Sep 09 23:08:16.285222 ip-10-0-143-228 systemd[1]: Starting Kubernetes Kubelet... Sep 09 23:08:16.682458 ip-10-0-143-228 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:08:16.682458 ip-10-0-143-228 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 23:08:16.682458 ip-10-0-143-228 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:08:16.682458 ip-10-0-143-228 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 23:08:16.682458 ip-10-0-143-228 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:08:16.684110 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.684033 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 23:08:16.687862 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687846 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:08:16.687862 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687861 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687865 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687868 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687873 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687875 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687879 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687882 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687884 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687887 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687889 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687902 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687905 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687907 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687910 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687913 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687915 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687918 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687921 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687923 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687928 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:08:16.687929 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687932 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687935 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687939 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687942 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687945 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687961 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687964 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687967 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687969 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687973 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687976 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687978 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687981 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687983 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687986 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687988 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687991 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687993 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687996 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.687998 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:08:16.688417 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688001 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688003 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688006 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688009 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688011 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688014 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688016 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688019 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688022 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688024 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688027 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688029 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688032 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688034 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688038 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688041 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688044 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688046 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688049 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688051 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:08:16.688885 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688054 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688057 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688060 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688062 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688065 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688067 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688070 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688072 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688075 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688078 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688080 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688082 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688085 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688087 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688090 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688094 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688097 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688100 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688103 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:08:16.689382 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688106 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688109 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688113 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688115 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688118 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688120 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688122 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688126 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688128 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688133 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688136 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688139 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688142 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688144 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688147 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688150 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688152 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688155 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688158 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:08:16.689848 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688855 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688862 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688866 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688869 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688872 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688875 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688878 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688880 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688883 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688886 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688889 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688892 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688895 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688897 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688900 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688903 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688905 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688908 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688911 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688914 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:08:16.690403 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688917 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688920 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688922 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688924 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688927 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688930 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688933 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688935 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688938 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688941 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688943 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688961 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688964 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688967 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688969 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688973 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688977 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688980 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688982 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:08:16.690940 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688987 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688991 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688994 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.688997 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689000 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689002 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689005 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689008 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689011 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689014 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689017 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689019 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689022 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689024 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689027 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689030 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689032 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689035 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689037 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689040 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:08:16.691425 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689042 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689044 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689047 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689049 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689052 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689054 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689057 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689059 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689062 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689064 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689067 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689069 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689072 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689074 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689076 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689079 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689082 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689085 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689087 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689090 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:08:16.691931 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689092 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689094 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689097 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689100 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689103 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689105 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689108 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689110 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689113 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689115 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689118 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689120 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689123 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689126 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689129 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689131 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689134 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689137 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689140 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689142 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:08:16.692434 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689516 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689521 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689525 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689529 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689532 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689535 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689538 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689543 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689546 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689548 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689551 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689553 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689556 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689559 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689561 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689564 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689567 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689570 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689573 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689576 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:08:16.692928 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689578 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689581 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689586 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689589 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689592 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689595 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689597 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689600 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689604 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689608 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689613 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689617 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689623 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689655 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689671 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689676 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689680 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689683 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689686 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:08:16.693415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689688 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689691 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689693 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689696 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689699 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689702 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689705 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689708 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689711 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689714 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689716 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689719 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689725 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689728 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689731 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689733 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689737 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689739 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689743 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689745 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:08:16.693884 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689748 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689750 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689753 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689756 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689759 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689762 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689764 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689768 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689770 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689773 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689776 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689778 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689781 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689783 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689786 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689788 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689791 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689793 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689796 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689800 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:08:16.694374 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689805 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689808 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689811 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689814 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689816 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689820 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689822 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689825 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689827 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689830 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689833 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689835 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689838 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689841 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689843 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689846 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689849 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689852 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689855 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.689858 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:08:16.694939 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.689945 2567 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.689997 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690011 2567 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690021 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690027 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690032 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690039 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690044 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690047 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690050 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690054 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690057 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690060 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690063 2567 flags.go:64] FLAG: --cgroup-root="" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690066 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690070 2567 flags.go:64] FLAG: --client-ca-file="" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690072 2567 flags.go:64] FLAG: --cloud-provider="external" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690075 2567 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690078 2567 flags.go:64] FLAG: --cluster-domain="" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690082 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690085 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690088 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690093 2567 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690097 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 23:08:16.695495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690100 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690103 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690106 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690110 2567 flags.go:64] FLAG: --contention-profiling="false" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690113 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690116 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690119 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690122 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690126 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690130 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690133 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690136 2567 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690139 2567 flags.go:64] FLAG: --enable-server="true" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690142 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690147 2567 flags.go:64] FLAG: --event-burst="100" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690150 2567 flags.go:64] FLAG: --event-qps="50" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690153 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690156 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690159 2567 flags.go:64] FLAG: --eviction-hard="" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690162 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690165 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690168 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690171 2567 flags.go:64] FLAG: --eviction-soft="" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690174 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690177 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 23:08:16.696108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690179 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690182 2567 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690185 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690188 2567 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690191 2567 flags.go:64] FLAG: --feature-gates="" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690196 2567 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690199 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690203 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690205 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690209 2567 flags.go:64] FLAG: --healthz-port="10248" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690212 2567 flags.go:64] FLAG: --help="false" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690215 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-143-228.ec2.internal" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690218 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690221 2567 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690224 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690227 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690231 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690234 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690237 2567 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690240 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690243 2567 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690245 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690249 2567 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690251 2567 flags.go:64] FLAG: --kube-reserved="" Sep 09 23:08:16.696718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690254 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690256 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690259 2567 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690262 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690265 2567 flags.go:64] FLAG: --lock-file="" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690267 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690270 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690273 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690279 2567 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690282 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690284 2567 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690287 2567 flags.go:64] FLAG: --logging-format="text" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690290 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690295 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690298 2567 flags.go:64] FLAG: --manifest-url="" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690300 2567 flags.go:64] FLAG: --manifest-url-header="" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690305 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690308 2567 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690314 2567 flags.go:64] FLAG: --max-pods="110" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690317 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690320 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690323 2567 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690326 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690329 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690332 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 23:08:16.697331 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690335 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690342 2567 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690345 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690348 2567 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690351 2567 flags.go:64] FLAG: --pod-cidr="" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690354 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690359 2567 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690362 2567 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690365 2567 flags.go:64] FLAG: --pods-per-core="0" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690369 2567 flags.go:64] FLAG: --port="10250" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690372 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690374 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09bf167b785438942" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690377 2567 flags.go:64] FLAG: --qos-reserved="" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690380 2567 flags.go:64] FLAG: --read-only-port="10255" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690383 2567 flags.go:64] FLAG: --register-node="true" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690386 2567 flags.go:64] FLAG: --register-with-taints="" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690389 2567 flags.go:64] FLAG: --registry-burst="10" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690392 2567 flags.go:64] FLAG: --registry-qps="5" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690395 2567 flags.go:64] FLAG: --reserved-cpus="" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690398 2567 flags.go:64] FLAG: --reserved-memory="" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690403 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690406 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690409 2567 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690412 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690415 2567 flags.go:64] FLAG: --runonce="false" Sep 09 23:08:16.698092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690418 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690423 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690426 2567 flags.go:64] FLAG: --seccomp-default="false" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690429 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690432 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690435 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690438 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690441 2567 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690444 2567 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690447 2567 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690450 2567 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690453 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690456 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690459 2567 flags.go:64] FLAG: --system-cgroups="" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690462 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690468 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690471 2567 flags.go:64] FLAG: --tls-cert-file="" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690475 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690478 2567 flags.go:64] FLAG: --tls-min-version="" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690480 2567 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690483 2567 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690486 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690489 2567 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690492 2567 flags.go:64] FLAG: --v="2" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690495 2567 flags.go:64] FLAG: --version="false" Sep 09 23:08:16.698980 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690499 2567 flags.go:64] FLAG: --vmodule="" Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690503 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.690508 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690639 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690642 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690646 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690649 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690652 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690658 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690661 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690663 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690666 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690669 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690671 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690674 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690677 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690679 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690682 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690685 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690687 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:08:16.699625 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690690 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690695 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690698 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690703 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690706 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690709 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690712 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690715 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690717 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690720 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690723 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690726 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690728 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690731 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690735 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690738 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690740 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690743 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690746 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:08:16.700127 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690748 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690752 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690754 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690757 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690760 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690762 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690765 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690767 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690770 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690773 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690775 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690778 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690782 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690786 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690789 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690791 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690794 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690796 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690799 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:08:16.700583 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690802 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690804 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690807 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690809 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690812 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690814 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690817 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690819 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690823 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690826 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690828 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690831 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690833 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690836 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690839 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690842 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690845 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690847 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690850 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690852 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:08:16.701054 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690855 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690858 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690860 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690863 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690865 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690868 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690871 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690873 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690876 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690887 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690890 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690893 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690895 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690898 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690901 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690903 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690906 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690908 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690911 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690913 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:08:16.701548 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690917 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:08:16.702063 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690920 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:08:16.702063 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690922 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:08:16.702063 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.690925 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:08:16.702063 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.691571 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:08:16.702063 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.699717 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 23:08:16.702063 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.699735 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 23:08:16.702063 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.700653 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 23:08:16.702063 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.700661 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 23:08:16.702063 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700719 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:08:16.702063 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700725 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:08:16.702063 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700728 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:08:16.702063 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700732 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:08:16.702063 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700735 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:08:16.702063 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700738 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700741 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700745 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700747 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700750 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700753 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700755 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700759 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700764 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700766 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700769 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700771 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700774 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700777 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700780 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700783 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700785 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700788 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700791 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700793 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:08:16.702415 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700796 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700799 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700802 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700805 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700808 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700811 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700814 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700816 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700819 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700823 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700827 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700830 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700833 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700835 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700838 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700840 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700843 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700846 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700848 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:08:16.702943 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700851 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700854 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700856 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700859 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700861 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700864 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700866 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700869 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700871 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700874 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700876 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700879 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700881 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700884 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700886 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700889 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700893 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700896 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700900 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700903 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:08:16.703426 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700906 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700909 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700912 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700914 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700917 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700920 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700922 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700925 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700927 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700930 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700932 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700936 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700938 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700941 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700943 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700957 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700960 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700962 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700965 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700968 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:08:16.703908 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700970 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:08:16.704463 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700973 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:08:16.704463 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700975 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:08:16.704463 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700978 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:08:16.704463 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700981 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:08:16.704463 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700983 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:08:16.704463 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700986 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:08:16.704463 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700989 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:08:16.704463 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700991 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:08:16.704463 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700995 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:08:16.704463 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.700997 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:08:16.704463 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701000 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:08:16.704463 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701003 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:08:16.704463 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701005 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:08:16.704463 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701008 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:08:16.704463 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.701013 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701126 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701130 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701133 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701136 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701139 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701141 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701144 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701147 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701149 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701152 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701154 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701157 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701160 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701163 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701166 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701168 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701171 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701173 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701176 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:08:16.704830 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701178 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701181 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701183 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701186 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701188 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701191 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701194 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701197 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701199 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701202 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701204 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701207 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701210 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701212 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701215 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701217 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701219 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701222 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701224 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701227 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:08:16.705333 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701229 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701232 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701234 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701237 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701239 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701243 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701248 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701250 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701253 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701255 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701258 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701261 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701263 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701266 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701268 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701271 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701273 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701276 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701279 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:08:16.705820 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701281 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701284 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701286 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701289 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701291 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701294 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701296 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701299 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701302 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701306 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701309 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701312 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701315 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701317 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701320 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701322 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701325 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701327 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701330 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:08:16.706299 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701334 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701337 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701339 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701342 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701345 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701347 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701350 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701353 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701355 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701357 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701360 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701362 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701365 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701367 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701370 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701372 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701375 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701377 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701379 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701382 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:08:16.707527 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701384 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:08:16.708084 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:16.701387 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:08:16.708084 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.701392 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:08:16.708084 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.701496 2567 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 23:08:16.708084 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.705355 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 23:08:16.708084 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.706238 2567 server.go:1019] "Starting client certificate rotation" Sep 09 23:08:16.708084 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.706335 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:08:16.708084 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.706362 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:08:16.709640 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.709627 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:08:16.710776 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.710758 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:08:16.726452 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.726431 2567 log.go:25] "Validated CRI v1 runtime API" Sep 09 23:08:16.730056 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.730039 2567 log.go:25] "Validated CRI v1 image API" Sep 09 23:08:16.730888 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.730866 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 23:08:16.733484 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.733465 2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ce5dc69c-fae9-43f4-8275-d8650e21b83a:/dev/nvme0n1p4 d30c9cd9-2b0e-4c5d-bdd6-83fd0dcac9ec:/dev/nvme0n1p3] Sep 09 23:08:16.733549 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.733482 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 23:08:16.734908 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.734889 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:08:16.740225 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.740115 2567 manager.go:216] Machine: {Timestamp:2026-09-09 23:08:16.738785931 +0000 UTC m=+0.340434665 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3063540 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c52b28998bf2db65b530655bc3571 SystemUUID:ec2c52b2-8998-bf2d-b65b-530655bc3571 BootID:3a34ea66-eea0-45a0-95b9-fe8a91402f5b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:73:2f:72:63:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:73:2f:72:63:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:4f:76:e4:35:24 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 23:08:16.740225 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.740217 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 23:08:16.740349 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.740324 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 23:08:16.743328 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.743304 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 23:08:16.743462 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.743332 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-228.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 23:08:16.744092 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.744083 2567 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 23:08:16.744127 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.744095 2567 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 23:08:16.744127 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.744102 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:08:16.745467 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.745457 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:08:16.746386 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.746376 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 23:08:16.749415 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.749405 2567 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:08:16.749528 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.749519 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 23:08:16.749556 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.749548 2567 kubelet.go:486] "Attempting to sync node with API server" Sep 09 23:08:16.749586 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.749557 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 23:08:16.749586 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.749570 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 23:08:16.749586 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.749579 2567 kubelet.go:398] "Adding apiserver pod source" Sep 09 23:08:16.749685 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.749587 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 23:08:16.749927 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.749914 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:08:16.749994 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.749940 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:08:16.751941 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.751923 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 23:08:16.754437 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.754424 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 23:08:16.754485 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.754454 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 23:08:16.756221 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.756207 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 23:08:16.756288 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.756226 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 23:08:16.756288 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.756232 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 23:08:16.756288 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.756237 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 23:08:16.756288 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.756245 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 23:08:16.756288 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.756251 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 23:08:16.756288 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.756264 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 23:08:16.756288 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.756269 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 23:08:16.756288 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.756275 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 23:08:16.756288 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.756285 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 23:08:16.756514 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.756301 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 23:08:16.756514 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.756307 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 23:08:16.756999 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:16.756976 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 23:08:16.756999 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:16.756989 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 23:08:16.757102 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.757093 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 23:08:16.757134 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.757103 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 23:08:16.760148 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.760129 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-966j9" Sep 09 23:08:16.760669 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.760657 2567 server.go:1268] "Started kubelet" Sep 09 23:08:16.760771 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.760746 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 23:08:16.760810 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.760741 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 23:08:16.760850 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.760813 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 23:08:16.761508 ip-10-0-143-228 systemd[1]: Started Kubernetes Kubelet. Sep 09 23:08:16.762465 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.762449 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-228.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 23:08:16.764147 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.764125 2567 server.go:310] "Adding debug handlers to kubelet server" Sep 09 23:08:16.765782 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.765767 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 23:08:16.766824 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:16.766806 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 23:08:16.767789 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.767773 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-966j9" Sep 09 23:08:16.767867 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:16.766932 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-228.ec2.internal.18d3c9be7043106a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-228.ec2.internal,UID:ip-10-0-143-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-228.ec2.internal,},FirstTimestamp:2026-09-09 23:08:16.760631402 +0000 UTC m=+0.362280134,LastTimestamp:2026-09-09 23:08:16.760631402 +0000 UTC m=+0.362280134,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-228.ec2.internal,}" Sep 09 23:08:16.771352 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.771336 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 23:08:16.771428 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.771380 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 23:08:16.771478 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:16.771438 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 23:08:16.772082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.772065 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 23:08:16.772082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.772066 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 23:08:16.772213 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.772102 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 23:08:16.772213 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.772189 2567 reconstruct.go:97] "Volume reconstruction finished" Sep 09 23:08:16.772213 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.772199 2567 reconciler.go:29] "Reconciler: start to sync state" Sep 09 23:08:16.773025 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.773007 2567 factory.go:55] Registering systemd factory Sep 09 23:08:16.773025 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.773028 2567 factory.go:223] Registration of the systemd container factory successfully Sep 09 23:08:16.773164 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:16.773118 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 09 23:08:16.773164 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:16.773125 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 09 23:08:16.773277 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.773260 2567 factory.go:153] Registering CRI-O factory Sep 09 23:08:16.773277 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.773275 2567 factory.go:223] Registration of the crio container factory successfully Sep 09 23:08:16.773377 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.773329 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 23:08:16.773377 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.773366 2567 factory.go:103] Registering Raw factory Sep 09 23:08:16.773462 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.773383 2567 manager.go:1196] Started watching for new ooms in manager Sep 09 23:08:16.773944 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.773927 2567 manager.go:349] Starting recovery of all containers Sep 09 23:08:16.780662 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.780635 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 23:08:16.787026 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.787007 2567 manager.go:354] Recovery completed Sep 09 23:08:16.791329 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.791314 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:08:16.793051 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.793034 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:08:16.793125 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.793068 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:08:16.793125 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.793083 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:08:16.793682 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.793667 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 23:08:16.793682 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.793680 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 23:08:16.793795 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.793698 2567 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:08:16.793795 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.793682 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:08:16.794555 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.794538 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:08:16.794628 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.794580 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:08:16.794628 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.794590 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:08:16.795064 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.795045 2567 policy_none.go:49] "None policy: Start" Sep 09 23:08:16.795064 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.795067 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 23:08:16.795179 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.795081 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 23:08:16.796480 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.796467 2567 policy_none.go:47] "Start" Sep 09 23:08:16.836503 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.836487 2567 manager.go:337] "Starting Device Plugin manager" Sep 09 23:08:16.849817 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:16.836541 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 23:08:16.849817 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.836554 2567 server.go:87] "Starting device plugin registration server" Sep 09 23:08:16.849817 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.836791 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 23:08:16.849817 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.836828 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 23:08:16.849817 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.836908 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 23:08:16.849817 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.836997 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 23:08:16.849817 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.837010 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 23:08:16.849817 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:16.837923 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 23:08:16.849817 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:16.837981 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 23:08:16.885715 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.885691 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 23:08:16.885797 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.885746 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 23:08:16.885797 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.885771 2567 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 23:08:16.885883 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:16.885815 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 23:08:16.888140 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.888118 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:08:16.937168 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.937092 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:08:16.937992 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.937976 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:08:16.938077 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.938004 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:08:16.938077 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.938014 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:08:16.938077 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.938034 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-228.ec2.internal" Sep 09 23:08:16.943996 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.943981 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-228.ec2.internal" Sep 09 23:08:16.944079 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:16.944005 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-228.ec2.internal\": node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 23:08:16.961435 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:16.961412 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 23:08:16.986369 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.986348 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal"] Sep 09 23:08:16.986461 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.986418 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:08:16.988471 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.988456 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:08:16.988538 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.988483 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:08:16.988538 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.988493 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:08:16.990179 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.990166 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:08:16.990321 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.990308 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 23:08:16.990380 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.990341 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:08:16.990911 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.990889 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:08:16.990995 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.990915 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:08:16.990995 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.990931 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:08:16.991243 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.991229 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:08:16.991309 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.991248 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:08:16.991309 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.991257 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:08:16.992294 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.992277 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" Sep 09 23:08:16.992396 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.992303 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:08:16.995291 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.995274 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:08:16.995362 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.995308 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:08:16.995362 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:16.995323 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:08:17.021530 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:17.021510 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-228.ec2.internal\" not found" node="ip-10-0-143-228.ec2.internal" Sep 09 23:08:17.027305 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:17.027288 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-228.ec2.internal\" not found" node="ip-10-0-143-228.ec2.internal" Sep 09 23:08:17.062221 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:17.062201 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 23:08:17.074519 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:17.074500 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4729ed97ef7a8c38fc61d9b5517096f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"e4729ed97ef7a8c38fc61d9b5517096f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 23:08:17.074600 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:17.074524 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4729ed97ef7a8c38fc61d9b5517096f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"e4729ed97ef7a8c38fc61d9b5517096f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 23:08:17.074600 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:17.074542 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/728b04a33548859b274bbec2cc5b3fee-config\") pod \"kube-apiserver-proxy-ip-10-0-143-228.ec2.internal\" (UID: \"728b04a33548859b274bbec2cc5b3fee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" Sep 09 23:08:17.162456 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:17.162426 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 23:08:17.174789 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:17.174767 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4729ed97ef7a8c38fc61d9b5517096f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"e4729ed97ef7a8c38fc61d9b5517096f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 23:08:17.174857 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:17.174793 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4729ed97ef7a8c38fc61d9b5517096f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"e4729ed97ef7a8c38fc61d9b5517096f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 23:08:17.174857 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:17.174810 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/728b04a33548859b274bbec2cc5b3fee-config\") pod \"kube-apiserver-proxy-ip-10-0-143-228.ec2.internal\" (UID: \"728b04a33548859b274bbec2cc5b3fee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" Sep 09 23:08:17.174930 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:17.174871 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/728b04a33548859b274bbec2cc5b3fee-config\") pod \"kube-apiserver-proxy-ip-10-0-143-228.ec2.internal\" (UID: \"728b04a33548859b274bbec2cc5b3fee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" Sep 09 23:08:17.174930 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:17.174888 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4729ed97ef7a8c38fc61d9b5517096f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"e4729ed97ef7a8c38fc61d9b5517096f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 23:08:17.174930 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:17.174888 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4729ed97ef7a8c38fc61d9b5517096f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal\" (UID: \"e4729ed97ef7a8c38fc61d9b5517096f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 23:08:17.263255 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:17.263180 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 23:08:17.323635 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:17.323608 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 23:08:17.330819 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:17.330801 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" Sep 09 23:08:17.364300 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:17.364088 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 23:08:17.464611 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:17.464576 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 23:08:18.866860 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:18.866796 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 23:08:18.967383 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:18.967353 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 23:08:19.007848 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:19.007821 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 23:08:19.008290 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:19.008018 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 23:08:19.068134 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:19.068110 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 23:08:19.076677 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:19.076644 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 23:03:18 +0000 UTC" deadline="2028-03-02 20:39:02.317612835 +0000 UTC" Sep 09 23:08:19.076677 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:19.076673 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12957h30m43.240943159s" Sep 09 23:08:19.168587 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:19.168566 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-228.ec2.internal\" not found" Sep 09 23:08:19.173557 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:19.173531 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4729ed97ef7a8c38fc61d9b5517096f.slice/crio-f782ef48b371ac1c263dbd5ad8618a9db83af0d63b9c9f9570b804a709f92c8a WatchSource:0}: Error finding container f782ef48b371ac1c263dbd5ad8618a9db83af0d63b9c9f9570b804a709f92c8a: Status 404 returned error can't find the container with id f782ef48b371ac1c263dbd5ad8618a9db83af0d63b9c9f9570b804a709f92c8a Sep 09 23:08:19.173900 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:19.173883 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod728b04a33548859b274bbec2cc5b3fee.slice/crio-a957250748ee2bc13fc47bcf59cfd55a18321acf4517eb9fbc4f29aaad330e3c WatchSource:0}: Error finding container a957250748ee2bc13fc47bcf59cfd55a18321acf4517eb9fbc4f29aaad330e3c: Status 404 returned error can't find the container with id a957250748ee2bc13fc47bcf59cfd55a18321acf4517eb9fbc4f29aaad330e3c Sep 09 23:08:19.179924 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:19.179911 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:08:19.190574 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:19.190534 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" event={"ID":"e4729ed97ef7a8c38fc61d9b5517096f","Type":"ContainerStarted","Data":"f782ef48b371ac1c263dbd5ad8618a9db83af0d63b9c9f9570b804a709f92c8a"} Sep 09 23:08:19.191737 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:19.191718 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" event={"ID":"728b04a33548859b274bbec2cc5b3fee","Type":"ContainerStarted","Data":"a957250748ee2bc13fc47bcf59cfd55a18321acf4517eb9fbc4f29aaad330e3c"} Sep 09 23:08:19.245623 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:19.245603 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:08:19.273148 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:19.273129 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" Sep 09 23:08:19.284003 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:19.283984 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:08:19.286116 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:19.286105 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" Sep 09 23:08:19.294974 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:19.294953 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:08:19.492850 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:19.492777 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:08:19.514428 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:19.514407 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:08:20.052699 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.052660 2567 apiserver.go:52] "Watching apiserver" Sep 09 23:08:20.061259 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.061233 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 23:08:20.063250 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.063219 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-89z5t","openshift-dns/node-resolver-9644c","openshift-image-registry/node-ca-rx9nk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal","openshift-multus/multus-additional-cni-plugins-l98pp","kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g","openshift-multus/multus-fngv2","openshift-multus/network-metrics-daemon-gmk7t","openshift-network-diagnostics/network-check-target-bngkg","openshift-network-operator/iptables-alerter-vl8p7","openshift-ovn-kubernetes/ovnkube-node-lhh26","kube-system/global-pull-secret-syncer-skd4w","kube-system/konnectivity-agent-pt9ht"] Sep 09 23:08:20.065514 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.065196 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:20.065514 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.065278 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bngkg" podUID="9919def0-8417-43bd-b29e-af19906c55ca" Sep 09 23:08:20.066920 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.066898 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:20.067022 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.066971 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skd4w" podUID="f7f994f2-a498-4d06-8a5c-f14c842b48a9" Sep 09 23:08:20.068373 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.068259 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rx9nk" Sep 09 23:08:20.070070 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.069575 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pt9ht" Sep 09 23:08:20.070408 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.070336 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 23:08:20.070408 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.070386 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pz5xr\"" Sep 09 23:08:20.070543 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.070409 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 23:08:20.070678 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.070619 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 23:08:20.071139 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.071100 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 23:08:20.071482 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.071393 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 23:08:20.071482 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.071451 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.072111 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.071824 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lls7q\"" Sep 09 23:08:20.072998 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.072663 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.073150 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.073135 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 23:08:20.073216 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.073179 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wcrbr\"" Sep 09 23:08:20.073294 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.073274 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 23:08:20.073498 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.073482 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 23:08:20.073622 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.073605 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 23:08:20.073730 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.073649 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 23:08:20.073730 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.073611 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 23:08:20.076978 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.074837 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:20.076978 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.074921 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:08:20.076978 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.075783 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 23:08:20.076978 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.075973 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hp2hq\"" Sep 09 23:08:20.079539 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.079518 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.080824 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.080809 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9644c" Sep 09 23:08:20.081370 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.081350 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 23:08:20.081467 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.081353 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d96fs\"" Sep 09 23:08:20.081467 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.081456 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 23:08:20.081741 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.081721 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 23:08:20.082841 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.082821 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.082992 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.082935 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 23:08:20.083219 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.083200 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k6kfx\"" Sep 09 23:08:20.083483 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.083405 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 23:08:20.084305 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.084285 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vl8p7" Sep 09 23:08:20.084724 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.084704 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:08:20.084792 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.084732 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 23:08:20.084952 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.084932 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pnwbt\"" Sep 09 23:08:20.085899 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.085859 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:08:20.086069 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086042 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 23:08:20.086152 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086099 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 23:08:20.086152 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086044 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8sz4w\"" Sep 09 23:08:20.086253 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086153 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.086253 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086169 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:08:20.086546 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086529 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0195649c-31a5-4859-9643-26ae90ab325a-konnectivity-ca\") pod \"konnectivity-agent-pt9ht\" (UID: \"0195649c-31a5-4859-9643-26ae90ab325a\") " pod="kube-system/konnectivity-agent-pt9ht" Sep 09 23:08:20.086625 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086576 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfx9f\" (UniqueName: \"kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f\") pod \"network-check-target-bngkg\" (UID: \"9919def0-8417-43bd-b29e-af19906c55ca\") " pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:20.086625 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086612 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1668ae93-f22d-4b5d-b86d-0c120fd1ac49-host\") pod \"node-ca-rx9nk\" (UID: \"1668ae93-f22d-4b5d-b86d-0c120fd1ac49\") " pod="openshift-image-registry/node-ca-rx9nk" Sep 09 23:08:20.086722 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086632 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhzjg\" (UniqueName: \"kubernetes.io/projected/1668ae93-f22d-4b5d-b86d-0c120fd1ac49-kube-api-access-hhzjg\") pod \"node-ca-rx9nk\" (UID: \"1668ae93-f22d-4b5d-b86d-0c120fd1ac49\") " pod="openshift-image-registry/node-ca-rx9nk" Sep 09 23:08:20.086722 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086651 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-run-k8s-cni-cncf-io\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.086722 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086686 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-etc-kubernetes\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.086863 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086728 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.086863 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086755 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.086863 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086772 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs\") pod \"network-metrics-daemon-gmk7t\" (UID: \"2e433ce1-5876-44c1-bafd-cf7237901a04\") " pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:20.086863 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086786 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1668ae93-f22d-4b5d-b86d-0c120fd1ac49-serviceca\") pod \"node-ca-rx9nk\" (UID: \"1668ae93-f22d-4b5d-b86d-0c120fd1ac49\") " pod="openshift-image-registry/node-ca-rx9nk" Sep 09 23:08:20.086863 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086813 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-system-cni-dir\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.086863 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086833 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-run-multus-certs\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.086863 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086862 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-cnibin\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.087138 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086877 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-cni-binary-copy\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.087138 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086891 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-multus-conf-dir\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.087138 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086914 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh4bk\" (UniqueName: \"kubernetes.io/projected/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-kube-api-access-dh4bk\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.087138 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086929 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-multus-cni-dir\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.087138 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086943 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-multus-socket-dir-parent\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.087138 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086962 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcfwt\" (UniqueName: \"kubernetes.io/projected/8c15c466-4329-4033-9a57-92b61c400874-kube-api-access-gcfwt\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.087138 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.086984 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7f994f2-a498-4d06-8a5c-f14c842b48a9-dbus\") pod \"global-pull-secret-syncer-skd4w\" (UID: \"f7f994f2-a498-4d06-8a5c-f14c842b48a9\") " pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:20.087138 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087016 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-system-cni-dir\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.087138 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087043 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj9nt\" (UniqueName: \"kubernetes.io/projected/2e433ce1-5876-44c1-bafd-cf7237901a04-kube-api-access-nj9nt\") pod \"network-metrics-daemon-gmk7t\" (UID: \"2e433ce1-5876-44c1-bafd-cf7237901a04\") " pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:20.087138 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087061 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c15c466-4329-4033-9a57-92b61c400874-multus-daemon-config\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.087138 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087094 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0195649c-31a5-4859-9643-26ae90ab325a-agent-certs\") pod \"konnectivity-agent-pt9ht\" (UID: \"0195649c-31a5-4859-9643-26ae90ab325a\") " pod="kube-system/konnectivity-agent-pt9ht" Sep 09 23:08:20.087138 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087124 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.087138 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087140 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-cnibin\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.087671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087173 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-var-lib-cni-multus\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.087671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7f994f2-a498-4d06-8a5c-f14c842b48a9-kubelet-config\") pod \"global-pull-secret-syncer-skd4w\" (UID: \"f7f994f2-a498-4d06-8a5c-f14c842b48a9\") " pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:20.087671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087219 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c15c466-4329-4033-9a57-92b61c400874-cni-binary-copy\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.087671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087297 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-run-netns\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.087671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087313 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-var-lib-cni-bin\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.087671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087335 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-var-lib-kubelet\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.087671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087356 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-hostroot\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.087671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087379 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret\") pod \"global-pull-secret-syncer-skd4w\" (UID: \"f7f994f2-a498-4d06-8a5c-f14c842b48a9\") " pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:20.087671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087568 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 23:08:20.087671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087664 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 23:08:20.088211 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087943 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 23:08:20.088211 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.087966 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 23:08:20.088282 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.088256 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 23:08:20.088320 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.088301 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 23:08:20.088320 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.088309 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-47jvd\"" Sep 09 23:08:20.111151 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.111132 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-krxxr" Sep 09 23:08:20.120970 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.120942 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-krxxr" Sep 09 23:08:20.178398 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.178365 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 23:08:20.188263 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188237 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-hostroot\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.188394 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188275 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret\") pod \"global-pull-secret-syncer-skd4w\" (UID: \"f7f994f2-a498-4d06-8a5c-f14c842b48a9\") " pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:20.188394 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188302 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-systemd-units\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.188394 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188324 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-node-log\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.188394 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188346 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a23eb22f-765f-4d94-8315-623722d7e706-ovnkube-config\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.188394 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188349 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-hostroot\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.188394 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188367 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-registration-dir\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.188394 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188388 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a832abe-6374-4c97-be59-eb9e1423903c-tmp-dir\") pod \"node-resolver-9644c\" (UID: \"8a832abe-6374-4c97-be59-eb9e1423903c\") " pod="openshift-dns/node-resolver-9644c" Sep 09 23:08:20.188816 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188409 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-systemd\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.188816 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188443 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-sys\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.188816 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.188468 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:20.188816 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.188537 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret podName:f7f994f2-a498-4d06-8a5c-f14c842b48a9 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:20.688508382 +0000 UTC m=+2.988515895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret") pod "global-pull-secret-syncer-skd4w" (UID: "f7f994f2-a498-4d06-8a5c-f14c842b48a9") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:20.188816 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188469 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhzjg\" (UniqueName: \"kubernetes.io/projected/1668ae93-f22d-4b5d-b86d-0c120fd1ac49-kube-api-access-hhzjg\") pod \"node-ca-rx9nk\" (UID: \"1668ae93-f22d-4b5d-b86d-0c120fd1ac49\") " pod="openshift-image-registry/node-ca-rx9nk" Sep 09 23:08:20.188816 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188722 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-run-k8s-cni-cncf-io\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.188816 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188750 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.188816 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188773 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs\") pod \"network-metrics-daemon-gmk7t\" (UID: \"2e433ce1-5876-44c1-bafd-cf7237901a04\") " pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:20.188816 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188801 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-var-lib-openvswitch\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.189228 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188822 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srq78\" (UniqueName: \"kubernetes.io/projected/a23eb22f-765f-4d94-8315-623722d7e706-kube-api-access-srq78\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.189228 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188830 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-run-k8s-cni-cncf-io\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.189228 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188856 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.189228 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188884 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-lib-modules\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.189228 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.188916 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:20.189228 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.188962 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs podName:2e433ce1-5876-44c1-bafd-cf7237901a04 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:20.688947768 +0000 UTC m=+2.988955267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs") pod "network-metrics-daemon-gmk7t" (UID: "2e433ce1-5876-44c1-bafd-cf7237901a04") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:20.189515 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189370 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1668ae93-f22d-4b5d-b86d-0c120fd1ac49-serviceca\") pod \"node-ca-rx9nk\" (UID: \"1668ae93-f22d-4b5d-b86d-0c120fd1ac49\") " pod="openshift-image-registry/node-ca-rx9nk" Sep 09 23:08:20.189515 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.188909 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1668ae93-f22d-4b5d-b86d-0c120fd1ac49-serviceca\") pod \"node-ca-rx9nk\" (UID: \"1668ae93-f22d-4b5d-b86d-0c120fd1ac49\") " pod="openshift-image-registry/node-ca-rx9nk" Sep 09 23:08:20.189515 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189454 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-run\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.189515 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189472 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.189515 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189479 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-var-lib-kubelet\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.189515 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189504 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c811b579-2709-48db-96df-a61df8ee5a24-iptables-alerter-script\") pod \"iptables-alerter-vl8p7\" (UID: \"c811b579-2709-48db-96df-a61df8ee5a24\") " pod="openshift-network-operator/iptables-alerter-vl8p7" Sep 09 23:08:20.189855 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189527 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c811b579-2709-48db-96df-a61df8ee5a24-host-slash\") pod \"iptables-alerter-vl8p7\" (UID: \"c811b579-2709-48db-96df-a61df8ee5a24\") " pod="openshift-network-operator/iptables-alerter-vl8p7" Sep 09 23:08:20.189855 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189562 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-multus-conf-dir\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.189855 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189611 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-kubelet\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.189855 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189636 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.189855 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189654 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-multus-conf-dir\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.189855 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189663 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a23eb22f-765f-4d94-8315-623722d7e706-env-overrides\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.189855 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189697 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a23eb22f-765f-4d94-8315-623722d7e706-ovnkube-script-lib\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.189855 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189754 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-sysctl-d\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.189855 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189791 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-multus-cni-dir\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.189855 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189816 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-multus-socket-dir-parent\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.189855 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189840 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-run-netns\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.190206 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189874 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.190206 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189917 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-device-dir\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.190206 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189940 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-tuned\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.190206 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189979 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c15c466-4329-4033-9a57-92b61c400874-multus-daemon-config\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.190206 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189996 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-multus-cni-dir\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.190206 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190005 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.190206 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.189978 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-multus-socket-dir-parent\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.190206 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190032 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vczr5\" (UniqueName: \"kubernetes.io/projected/8a832abe-6374-4c97-be59-eb9e1423903c-kube-api-access-vczr5\") pod \"node-resolver-9644c\" (UID: \"8a832abe-6374-4c97-be59-eb9e1423903c\") " pod="openshift-dns/node-resolver-9644c" Sep 09 23:08:20.190206 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190076 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-sysconfig\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.190206 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190103 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9dc161a-a59b-422e-8575-0141fd4aa565-tmp\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.190206 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190147 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-cnibin\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.190206 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190178 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-var-lib-cni-multus\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.190206 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190201 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7f994f2-a498-4d06-8a5c-f14c842b48a9-kubelet-config\") pod \"global-pull-secret-syncer-skd4w\" (UID: \"f7f994f2-a498-4d06-8a5c-f14c842b48a9\") " pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:20.190671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190232 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-var-lib-cni-bin\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.190671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190259 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-var-lib-kubelet\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.190671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190274 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a23eb22f-765f-4d94-8315-623722d7e706-ovn-node-metrics-cert\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.190671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190295 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-sys-fs\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.190671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190336 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0195649c-31a5-4859-9643-26ae90ab325a-konnectivity-ca\") pod \"konnectivity-agent-pt9ht\" (UID: \"0195649c-31a5-4859-9643-26ae90ab325a\") " pod="kube-system/konnectivity-agent-pt9ht" Sep 09 23:08:20.190671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190351 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-cni-netd\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.190671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190365 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c15c466-4329-4033-9a57-92b61c400874-multus-daemon-config\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.190671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190370 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-host\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.190671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190396 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx9f\" (UniqueName: \"kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f\") pod \"network-check-target-bngkg\" (UID: \"9919def0-8417-43bd-b29e-af19906c55ca\") " pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:20.190671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190412 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-var-lib-cni-bin\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.190671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190420 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-var-lib-kubelet\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.190671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190459 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.190671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190473 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7f994f2-a498-4d06-8a5c-f14c842b48a9-kubelet-config\") pod \"global-pull-secret-syncer-skd4w\" (UID: \"f7f994f2-a498-4d06-8a5c-f14c842b48a9\") " pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:20.190671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190479 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-cnibin\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.190671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190505 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-var-lib-cni-multus\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.190671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190469 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1668ae93-f22d-4b5d-b86d-0c120fd1ac49-host\") pod \"node-ca-rx9nk\" (UID: \"1668ae93-f22d-4b5d-b86d-0c120fd1ac49\") " pod="openshift-image-registry/node-ca-rx9nk" Sep 09 23:08:20.190671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190616 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1668ae93-f22d-4b5d-b86d-0c120fd1ac49-host\") pod \"node-ca-rx9nk\" (UID: \"1668ae93-f22d-4b5d-b86d-0c120fd1ac49\") " pod="openshift-image-registry/node-ca-rx9nk" Sep 09 23:08:20.191390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190621 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-etc-kubernetes\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.191390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190652 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.191390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190678 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-log-socket\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.191390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190701 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-system-cni-dir\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.191390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190726 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-run-multus-certs\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.191390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190751 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-cnibin\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.191390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190757 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-etc-kubernetes\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.191390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190774 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-cni-binary-copy\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.191390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190799 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-sysctl-conf\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.191390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190825 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7cll\" (UniqueName: \"kubernetes.io/projected/e9dc161a-a59b-422e-8575-0141fd4aa565-kube-api-access-r7cll\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.191390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190829 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-system-cni-dir\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.191390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190851 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kspcg\" (UniqueName: \"kubernetes.io/projected/c811b579-2709-48db-96df-a61df8ee5a24-kube-api-access-kspcg\") pod \"iptables-alerter-vl8p7\" (UID: \"c811b579-2709-48db-96df-a61df8ee5a24\") " pod="openshift-network-operator/iptables-alerter-vl8p7" Sep 09 23:08:20.191390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190879 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh4bk\" (UniqueName: \"kubernetes.io/projected/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-kube-api-access-dh4bk\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.191390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190887 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-cnibin\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.191390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190901 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-slash\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.191390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190855 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0195649c-31a5-4859-9643-26ae90ab325a-konnectivity-ca\") pod \"konnectivity-agent-pt9ht\" (UID: \"0195649c-31a5-4859-9643-26ae90ab325a\") " pod="kube-system/konnectivity-agent-pt9ht" Sep 09 23:08:20.191390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190930 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.192164 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190799 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-run-multus-certs\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.192164 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190931 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-run-ovn\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.192164 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.190968 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcfwt\" (UniqueName: \"kubernetes.io/projected/8c15c466-4329-4033-9a57-92b61c400874-kube-api-access-gcfwt\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.192164 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191113 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7f994f2-a498-4d06-8a5c-f14c842b48a9-dbus\") pod \"global-pull-secret-syncer-skd4w\" (UID: \"f7f994f2-a498-4d06-8a5c-f14c842b48a9\") " pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:20.192164 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191184 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-system-cni-dir\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.192164 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191232 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj9nt\" (UniqueName: \"kubernetes.io/projected/2e433ce1-5876-44c1-bafd-cf7237901a04-kube-api-access-nj9nt\") pod \"network-metrics-daemon-gmk7t\" (UID: \"2e433ce1-5876-44c1-bafd-cf7237901a04\") " pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:20.192164 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191233 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7f994f2-a498-4d06-8a5c-f14c842b48a9-dbus\") pod \"global-pull-secret-syncer-skd4w\" (UID: \"f7f994f2-a498-4d06-8a5c-f14c842b48a9\") " pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:20.192164 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191252 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-system-cni-dir\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.192164 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191281 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-cni-binary-copy\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.192164 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191291 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.192164 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191416 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-socket-dir\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.192164 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191445 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt49d\" (UniqueName: \"kubernetes.io/projected/edc518f3-1517-4875-9f98-49e26e02ec83-kube-api-access-bt49d\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.192164 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191504 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a832abe-6374-4c97-be59-eb9e1423903c-hosts-file\") pod \"node-resolver-9644c\" (UID: \"8a832abe-6374-4c97-be59-eb9e1423903c\") " pod="openshift-dns/node-resolver-9644c" Sep 09 23:08:20.192164 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191529 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0195649c-31a5-4859-9643-26ae90ab325a-agent-certs\") pod \"konnectivity-agent-pt9ht\" (UID: \"0195649c-31a5-4859-9643-26ae90ab325a\") " pod="kube-system/konnectivity-agent-pt9ht" Sep 09 23:08:20.192164 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191568 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-run-openvswitch\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.192164 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191637 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-cni-bin\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.192164 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191674 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-run-systemd\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.192975 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191717 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-etc-openvswitch\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.192975 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191745 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-modprobe-d\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.192975 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191765 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-kubernetes\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.192975 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191794 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c15c466-4329-4033-9a57-92b61c400874-cni-binary-copy\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.192975 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191819 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-run-netns\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.192975 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191853 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 23:08:20.192975 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.191906 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c15c466-4329-4033-9a57-92b61c400874-host-run-netns\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.192975 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.192251 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c15c466-4329-4033-9a57-92b61c400874-cni-binary-copy\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.195848 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.195829 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhzjg\" (UniqueName: \"kubernetes.io/projected/1668ae93-f22d-4b5d-b86d-0c120fd1ac49-kube-api-access-hhzjg\") pod \"node-ca-rx9nk\" (UID: \"1668ae93-f22d-4b5d-b86d-0c120fd1ac49\") " pod="openshift-image-registry/node-ca-rx9nk" Sep 09 23:08:20.195848 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.195839 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0195649c-31a5-4859-9643-26ae90ab325a-agent-certs\") pod \"konnectivity-agent-pt9ht\" (UID: \"0195649c-31a5-4859-9643-26ae90ab325a\") " pod="kube-system/konnectivity-agent-pt9ht" Sep 09 23:08:20.198616 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.198583 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:08:20.198700 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.198621 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:08:20.198700 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.198635 2567 projected.go:196] Error preparing data for projected volume kube-api-access-jfx9f for pod openshift-network-diagnostics/network-check-target-bngkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:20.198775 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.198735 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f podName:9919def0-8417-43bd-b29e-af19906c55ca nodeName:}" failed. No retries permitted until 2026-09-09 23:08:20.698718511 +0000 UTC m=+2.998726014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jfx9f" (UniqueName: "kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f") pod "network-check-target-bngkg" (UID: "9919def0-8417-43bd-b29e-af19906c55ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:20.201657 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.201635 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcfwt\" (UniqueName: \"kubernetes.io/projected/8c15c466-4329-4033-9a57-92b61c400874-kube-api-access-gcfwt\") pod \"multus-fngv2\" (UID: \"8c15c466-4329-4033-9a57-92b61c400874\") " pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.201770 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.201680 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh4bk\" (UniqueName: \"kubernetes.io/projected/130a2012-14a3-4b9f-ae73-7a3a3fe7cf59-kube-api-access-dh4bk\") pod \"multus-additional-cni-plugins-l98pp\" (UID: \"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59\") " pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.202062 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.202040 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj9nt\" (UniqueName: \"kubernetes.io/projected/2e433ce1-5876-44c1-bafd-cf7237901a04-kube-api-access-nj9nt\") pod \"network-metrics-daemon-gmk7t\" (UID: \"2e433ce1-5876-44c1-bafd-cf7237901a04\") " pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:20.292171 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292138 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a23eb22f-765f-4d94-8315-623722d7e706-ovn-node-metrics-cert\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.292171 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292175 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-sys-fs\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.292392 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292196 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-cni-netd\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.292392 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292217 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-host\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.292392 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292270 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-host\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.292392 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292269 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-sys-fs\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.292392 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292269 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-cni-netd\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.292392 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292302 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-log-socket\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.292392 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292334 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-log-socket\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.292392 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292342 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-sysctl-conf\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.292392 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292371 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7cll\" (UniqueName: \"kubernetes.io/projected/e9dc161a-a59b-422e-8575-0141fd4aa565-kube-api-access-r7cll\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.292796 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292396 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kspcg\" (UniqueName: \"kubernetes.io/projected/c811b579-2709-48db-96df-a61df8ee5a24-kube-api-access-kspcg\") pod \"iptables-alerter-vl8p7\" (UID: \"c811b579-2709-48db-96df-a61df8ee5a24\") " pod="openshift-network-operator/iptables-alerter-vl8p7" Sep 09 23:08:20.292796 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292421 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-slash\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.292796 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292444 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-run-ovn\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.292796 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292473 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.292796 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292487 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-sysctl-conf\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.292796 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292496 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-socket-dir\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.292796 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292524 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-slash\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.292796 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292539 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt49d\" (UniqueName: \"kubernetes.io/projected/edc518f3-1517-4875-9f98-49e26e02ec83-kube-api-access-bt49d\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.292796 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292569 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a832abe-6374-4c97-be59-eb9e1423903c-hosts-file\") pod \"node-resolver-9644c\" (UID: \"8a832abe-6374-4c97-be59-eb9e1423903c\") " pod="openshift-dns/node-resolver-9644c" Sep 09 23:08:20.292796 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292576 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.292796 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292540 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-run-ovn\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.292796 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292609 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-run-openvswitch\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.292796 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292634 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-cni-bin\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.292796 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292646 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-socket-dir\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.292796 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292652 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a832abe-6374-4c97-be59-eb9e1423903c-hosts-file\") pod \"node-resolver-9644c\" (UID: \"8a832abe-6374-4c97-be59-eb9e1423903c\") " pod="openshift-dns/node-resolver-9644c" Sep 09 23:08:20.292796 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292660 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-run-systemd\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.292796 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292688 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-etc-openvswitch\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292689 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-run-openvswitch\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292741 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-etc-openvswitch\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292731 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-cni-bin\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292782 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-run-systemd\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292797 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-modprobe-d\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292838 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-kubernetes\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292896 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-kubernetes\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292911 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-systemd-units\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292937 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-node-log\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292962 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a23eb22f-765f-4d94-8315-623722d7e706-ovnkube-config\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292988 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-registration-dir\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292995 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-node-log\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292916 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-modprobe-d\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.292941 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-systemd-units\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293018 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a832abe-6374-4c97-be59-eb9e1423903c-tmp-dir\") pod \"node-resolver-9644c\" (UID: \"8a832abe-6374-4c97-be59-eb9e1423903c\") " pod="openshift-dns/node-resolver-9644c" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293039 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-systemd\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293064 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-sys\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.293579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293106 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-systemd\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.294404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293121 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-var-lib-openvswitch\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.294404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293151 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-sys\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.294404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293062 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-registration-dir\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.294404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293149 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srq78\" (UniqueName: \"kubernetes.io/projected/a23eb22f-765f-4d94-8315-623722d7e706-kube-api-access-srq78\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.294404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293196 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.294404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293201 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-var-lib-openvswitch\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.294404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293222 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-lib-modules\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.294404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-run\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.294404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293268 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-var-lib-kubelet\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.294404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293290 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c811b579-2709-48db-96df-a61df8ee5a24-iptables-alerter-script\") pod \"iptables-alerter-vl8p7\" (UID: \"c811b579-2709-48db-96df-a61df8ee5a24\") " pod="openshift-network-operator/iptables-alerter-vl8p7" Sep 09 23:08:20.294404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293315 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c811b579-2709-48db-96df-a61df8ee5a24-host-slash\") pod \"iptables-alerter-vl8p7\" (UID: \"c811b579-2709-48db-96df-a61df8ee5a24\") " pod="openshift-network-operator/iptables-alerter-vl8p7" Sep 09 23:08:20.294404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293340 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-kubelet\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.294404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293364 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.294404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293379 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a832abe-6374-4c97-be59-eb9e1423903c-tmp-dir\") pod \"node-resolver-9644c\" (UID: \"8a832abe-6374-4c97-be59-eb9e1423903c\") " pod="openshift-dns/node-resolver-9644c" Sep 09 23:08:20.294404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293391 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a23eb22f-765f-4d94-8315-623722d7e706-env-overrides\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.294404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293414 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a23eb22f-765f-4d94-8315-623722d7e706-ovnkube-script-lib\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.294404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293435 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-var-lib-kubelet\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.295082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293457 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-kubelet\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.295082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293460 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.295082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293491 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a23eb22f-765f-4d94-8315-623722d7e706-ovnkube-config\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.295082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293510 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.295082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293536 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c811b579-2709-48db-96df-a61df8ee5a24-host-slash\") pod \"iptables-alerter-vl8p7\" (UID: \"c811b579-2709-48db-96df-a61df8ee5a24\") " pod="openshift-network-operator/iptables-alerter-vl8p7" Sep 09 23:08:20.295082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293609 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-lib-modules\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.295082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293638 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-run\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.295082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293655 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-sysctl-d\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.295082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293673 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-run-netns\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.295082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293689 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.295082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293704 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-device-dir\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.295082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293718 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-tuned\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.295082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293735 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vczr5\" (UniqueName: \"kubernetes.io/projected/8a832abe-6374-4c97-be59-eb9e1423903c-kube-api-access-vczr5\") pod \"node-resolver-9644c\" (UID: \"8a832abe-6374-4c97-be59-eb9e1423903c\") " pod="openshift-dns/node-resolver-9644c" Sep 09 23:08:20.295082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293750 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-sysconfig\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.295082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293763 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9dc161a-a59b-422e-8575-0141fd4aa565-tmp\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.295082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293852 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a23eb22f-765f-4d94-8315-623722d7e706-env-overrides\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.295082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293917 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-device-dir\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.295652 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.293974 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a23eb22f-765f-4d94-8315-623722d7e706-ovnkube-script-lib\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.295652 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.294029 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-sysctl-d\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.295652 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.294070 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a23eb22f-765f-4d94-8315-623722d7e706-host-run-netns\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.295652 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.294115 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/edc518f3-1517-4875-9f98-49e26e02ec83-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.295652 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.294162 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-sysconfig\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.295652 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.294621 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c811b579-2709-48db-96df-a61df8ee5a24-iptables-alerter-script\") pod \"iptables-alerter-vl8p7\" (UID: \"c811b579-2709-48db-96df-a61df8ee5a24\") " pod="openshift-network-operator/iptables-alerter-vl8p7" Sep 09 23:08:20.295652 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.295034 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a23eb22f-765f-4d94-8315-623722d7e706-ovn-node-metrics-cert\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.296115 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.296076 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9dc161a-a59b-422e-8575-0141fd4aa565-tmp\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.296259 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.296239 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9dc161a-a59b-422e-8575-0141fd4aa565-etc-tuned\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.300142 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.300114 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt49d\" (UniqueName: \"kubernetes.io/projected/edc518f3-1517-4875-9f98-49e26e02ec83-kube-api-access-bt49d\") pod \"aws-ebs-csi-driver-node-qzt2g\" (UID: \"edc518f3-1517-4875-9f98-49e26e02ec83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.300552 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.300525 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7cll\" (UniqueName: \"kubernetes.io/projected/e9dc161a-a59b-422e-8575-0141fd4aa565-kube-api-access-r7cll\") pod \"tuned-89z5t\" (UID: \"e9dc161a-a59b-422e-8575-0141fd4aa565\") " pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.301426 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.301399 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vczr5\" (UniqueName: \"kubernetes.io/projected/8a832abe-6374-4c97-be59-eb9e1423903c-kube-api-access-vczr5\") pod \"node-resolver-9644c\" (UID: \"8a832abe-6374-4c97-be59-eb9e1423903c\") " pod="openshift-dns/node-resolver-9644c" Sep 09 23:08:20.301723 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.301704 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srq78\" (UniqueName: \"kubernetes.io/projected/a23eb22f-765f-4d94-8315-623722d7e706-kube-api-access-srq78\") pod \"ovnkube-node-lhh26\" (UID: \"a23eb22f-765f-4d94-8315-623722d7e706\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.301805 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.301764 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kspcg\" (UniqueName: \"kubernetes.io/projected/c811b579-2709-48db-96df-a61df8ee5a24-kube-api-access-kspcg\") pod \"iptables-alerter-vl8p7\" (UID: \"c811b579-2709-48db-96df-a61df8ee5a24\") " pod="openshift-network-operator/iptables-alerter-vl8p7" Sep 09 23:08:20.384875 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.384801 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rx9nk" Sep 09 23:08:20.391368 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.391347 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pt9ht" Sep 09 23:08:20.399264 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.399235 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l98pp" Sep 09 23:08:20.404161 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.404144 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fngv2" Sep 09 23:08:20.410025 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.410007 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" Sep 09 23:08:20.415938 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.415918 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9644c" Sep 09 23:08:20.423285 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.423268 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-89z5t" Sep 09 23:08:20.430633 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.430616 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vl8p7" Sep 09 23:08:20.436047 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.436031 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:20.437642 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.437624 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:08:20.696273 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.696207 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret\") pod \"global-pull-secret-syncer-skd4w\" (UID: \"f7f994f2-a498-4d06-8a5c-f14c842b48a9\") " pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:20.696273 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.696240 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs\") pod \"network-metrics-daemon-gmk7t\" (UID: \"2e433ce1-5876-44c1-bafd-cf7237901a04\") " pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:20.696463 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.696326 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:20.696463 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.696356 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:20.696463 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.696374 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs podName:2e433ce1-5876-44c1-bafd-cf7237901a04 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:21.696360842 +0000 UTC m=+3.996368338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs") pod "network-metrics-daemon-gmk7t" (UID: "2e433ce1-5876-44c1-bafd-cf7237901a04") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:20.696463 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.696411 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret podName:f7f994f2-a498-4d06-8a5c-f14c842b48a9 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:21.696395073 +0000 UTC m=+3.996402583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret") pod "global-pull-secret-syncer-skd4w" (UID: "f7f994f2-a498-4d06-8a5c-f14c842b48a9") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:20.797123 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:20.797092 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx9f\" (UniqueName: \"kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f\") pod \"network-check-target-bngkg\" (UID: \"9919def0-8417-43bd-b29e-af19906c55ca\") " pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:20.797274 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.797215 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:08:20.797274 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.797229 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:08:20.797274 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.797239 2567 projected.go:196] Error preparing data for projected volume kube-api-access-jfx9f for pod openshift-network-diagnostics/network-check-target-bngkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:20.797407 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:20.797282 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f podName:9919def0-8417-43bd-b29e-af19906c55ca nodeName:}" failed. No retries permitted until 2026-09-09 23:08:21.797270033 +0000 UTC m=+4.097277542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfx9f" (UniqueName: "kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f") pod "network-check-target-bngkg" (UID: "9919def0-8417-43bd-b29e-af19906c55ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:21.022116 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:21.022090 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0195649c_31a5_4859_9643_26ae90ab325a.slice/crio-ddf480ef9063ae5f717d924b68ea0c7246dee473bcf8af569f6e3b6399a375fa WatchSource:0}: Error finding container ddf480ef9063ae5f717d924b68ea0c7246dee473bcf8af569f6e3b6399a375fa: Status 404 returned error can't find the container with id ddf480ef9063ae5f717d924b68ea0c7246dee473bcf8af569f6e3b6399a375fa Sep 09 23:08:21.023990 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:21.023963 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a832abe_6374_4c97_be59_eb9e1423903c.slice/crio-67b0137b316e45c6ebcff33dd535982ae6b1e255f1441fc7fb84b1cb5ab9f65c WatchSource:0}: Error finding container 67b0137b316e45c6ebcff33dd535982ae6b1e255f1441fc7fb84b1cb5ab9f65c: Status 404 returned error can't find the container with id 67b0137b316e45c6ebcff33dd535982ae6b1e255f1441fc7fb84b1cb5ab9f65c Sep 09 23:08:21.026753 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:21.026732 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130a2012_14a3_4b9f_ae73_7a3a3fe7cf59.slice/crio-c31f6ae4c96760827c16d706938f7597b6f3619db2680b2295cfcb3385528de1 WatchSource:0}: Error finding container c31f6ae4c96760827c16d706938f7597b6f3619db2680b2295cfcb3385528de1: Status 404 returned error can't find the container with id c31f6ae4c96760827c16d706938f7597b6f3619db2680b2295cfcb3385528de1 Sep 09 23:08:21.027693 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:21.027668 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c15c466_4329_4033_9a57_92b61c400874.slice/crio-d4439b58e1c8c83db0f98335d4434b2a9a1d10e14d4fc0839b24b61d1e6be247 WatchSource:0}: Error finding container d4439b58e1c8c83db0f98335d4434b2a9a1d10e14d4fc0839b24b61d1e6be247: Status 404 returned error can't find the container with id d4439b58e1c8c83db0f98335d4434b2a9a1d10e14d4fc0839b24b61d1e6be247 Sep 09 23:08:21.029267 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:21.029112 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc811b579_2709_48db_96df_a61df8ee5a24.slice/crio-cb43460ec006a935b73f226b4651b5fcc8064873a2598e7cfa4618e58536c650 WatchSource:0}: Error finding container cb43460ec006a935b73f226b4651b5fcc8064873a2598e7cfa4618e58536c650: Status 404 returned error can't find the container with id cb43460ec006a935b73f226b4651b5fcc8064873a2598e7cfa4618e58536c650 Sep 09 23:08:21.123502 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:21.123458 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:03:20 +0000 UTC" deadline="2028-03-20 01:32:43.488801288 +0000 UTC" Sep 09 23:08:21.123502 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:21.123500 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13370h24m22.365303633s" Sep 09 23:08:21.195613 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:21.195555 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" event={"ID":"edc518f3-1517-4875-9f98-49e26e02ec83","Type":"ContainerStarted","Data":"7c314ad61e8520ae5274738e4d5338c96659d128ef3b4ed688043c4ff8123de0"} Sep 09 23:08:21.196836 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:21.196807 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fngv2" event={"ID":"8c15c466-4329-4033-9a57-92b61c400874","Type":"ContainerStarted","Data":"d4439b58e1c8c83db0f98335d4434b2a9a1d10e14d4fc0839b24b61d1e6be247"} Sep 09 23:08:21.198069 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:21.198038 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l98pp" event={"ID":"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59","Type":"ContainerStarted","Data":"c31f6ae4c96760827c16d706938f7597b6f3619db2680b2295cfcb3385528de1"} Sep 09 23:08:21.199293 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:21.199179 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9644c" event={"ID":"8a832abe-6374-4c97-be59-eb9e1423903c","Type":"ContainerStarted","Data":"67b0137b316e45c6ebcff33dd535982ae6b1e255f1441fc7fb84b1cb5ab9f65c"} Sep 09 23:08:21.200696 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:21.200671 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pt9ht" event={"ID":"0195649c-31a5-4859-9643-26ae90ab325a","Type":"ContainerStarted","Data":"ddf480ef9063ae5f717d924b68ea0c7246dee473bcf8af569f6e3b6399a375fa"} Sep 09 23:08:21.201957 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:21.201931 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-89z5t" event={"ID":"e9dc161a-a59b-422e-8575-0141fd4aa565","Type":"ContainerStarted","Data":"338266bccfebd4a5c97b26a62b1dcd5fd929a6abe97e2e537366606964ec9c8d"} Sep 09 23:08:21.203267 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:21.203242 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" event={"ID":"a23eb22f-765f-4d94-8315-623722d7e706","Type":"ContainerStarted","Data":"dc854a14759a37406e2397fb29d5927dac6f6a489a49c1c00c9e60f91a0c6fa4"} Sep 09 23:08:21.204355 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:21.204330 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vl8p7" event={"ID":"c811b579-2709-48db-96df-a61df8ee5a24","Type":"ContainerStarted","Data":"cb43460ec006a935b73f226b4651b5fcc8064873a2598e7cfa4618e58536c650"} Sep 09 23:08:21.206753 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:21.206729 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" event={"ID":"728b04a33548859b274bbec2cc5b3fee","Type":"ContainerStarted","Data":"92bac38449da65c9f4678224a103c1891a8c38d7b917329fc260edfbabaa39a2"} Sep 09 23:08:21.209422 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:21.209400 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rx9nk" event={"ID":"1668ae93-f22d-4b5d-b86d-0c120fd1ac49","Type":"ContainerStarted","Data":"b42799798c664cfe8830548b6e28f99d87f1cefa1186b3c0514295aa06143d31"} Sep 09 23:08:21.220099 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:21.220060 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-228.ec2.internal" podStartSLOduration=2.220048101 podStartE2EDuration="2.220048101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:21.219973614 +0000 UTC m=+3.519981126" watchObservedRunningTime="2026-09-09 23:08:21.220048101 +0000 UTC m=+3.520055619" Sep 09 23:08:21.706783 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:21.706455 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs\") pod \"network-metrics-daemon-gmk7t\" (UID: \"2e433ce1-5876-44c1-bafd-cf7237901a04\") " pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:21.706937 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:21.706792 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret\") pod \"global-pull-secret-syncer-skd4w\" (UID: \"f7f994f2-a498-4d06-8a5c-f14c842b48a9\") " pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:21.706937 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:21.706909 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:21.707050 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:21.706971 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret podName:f7f994f2-a498-4d06-8a5c-f14c842b48a9 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:23.706953353 +0000 UTC m=+6.006960866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret") pod "global-pull-secret-syncer-skd4w" (UID: "f7f994f2-a498-4d06-8a5c-f14c842b48a9") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:21.707412 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:21.707389 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:21.707527 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:21.707446 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs podName:2e433ce1-5876-44c1-bafd-cf7237901a04 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:23.707431857 +0000 UTC m=+6.007439366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs") pod "network-metrics-daemon-gmk7t" (UID: "2e433ce1-5876-44c1-bafd-cf7237901a04") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:21.808154 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:21.808118 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx9f\" (UniqueName: \"kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f\") pod \"network-check-target-bngkg\" (UID: \"9919def0-8417-43bd-b29e-af19906c55ca\") " pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:21.808333 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:21.808316 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:08:21.808416 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:21.808341 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:08:21.808416 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:21.808352 2567 projected.go:196] Error preparing data for projected volume kube-api-access-jfx9f for pod openshift-network-diagnostics/network-check-target-bngkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:21.808416 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:21.808412 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f podName:9919def0-8417-43bd-b29e-af19906c55ca nodeName:}" failed. No retries permitted until 2026-09-09 23:08:23.808391555 +0000 UTC m=+6.108399055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfx9f" (UniqueName: "kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f") pod "network-check-target-bngkg" (UID: "9919def0-8417-43bd-b29e-af19906c55ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:22.124603 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:22.124493 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:03:20 +0000 UTC" deadline="2028-04-24 04:25:53.092500076 +0000 UTC" Sep 09 23:08:22.124603 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:22.124542 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14213h17m30.967962854s" Sep 09 23:08:22.188971 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:22.188421 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:22.188971 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:22.188421 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:22.188971 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:22.188626 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bngkg" podUID="9919def0-8417-43bd-b29e-af19906c55ca" Sep 09 23:08:22.188971 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:22.188681 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:08:22.188971 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:22.188733 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:22.188971 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:22.188803 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skd4w" podUID="f7f994f2-a498-4d06-8a5c-f14c842b48a9" Sep 09 23:08:22.231845 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:22.230760 2567 generic.go:356] "Generic (PLEG): container finished" podID="e4729ed97ef7a8c38fc61d9b5517096f" containerID="20e992995c78d32907276154584e5138459cd128e98fae529e12fb3454d33c8a" exitCode=0 Sep 09 23:08:22.231845 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:22.231646 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" event={"ID":"e4729ed97ef7a8c38fc61d9b5517096f","Type":"ContainerDied","Data":"20e992995c78d32907276154584e5138459cd128e98fae529e12fb3454d33c8a"} Sep 09 23:08:23.255543 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:23.255507 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" event={"ID":"e4729ed97ef7a8c38fc61d9b5517096f","Type":"ContainerStarted","Data":"9f209cdf91f627e46717c4aeb576fc0364575fac46ac555f23e71972f656dd11"} Sep 09 23:08:23.271958 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:23.271395 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-228.ec2.internal" podStartSLOduration=4.271373766 podStartE2EDuration="4.271373766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:23.270911113 +0000 UTC m=+5.570918633" watchObservedRunningTime="2026-09-09 23:08:23.271373766 +0000 UTC m=+5.571381285" Sep 09 23:08:23.722345 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:23.722307 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret\") pod \"global-pull-secret-syncer-skd4w\" (UID: \"f7f994f2-a498-4d06-8a5c-f14c842b48a9\") " pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:23.722538 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:23.722362 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs\") pod \"network-metrics-daemon-gmk7t\" (UID: \"2e433ce1-5876-44c1-bafd-cf7237901a04\") " pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:23.722628 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:23.722562 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:23.722680 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:23.722639 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs podName:2e433ce1-5876-44c1-bafd-cf7237901a04 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:27.72262236 +0000 UTC m=+10.022629859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs") pod "network-metrics-daemon-gmk7t" (UID: "2e433ce1-5876-44c1-bafd-cf7237901a04") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:23.722742 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:23.722715 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:23.722789 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:23.722748 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret podName:f7f994f2-a498-4d06-8a5c-f14c842b48a9 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:27.722737149 +0000 UTC m=+10.022744649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret") pod "global-pull-secret-syncer-skd4w" (UID: "f7f994f2-a498-4d06-8a5c-f14c842b48a9") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:23.823421 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:23.823378 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx9f\" (UniqueName: \"kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f\") pod \"network-check-target-bngkg\" (UID: \"9919def0-8417-43bd-b29e-af19906c55ca\") " pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:23.823622 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:23.823553 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:08:23.823622 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:23.823574 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:08:23.823622 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:23.823599 2567 projected.go:196] Error preparing data for projected volume kube-api-access-jfx9f for pod openshift-network-diagnostics/network-check-target-bngkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:23.823772 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:23.823663 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f podName:9919def0-8417-43bd-b29e-af19906c55ca nodeName:}" failed. No retries permitted until 2026-09-09 23:08:27.823644611 +0000 UTC m=+10.123652109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfx9f" (UniqueName: "kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f") pod "network-check-target-bngkg" (UID: "9919def0-8417-43bd-b29e-af19906c55ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:24.190289 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:24.189739 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:24.190289 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:24.189743 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:24.190289 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:24.189872 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skd4w" podUID="f7f994f2-a498-4d06-8a5c-f14c842b48a9" Sep 09 23:08:24.190289 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:24.189907 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:24.190289 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:24.190019 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:08:24.190289 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:24.190118 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bngkg" podUID="9919def0-8417-43bd-b29e-af19906c55ca" Sep 09 23:08:26.188113 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:26.188079 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:26.188113 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:26.188125 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:26.188701 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:26.188087 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:26.188701 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:26.188224 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:08:26.188701 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:26.188272 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bngkg" podUID="9919def0-8417-43bd-b29e-af19906c55ca" Sep 09 23:08:26.188701 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:26.188339 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skd4w" podUID="f7f994f2-a498-4d06-8a5c-f14c842b48a9" Sep 09 23:08:27.759008 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:27.758971 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret\") pod \"global-pull-secret-syncer-skd4w\" (UID: \"f7f994f2-a498-4d06-8a5c-f14c842b48a9\") " pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:27.759459 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:27.759023 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs\") pod \"network-metrics-daemon-gmk7t\" (UID: \"2e433ce1-5876-44c1-bafd-cf7237901a04\") " pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:27.759459 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:27.759167 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:27.759459 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:27.759231 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs podName:2e433ce1-5876-44c1-bafd-cf7237901a04 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:35.759210747 +0000 UTC m=+18.059218259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs") pod "network-metrics-daemon-gmk7t" (UID: "2e433ce1-5876-44c1-bafd-cf7237901a04") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:27.759459 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:27.759296 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:27.759459 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:27.759330 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret podName:f7f994f2-a498-4d06-8a5c-f14c842b48a9 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:35.759318862 +0000 UTC m=+18.059326372 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret") pod "global-pull-secret-syncer-skd4w" (UID: "f7f994f2-a498-4d06-8a5c-f14c842b48a9") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:27.860083 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:27.859514 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx9f\" (UniqueName: \"kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f\") pod \"network-check-target-bngkg\" (UID: \"9919def0-8417-43bd-b29e-af19906c55ca\") " pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:27.860083 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:27.859744 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:08:27.860083 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:27.859769 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:08:27.860083 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:27.859782 2567 projected.go:196] Error preparing data for projected volume kube-api-access-jfx9f for pod openshift-network-diagnostics/network-check-target-bngkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:27.860083 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:27.859841 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f podName:9919def0-8417-43bd-b29e-af19906c55ca nodeName:}" failed. No retries permitted until 2026-09-09 23:08:35.859824016 +0000 UTC m=+18.159831517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfx9f" (UniqueName: "kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f") pod "network-check-target-bngkg" (UID: "9919def0-8417-43bd-b29e-af19906c55ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:28.189442 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:28.189330 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:28.189622 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:28.189441 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skd4w" podUID="f7f994f2-a498-4d06-8a5c-f14c842b48a9" Sep 09 23:08:28.189867 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:28.189799 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:28.190003 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:28.189911 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:08:28.190003 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:28.189953 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:28.190106 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:28.190017 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bngkg" podUID="9919def0-8417-43bd-b29e-af19906c55ca" Sep 09 23:08:30.187896 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:30.187863 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:30.188310 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:30.187871 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:30.188310 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:30.187962 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skd4w" podUID="f7f994f2-a498-4d06-8a5c-f14c842b48a9" Sep 09 23:08:30.188310 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:30.188036 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:08:30.188310 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:30.188086 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:30.188310 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:30.188182 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bngkg" podUID="9919def0-8417-43bd-b29e-af19906c55ca" Sep 09 23:08:32.187905 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:32.187870 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:32.188360 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:32.187870 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:32.188360 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:32.187996 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bngkg" podUID="9919def0-8417-43bd-b29e-af19906c55ca" Sep 09 23:08:32.188360 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:32.188077 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:08:32.188360 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:32.187876 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:32.188360 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:32.188175 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skd4w" podUID="f7f994f2-a498-4d06-8a5c-f14c842b48a9" Sep 09 23:08:34.188826 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:34.188780 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:34.189260 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:34.188781 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:34.189260 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:34.188913 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skd4w" podUID="f7f994f2-a498-4d06-8a5c-f14c842b48a9" Sep 09 23:08:34.189260 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:34.188780 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:34.189260 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:34.189044 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:08:34.189260 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:34.189148 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bngkg" podUID="9919def0-8417-43bd-b29e-af19906c55ca" Sep 09 23:08:35.811217 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:35.811179 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret\") pod \"global-pull-secret-syncer-skd4w\" (UID: \"f7f994f2-a498-4d06-8a5c-f14c842b48a9\") " pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:35.811733 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:35.811233 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs\") pod \"network-metrics-daemon-gmk7t\" (UID: \"2e433ce1-5876-44c1-bafd-cf7237901a04\") " pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:35.811733 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:35.811347 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:35.811733 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:35.811371 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:35.811733 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:35.811430 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret podName:f7f994f2-a498-4d06-8a5c-f14c842b48a9 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:51.811411128 +0000 UTC m=+34.111418625 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret") pod "global-pull-secret-syncer-skd4w" (UID: "f7f994f2-a498-4d06-8a5c-f14c842b48a9") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:35.811733 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:35.811452 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs podName:2e433ce1-5876-44c1-bafd-cf7237901a04 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:51.811441557 +0000 UTC m=+34.111449054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs") pod "network-metrics-daemon-gmk7t" (UID: "2e433ce1-5876-44c1-bafd-cf7237901a04") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:35.911995 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:35.911955 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx9f\" (UniqueName: \"kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f\") pod \"network-check-target-bngkg\" (UID: \"9919def0-8417-43bd-b29e-af19906c55ca\") " pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:35.912168 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:35.912145 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:08:35.912225 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:35.912170 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:08:35.912225 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:35.912180 2567 projected.go:196] Error preparing data for projected volume kube-api-access-jfx9f for pod openshift-network-diagnostics/network-check-target-bngkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:35.912310 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:35.912242 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f podName:9919def0-8417-43bd-b29e-af19906c55ca nodeName:}" failed. No retries permitted until 2026-09-09 23:08:51.912222035 +0000 UTC m=+34.212229531 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfx9f" (UniqueName: "kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f") pod "network-check-target-bngkg" (UID: "9919def0-8417-43bd-b29e-af19906c55ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:36.188038 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:36.187954 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:36.188038 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:36.187982 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:36.188244 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:36.187958 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:36.188244 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:36.188091 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:08:36.188244 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:36.188153 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bngkg" podUID="9919def0-8417-43bd-b29e-af19906c55ca" Sep 09 23:08:36.188382 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:36.188238 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skd4w" podUID="f7f994f2-a498-4d06-8a5c-f14c842b48a9" Sep 09 23:08:38.188970 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:38.188942 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:38.189433 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:38.189047 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skd4w" podUID="f7f994f2-a498-4d06-8a5c-f14c842b48a9" Sep 09 23:08:38.189433 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:38.189088 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:38.189433 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:38.189192 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:08:38.189433 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:38.189219 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:38.189433 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:38.189290 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bngkg" podUID="9919def0-8417-43bd-b29e-af19906c55ca" Sep 09 23:08:39.287959 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:39.287618 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9644c" event={"ID":"8a832abe-6374-4c97-be59-eb9e1423903c","Type":"ContainerStarted","Data":"83f17dd20eb07b37adc3c0cfcd2fc194a3493acda0a64459cbfab2fe920bfe14"} Sep 09 23:08:39.289195 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:39.289171 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pt9ht" event={"ID":"0195649c-31a5-4859-9643-26ae90ab325a","Type":"ContainerStarted","Data":"911cffcb821d2ea7e40515146f5d4758399bc4c1c04440c17ede4e95a0e685e1"} Sep 09 23:08:39.290629 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:39.290608 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-89z5t" event={"ID":"e9dc161a-a59b-422e-8575-0141fd4aa565","Type":"ContainerStarted","Data":"9630cfd702f407f95f7d800fc5465cf9c83194090e0efa6e74c4e05a16c13852"} Sep 09 23:08:39.292986 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:39.292964 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" event={"ID":"a23eb22f-765f-4d94-8315-623722d7e706","Type":"ContainerStarted","Data":"2cc7d64f1bcc1537ef34507582cb86971f98091b503b97142316289b03957738"} Sep 09 23:08:39.293072 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:39.293034 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" event={"ID":"a23eb22f-765f-4d94-8315-623722d7e706","Type":"ContainerStarted","Data":"7541813623aa73be33bbc79d49b29e422e9c751b7aaed0686f8d9d34069e05b6"} Sep 09 23:08:39.293139 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:39.293085 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" event={"ID":"a23eb22f-765f-4d94-8315-623722d7e706","Type":"ContainerStarted","Data":"58e920c8e7d4b401b208fa256a52a5dc0fc93bf1a40db3172b74988264d9bb25"} Sep 09 23:08:39.293139 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:39.293134 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" event={"ID":"a23eb22f-765f-4d94-8315-623722d7e706","Type":"ContainerStarted","Data":"7462fc1d429a48bfd9ce122e72e251d73566e948854ba9182a06f719aa1100cb"} Sep 09 23:08:39.294255 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:39.294219 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rx9nk" event={"ID":"1668ae93-f22d-4b5d-b86d-0c120fd1ac49","Type":"ContainerStarted","Data":"31f282dc39653cdcd58d1e53fbef6b0b3ef03b15c8e8888779bfaf9f8c17bf32"} Sep 09 23:08:39.295632 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:39.295612 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" event={"ID":"edc518f3-1517-4875-9f98-49e26e02ec83","Type":"ContainerStarted","Data":"2d2aaf2e22139704864871eda421632263aa4b1ea73fa3672155c483c594bfb5"} Sep 09 23:08:39.296947 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:39.296928 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fngv2" event={"ID":"8c15c466-4329-4033-9a57-92b61c400874","Type":"ContainerStarted","Data":"34a0e90a4ae2f06db2304d188ff3553ad18464dda93c7c10305522a0fccd2d6d"} Sep 09 23:08:39.298156 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:39.298137 2567 generic.go:356] "Generic (PLEG): container finished" podID="130a2012-14a3-4b9f-ae73-7a3a3fe7cf59" containerID="1dd0674490bef112bccad1ed936b1462c8e13ce4c4be67578ff7ad1a4957b827" exitCode=0 Sep 09 23:08:39.298228 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:39.298167 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l98pp" event={"ID":"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59","Type":"ContainerDied","Data":"1dd0674490bef112bccad1ed936b1462c8e13ce4c4be67578ff7ad1a4957b827"} Sep 09 23:08:39.302053 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:39.302017 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9644c" podStartSLOduration=3.464478574 podStartE2EDuration="21.301985652s" totalImagesPullingTime="17.837507078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:39.301843496 +0000 UTC m=+21.601851015" watchObservedRunningTime="2026-09-09 23:08:39.301985652 +0000 UTC m=+21.601993172" Sep 09 23:08:39.332553 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:39.332513 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-89z5t" podStartSLOduration=3.5068048259999998 podStartE2EDuration="21.332494527s" totalImagesPullingTime="17.825689701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:39.332163667 +0000 UTC m=+21.632171185" watchObservedRunningTime="2026-09-09 23:08:39.332494527 +0000 UTC m=+21.632502044" Sep 09 23:08:39.344155 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:39.344120 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rx9nk" podStartSLOduration=3.559026107 podStartE2EDuration="21.344108979s" totalImagesPullingTime="17.785082872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:39.344039473 +0000 UTC m=+21.644046991" watchObservedRunningTime="2026-09-09 23:08:39.344108979 +0000 UTC m=+21.644116496" Sep 09 23:08:39.356842 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:39.356809 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pt9ht" podStartSLOduration=7.135194661 podStartE2EDuration="21.356796334s" totalImagesPullingTime="14.221601673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:39.356415106 +0000 UTC m=+21.656422623" watchObservedRunningTime="2026-09-09 23:08:39.356796334 +0000 UTC m=+21.656803851" Sep 09 23:08:39.372607 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:39.372560 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fngv2" podStartSLOduration=3.440441842 podStartE2EDuration="21.372548675s" totalImagesPullingTime="17.932106833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:39.372327714 +0000 UTC m=+21.672335233" watchObservedRunningTime="2026-09-09 23:08:39.372548675 +0000 UTC m=+21.672556203" Sep 09 23:08:40.188385 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:40.188354 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:40.188385 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:40.188369 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:40.188659 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:40.188368 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:40.188659 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:40.188474 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skd4w" podUID="f7f994f2-a498-4d06-8a5c-f14c842b48a9" Sep 09 23:08:40.188659 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:40.188544 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:08:40.188659 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:40.188641 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bngkg" podUID="9919def0-8417-43bd-b29e-af19906c55ca" Sep 09 23:08:40.304457 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:40.304432 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 23:08:40.304885 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:40.304709 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" event={"ID":"a23eb22f-765f-4d94-8315-623722d7e706","Type":"ContainerStarted","Data":"acdf0b8382c3e8df4d095ae85220ad5dc61675d826436c346c886fb351e3c5ce"} Sep 09 23:08:40.304885 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:40.304801 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" event={"ID":"a23eb22f-765f-4d94-8315-623722d7e706","Type":"ContainerStarted","Data":"cd5d547eafbb3559c9340c30103c4c5a37a094fe8ea8f5451bb53ad5f6058ea4"} Sep 09 23:08:40.306360 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:40.306332 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vl8p7" event={"ID":"c811b579-2709-48db-96df-a61df8ee5a24","Type":"ContainerStarted","Data":"42f75471033b7089ce8f96b13539cddbc3f35abd295bd028ac884d22c6ae6cb4"} Sep 09 23:08:40.308618 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:40.308582 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" event={"ID":"edc518f3-1517-4875-9f98-49e26e02ec83","Type":"ContainerStarted","Data":"dad8e34b664ba40676170aa77d12b593d5928c888d14ccb385229d62bb59c5fa"} Sep 09 23:08:40.320574 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:40.320528 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vl8p7" podStartSLOduration=4.492576294 podStartE2EDuration="22.320516726s" totalImagesPullingTime="17.827940432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:40.320283083 +0000 UTC m=+22.620290601" watchObservedRunningTime="2026-09-09 23:08:40.320516726 +0000 UTC m=+22.620524247" Sep 09 23:08:41.149513 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:41.149390 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T23:08:40.304452073Z","UUID":"e4150506-5934-472f-8386-e59de222daaa","Handler":null,"Name":"","Endpoint":""} Sep 09 23:08:41.151201 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:41.151165 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 23:08:41.151201 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:41.151199 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 23:08:42.187808 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:42.187787 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:42.188303 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:42.187816 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:42.188303 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:42.187791 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:42.188303 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:42.187906 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skd4w" podUID="f7f994f2-a498-4d06-8a5c-f14c842b48a9" Sep 09 23:08:42.188303 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:42.187953 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bngkg" podUID="9919def0-8417-43bd-b29e-af19906c55ca" Sep 09 23:08:42.188303 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:42.188015 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:08:42.315708 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:42.315673 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" event={"ID":"edc518f3-1517-4875-9f98-49e26e02ec83","Type":"ContainerStarted","Data":"c7c7de15a25d1d86ff5bccd9b8226cbb67402947e2a670b2c190b51656bd31cb"} Sep 09 23:08:42.319580 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:42.319553 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" event={"ID":"a23eb22f-765f-4d94-8315-623722d7e706","Type":"ContainerStarted","Data":"14803039cd481911d41688a9ff4793454a2ad7802e7d1b2f9ba31c1f03d9df2e"} Sep 09 23:08:42.332515 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:42.332451 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzt2g" podStartSLOduration=4.38742951 podStartE2EDuration="24.33243381s" totalImagesPullingTime="19.9450043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:42.332041046 +0000 UTC m=+24.632048567" watchObservedRunningTime="2026-09-09 23:08:42.33243381 +0000 UTC m=+24.632441329" Sep 09 23:08:43.864266 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:43.863931 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pt9ht" Sep 09 23:08:43.865083 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:43.864659 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pt9ht" Sep 09 23:08:44.188289 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:44.188263 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:44.188409 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:44.188266 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:44.188409 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:44.188382 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skd4w" podUID="f7f994f2-a498-4d06-8a5c-f14c842b48a9" Sep 09 23:08:44.188532 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:44.188271 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:44.188532 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:44.188449 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:08:44.188532 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:44.188518 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bngkg" podUID="9919def0-8417-43bd-b29e-af19906c55ca" Sep 09 23:08:44.326266 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:44.326186 2567 generic.go:356] "Generic (PLEG): container finished" podID="130a2012-14a3-4b9f-ae73-7a3a3fe7cf59" containerID="abbdeada4363bd81b11d46cf6ed0c1c63e5cd48b266c6b0d01831daa43c9fb0f" exitCode=0 Sep 09 23:08:44.326410 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:44.326273 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l98pp" event={"ID":"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59","Type":"ContainerDied","Data":"abbdeada4363bd81b11d46cf6ed0c1c63e5cd48b266c6b0d01831daa43c9fb0f"} Sep 09 23:08:44.330365 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:44.330327 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" event={"ID":"a23eb22f-765f-4d94-8315-623722d7e706","Type":"ContainerStarted","Data":"420041414c78a4fcb7b0290e4c42d1d5fb1e478ca611356d2dea09e721a72a9f"} Sep 09 23:08:44.330692 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:44.330582 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:44.330692 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:44.330653 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:44.345062 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:44.345043 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:45.332665 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:45.332630 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:45.350012 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:45.349792 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:08:45.396486 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:45.396444 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" podStartSLOduration=9.524193278 podStartE2EDuration="27.396430195s" totalImagesPullingTime="17.872236917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:44.374142578 +0000 UTC m=+26.674150096" watchObservedRunningTime="2026-09-09 23:08:45.396430195 +0000 UTC m=+27.696437712" Sep 09 23:08:45.691120 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:45.691017 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bngkg"] Sep 09 23:08:45.691308 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:45.691151 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:45.691308 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:45.691252 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bngkg" podUID="9919def0-8417-43bd-b29e-af19906c55ca" Sep 09 23:08:45.691698 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:45.691671 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-skd4w"] Sep 09 23:08:45.691791 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:45.691779 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:45.691871 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:45.691854 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skd4w" podUID="f7f994f2-a498-4d06-8a5c-f14c842b48a9" Sep 09 23:08:45.708266 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:45.708238 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gmk7t"] Sep 09 23:08:45.708395 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:45.708346 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:45.708472 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:45.708451 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:08:46.011245 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:46.011167 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:46.100691 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:46.100659 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:46.336540 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:46.336456 2567 generic.go:356] "Generic (PLEG): container finished" podID="130a2012-14a3-4b9f-ae73-7a3a3fe7cf59" containerID="1241620279a06d7545f25bb436d41163012d9f9ddc2bf8d3a66d1fe16e1a91b8" exitCode=0 Sep 09 23:08:46.336540 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:46.336533 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l98pp" event={"ID":"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59","Type":"ContainerDied","Data":"1241620279a06d7545f25bb436d41163012d9f9ddc2bf8d3a66d1fe16e1a91b8"} Sep 09 23:08:47.188383 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:47.188316 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:47.188383 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:47.188353 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:47.188709 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:47.188404 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:47.188709 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:47.188418 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:08:47.188709 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:47.188469 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bngkg" podUID="9919def0-8417-43bd-b29e-af19906c55ca" Sep 09 23:08:47.188709 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:47.188536 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skd4w" podUID="f7f994f2-a498-4d06-8a5c-f14c842b48a9" Sep 09 23:08:47.484420 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:47.484397 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:47.587684 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:47.587648 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:47.830247 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:47.830221 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pt9ht" Sep 09 23:08:47.830423 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:47.830409 2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 09 23:08:47.830934 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:47.830916 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pt9ht" Sep 09 23:08:47.909262 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:47.909225 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:48.342690 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:48.342659 2567 generic.go:356] "Generic (PLEG): container finished" podID="130a2012-14a3-4b9f-ae73-7a3a3fe7cf59" containerID="a5455f3b236a9649797c7d99f245bd83f8945284d222dbdd05f150b0cb6ccfbc" exitCode=0 Sep 09 23:08:48.342869 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:48.342729 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l98pp" event={"ID":"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59","Type":"ContainerDied","Data":"a5455f3b236a9649797c7d99f245bd83f8945284d222dbdd05f150b0cb6ccfbc"} Sep 09 23:08:48.653338 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:48.653265 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:48.736987 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:48.736956 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:49.188213 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:49.188185 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:49.188377 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:49.188184 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:49.188377 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:49.188320 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skd4w" podUID="f7f994f2-a498-4d06-8a5c-f14c842b48a9" Sep 09 23:08:49.188377 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:49.188184 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:49.188547 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:49.188405 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:08:49.188547 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:49.188487 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bngkg" podUID="9919def0-8417-43bd-b29e-af19906c55ca" Sep 09 23:08:51.188841 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.188527 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:51.189343 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.188575 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:51.189343 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:51.188928 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bngkg" podUID="9919def0-8417-43bd-b29e-af19906c55ca" Sep 09 23:08:51.189343 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.188601 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:51.189343 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:51.188996 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-skd4w" podUID="f7f994f2-a498-4d06-8a5c-f14c842b48a9" Sep 09 23:08:51.189343 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:51.189064 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:08:51.504541 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.504458 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-228.ec2.internal" event="NodeReady" Sep 09 23:08:51.504717 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.504627 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 23:08:51.547227 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.547187 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rdtvn"] Sep 09 23:08:51.550008 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.549979 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rdtvn" Sep 09 23:08:51.553786 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.553763 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 23:08:51.553914 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.553754 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 23:08:51.554383 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.553871 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-249ln\"" Sep 09 23:08:51.555257 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.555237 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z8p6x"] Sep 09 23:08:51.557121 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.557096 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z8p6x" Sep 09 23:08:51.558909 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.558889 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 23:08:51.559029 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.558960 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 23:08:51.559636 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.559214 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4h26n\"" Sep 09 23:08:51.559862 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.559839 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 23:08:51.561842 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.561816 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rdtvn"] Sep 09 23:08:51.568384 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.568363 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z8p6x"] Sep 09 23:08:51.626239 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.626200 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad961056-ef98-4a07-947a-f503dafaa568-config-volume\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:08:51.626395 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.626251 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sqxq\" (UniqueName: \"kubernetes.io/projected/ad961056-ef98-4a07-947a-f503dafaa568-kube-api-access-9sqxq\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:08:51.626395 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.626309 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f0a8a36-41da-42f7-98ee-21b2fbf71348-cert\") pod \"ingress-canary-z8p6x\" (UID: \"6f0a8a36-41da-42f7-98ee-21b2fbf71348\") " pod="openshift-ingress-canary/ingress-canary-z8p6x" Sep 09 23:08:51.626395 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.626352 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad961056-ef98-4a07-947a-f503dafaa568-tmp-dir\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:08:51.626395 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.626392 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hhvn\" (UniqueName: \"kubernetes.io/projected/6f0a8a36-41da-42f7-98ee-21b2fbf71348-kube-api-access-9hhvn\") pod \"ingress-canary-z8p6x\" (UID: \"6f0a8a36-41da-42f7-98ee-21b2fbf71348\") " pod="openshift-ingress-canary/ingress-canary-z8p6x" Sep 09 23:08:51.626616 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.626467 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:08:51.727464 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.727431 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f0a8a36-41da-42f7-98ee-21b2fbf71348-cert\") pod \"ingress-canary-z8p6x\" (UID: \"6f0a8a36-41da-42f7-98ee-21b2fbf71348\") " pod="openshift-ingress-canary/ingress-canary-z8p6x" Sep 09 23:08:51.727464 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.727474 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad961056-ef98-4a07-947a-f503dafaa568-tmp-dir\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:08:51.727729 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.727614 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hhvn\" (UniqueName: \"kubernetes.io/projected/6f0a8a36-41da-42f7-98ee-21b2fbf71348-kube-api-access-9hhvn\") pod \"ingress-canary-z8p6x\" (UID: \"6f0a8a36-41da-42f7-98ee-21b2fbf71348\") " pod="openshift-ingress-canary/ingress-canary-z8p6x" Sep 09 23:08:51.727729 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.727703 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:08:51.727839 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.727751 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad961056-ef98-4a07-947a-f503dafaa568-config-volume\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:08:51.727839 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.727790 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sqxq\" (UniqueName: \"kubernetes.io/projected/ad961056-ef98-4a07-947a-f503dafaa568-kube-api-access-9sqxq\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:08:51.727916 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.727848 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad961056-ef98-4a07-947a-f503dafaa568-tmp-dir\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:08:51.727963 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:51.727952 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:08:51.728043 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:51.728021 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls podName:ad961056-ef98-4a07-947a-f503dafaa568 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:52.22799934 +0000 UTC m=+34.528006841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls") pod "dns-default-rdtvn" (UID: "ad961056-ef98-4a07-947a-f503dafaa568") : secret "dns-default-metrics-tls" not found Sep 09 23:08:51.728631 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.728604 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad961056-ef98-4a07-947a-f503dafaa568-config-volume\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:08:51.732375 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.732350 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f0a8a36-41da-42f7-98ee-21b2fbf71348-cert\") pod \"ingress-canary-z8p6x\" (UID: \"6f0a8a36-41da-42f7-98ee-21b2fbf71348\") " pod="openshift-ingress-canary/ingress-canary-z8p6x" Sep 09 23:08:51.736264 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.736242 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hhvn\" (UniqueName: \"kubernetes.io/projected/6f0a8a36-41da-42f7-98ee-21b2fbf71348-kube-api-access-9hhvn\") pod \"ingress-canary-z8p6x\" (UID: \"6f0a8a36-41da-42f7-98ee-21b2fbf71348\") " pod="openshift-ingress-canary/ingress-canary-z8p6x" Sep 09 23:08:51.736371 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.736334 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sqxq\" (UniqueName: \"kubernetes.io/projected/ad961056-ef98-4a07-947a-f503dafaa568-kube-api-access-9sqxq\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:08:51.828573 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.828536 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret\") pod \"global-pull-secret-syncer-skd4w\" (UID: \"f7f994f2-a498-4d06-8a5c-f14c842b48a9\") " pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:51.828573 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.828575 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs\") pod \"network-metrics-daemon-gmk7t\" (UID: \"2e433ce1-5876-44c1-bafd-cf7237901a04\") " pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:51.828801 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:51.828682 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:51.828801 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:51.828719 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:51.828801 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:51.828744 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret podName:f7f994f2-a498-4d06-8a5c-f14c842b48a9 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:23.828726303 +0000 UTC m=+66.128733807 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret") pod "global-pull-secret-syncer-skd4w" (UID: "f7f994f2-a498-4d06-8a5c-f14c842b48a9") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:51.828801 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:51.828770 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs podName:2e433ce1-5876-44c1-bafd-cf7237901a04 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:23.828758281 +0000 UTC m=+66.128765782 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs") pod "network-metrics-daemon-gmk7t" (UID: "2e433ce1-5876-44c1-bafd-cf7237901a04") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:51.871470 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.871438 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z8p6x" Sep 09 23:08:51.929638 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:51.929583 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx9f\" (UniqueName: \"kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f\") pod \"network-check-target-bngkg\" (UID: \"9919def0-8417-43bd-b29e-af19906c55ca\") " pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:51.929784 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:51.929767 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:08:51.929827 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:51.929789 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:08:51.929827 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:51.929799 2567 projected.go:196] Error preparing data for projected volume kube-api-access-jfx9f for pod openshift-network-diagnostics/network-check-target-bngkg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:51.929909 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:51.929850 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f podName:9919def0-8417-43bd-b29e-af19906c55ca nodeName:}" failed. No retries permitted until 2026-09-09 23:09:23.92983625 +0000 UTC m=+66.229843746 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfx9f" (UniqueName: "kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f") pod "network-check-target-bngkg" (UID: "9919def0-8417-43bd-b29e-af19906c55ca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:52.127629 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:52.127489 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:52.227724 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:52.227690 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:52.231715 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:52.231690 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:08:52.231854 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:52.231810 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:08:52.231919 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:52.231873 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls podName:ad961056-ef98-4a07-947a-f503dafaa568 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:53.231856 +0000 UTC m=+35.531863497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls") pod "dns-default-rdtvn" (UID: "ad961056-ef98-4a07-947a-f503dafaa568") : secret "dns-default-metrics-tls" not found Sep 09 23:08:53.005346 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:53.005129 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z8p6x"] Sep 09 23:08:53.011892 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:08:53.011866 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f0a8a36_41da_42f7_98ee_21b2fbf71348.slice/crio-052926376e4da6713da17ef3cea4cc1fdf440ac016b6c23d1515ae74bbd35ed9 WatchSource:0}: Error finding container 052926376e4da6713da17ef3cea4cc1fdf440ac016b6c23d1515ae74bbd35ed9: Status 404 returned error can't find the container with id 052926376e4da6713da17ef3cea4cc1fdf440ac016b6c23d1515ae74bbd35ed9 Sep 09 23:08:53.188336 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:53.188304 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:08:53.188513 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:53.188347 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:08:53.188513 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:53.188395 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:08:53.191541 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:53.191150 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:08:53.193727 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:53.191730 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:08:53.193727 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:53.191871 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26qq8\"" Sep 09 23:08:53.193727 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:53.192078 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hgrbx\"" Sep 09 23:08:53.193727 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:53.192319 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:08:53.193727 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:53.192374 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:08:53.238065 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:53.238033 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:08:53.238628 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:53.238138 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:08:53.238628 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:53.238186 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls podName:ad961056-ef98-4a07-947a-f503dafaa568 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:55.238173437 +0000 UTC m=+37.538180932 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls") pod "dns-default-rdtvn" (UID: "ad961056-ef98-4a07-947a-f503dafaa568") : secret "dns-default-metrics-tls" not found Sep 09 23:08:53.357145 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:53.357056 2567 generic.go:356] "Generic (PLEG): container finished" podID="130a2012-14a3-4b9f-ae73-7a3a3fe7cf59" containerID="037a538f4ebcde4b7d0da1fcc11ac001b5788025ff5446508b9d1c700ddcd6c7" exitCode=0 Sep 09 23:08:53.357145 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:53.357125 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l98pp" event={"ID":"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59","Type":"ContainerDied","Data":"037a538f4ebcde4b7d0da1fcc11ac001b5788025ff5446508b9d1c700ddcd6c7"} Sep 09 23:08:53.358327 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:53.358308 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z8p6x" event={"ID":"6f0a8a36-41da-42f7-98ee-21b2fbf71348","Type":"ContainerStarted","Data":"052926376e4da6713da17ef3cea4cc1fdf440ac016b6c23d1515ae74bbd35ed9"} Sep 09 23:08:54.364415 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:54.364382 2567 generic.go:356] "Generic (PLEG): container finished" podID="130a2012-14a3-4b9f-ae73-7a3a3fe7cf59" containerID="a0dc1b303b7d3018e3db2cb18d5e2effe92dcb40d68360d49a98c0829c250202" exitCode=0 Sep 09 23:08:54.364865 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:54.364425 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l98pp" event={"ID":"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59","Type":"ContainerDied","Data":"a0dc1b303b7d3018e3db2cb18d5e2effe92dcb40d68360d49a98c0829c250202"} Sep 09 23:08:55.252888 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:55.252852 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:08:55.253056 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:55.253033 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:08:55.253125 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:55.253114 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls podName:ad961056-ef98-4a07-947a-f503dafaa568 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:59.253094505 +0000 UTC m=+41.553102026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls") pod "dns-default-rdtvn" (UID: "ad961056-ef98-4a07-947a-f503dafaa568") : secret "dns-default-metrics-tls" not found Sep 09 23:08:55.368307 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:55.368225 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z8p6x" event={"ID":"6f0a8a36-41da-42f7-98ee-21b2fbf71348","Type":"ContainerStarted","Data":"db81a9c8b5fe84a7236fb4c13c2b3f41b9b79b4563738461d6a479ba9bc31335"} Sep 09 23:08:55.371872 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:55.371848 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l98pp" event={"ID":"130a2012-14a3-4b9f-ae73-7a3a3fe7cf59","Type":"ContainerStarted","Data":"aea8cbd16e299c8668257d7834015988722d9325d676f7f2971f06adbd57edfa"} Sep 09 23:08:55.384760 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:55.384706 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z8p6x" podStartSLOduration=2.288354801 podStartE2EDuration="4.384688798s" totalImagesPullingTime="2.096333997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:55.383810759 +0000 UTC m=+37.683818276" watchObservedRunningTime="2026-09-09 23:08:55.384688798 +0000 UTC m=+37.684696317" Sep 09 23:08:55.402841 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:55.402802 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l98pp" podStartSLOduration=8.547509104 podStartE2EDuration="37.402788211s" totalImagesPullingTime="28.855279107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:55.402251606 +0000 UTC m=+37.702259127" watchObservedRunningTime="2026-09-09 23:08:55.402788211 +0000 UTC m=+37.702795729" Sep 09 23:08:55.524012 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:55.523981 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:55.584782 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:55.584754 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:56.173080 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:56.172998 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:56.273952 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:56.273916 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:57.073605 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:57.073554 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:57.128135 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:57.128096 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:08:59.281190 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:08:59.281156 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:08:59.281611 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:59.281311 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:08:59.281611 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:08:59.281388 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls podName:ad961056-ef98-4a07-947a-f503dafaa568 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:07.281372952 +0000 UTC m=+49.581380448 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls") pod "dns-default-rdtvn" (UID: "ad961056-ef98-4a07-947a-f503dafaa568") : secret "dns-default-metrics-tls" not found Sep 09 23:09:07.332171 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:07.332133 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:09:07.332630 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:09:07.332274 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:09:07.332630 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:09:07.332348 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls podName:ad961056-ef98-4a07-947a-f503dafaa568 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:23.332333135 +0000 UTC m=+65.632340631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls") pod "dns-default-rdtvn" (UID: "ad961056-ef98-4a07-947a-f503dafaa568") : secret "dns-default-metrics-tls" not found Sep 09 23:09:07.977820 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:07.977788 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:08.085459 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:08.085411 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:12.607398 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:12.607330 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:12.662234 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:12.662200 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:17.353780 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:17.353751 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhh26" Sep 09 23:09:17.472481 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:17.472449 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:17.573561 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:17.573532 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:22.073937 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:22.073900 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:22.175188 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:22.175158 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:23.341652 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:23.341613 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:09:23.342129 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:09:23.341724 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:09:23.342129 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:09:23.341785 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls podName:ad961056-ef98-4a07-947a-f503dafaa568 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:55.341771663 +0000 UTC m=+97.641779165 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls") pod "dns-default-rdtvn" (UID: "ad961056-ef98-4a07-947a-f503dafaa568") : secret "dns-default-metrics-tls" not found Sep 09 23:09:23.844421 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:23.844388 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret\") pod \"global-pull-secret-syncer-skd4w\" (UID: \"f7f994f2-a498-4d06-8a5c-f14c842b48a9\") " pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:09:23.844647 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:23.844433 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs\") pod \"network-metrics-daemon-gmk7t\" (UID: \"2e433ce1-5876-44c1-bafd-cf7237901a04\") " pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:09:23.846508 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:23.846483 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:09:23.846656 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:23.846639 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:09:23.855371 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:09:23.855350 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 23:09:23.855477 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:09:23.855433 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs podName:2e433ce1-5876-44c1-bafd-cf7237901a04 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:27.855413001 +0000 UTC m=+130.155420498 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs") pod "network-metrics-daemon-gmk7t" (UID: "2e433ce1-5876-44c1-bafd-cf7237901a04") : secret "metrics-daemon-secret" not found Sep 09 23:09:23.858766 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:23.858749 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7f994f2-a498-4d06-8a5c-f14c842b48a9-original-pull-secret\") pod \"global-pull-secret-syncer-skd4w\" (UID: \"f7f994f2-a498-4d06-8a5c-f14c842b48a9\") " pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:09:23.945630 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:23.945574 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfx9f\" (UniqueName: \"kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f\") pod \"network-check-target-bngkg\" (UID: \"9919def0-8417-43bd-b29e-af19906c55ca\") " pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:09:23.947953 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:23.947923 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:09:23.957911 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:23.957887 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:09:23.968987 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:23.968960 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfx9f\" (UniqueName: \"kubernetes.io/projected/9919def0-8417-43bd-b29e-af19906c55ca-kube-api-access-jfx9f\") pod \"network-check-target-bngkg\" (UID: \"9919def0-8417-43bd-b29e-af19906c55ca\") " pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:09:24.101697 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:24.101630 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-skd4w" Sep 09 23:09:24.108448 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:24.108431 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26qq8\"" Sep 09 23:09:24.116963 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:24.116944 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:09:24.393017 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:24.392950 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-skd4w"] Sep 09 23:09:24.395526 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:09:24.395501 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f994f2_a498_4d06_8a5c_f14c842b48a9.slice/crio-53e5ba13bdd62001973e0f73c583720d27808099f34e67c29126199900b3a9a5 WatchSource:0}: Error finding container 53e5ba13bdd62001973e0f73c583720d27808099f34e67c29126199900b3a9a5: Status 404 returned error can't find the container with id 53e5ba13bdd62001973e0f73c583720d27808099f34e67c29126199900b3a9a5 Sep 09 23:09:24.413636 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:24.413613 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bngkg"] Sep 09 23:09:24.417853 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:09:24.417829 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9919def0_8417_43bd_b29e_af19906c55ca.slice/crio-e8cf6c5acd5b63a86bf0b1f5e7c9b17e04126e59c61b85d56fd064c9c4324caa WatchSource:0}: Error finding container e8cf6c5acd5b63a86bf0b1f5e7c9b17e04126e59c61b85d56fd064c9c4324caa: Status 404 returned error can't find the container with id e8cf6c5acd5b63a86bf0b1f5e7c9b17e04126e59c61b85d56fd064c9c4324caa Sep 09 23:09:24.437266 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:24.437236 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bngkg" event={"ID":"9919def0-8417-43bd-b29e-af19906c55ca","Type":"ContainerStarted","Data":"e8cf6c5acd5b63a86bf0b1f5e7c9b17e04126e59c61b85d56fd064c9c4324caa"} Sep 09 23:09:24.438356 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:24.438336 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-skd4w" event={"ID":"f7f994f2-a498-4d06-8a5c-f14c842b48a9","Type":"ContainerStarted","Data":"53e5ba13bdd62001973e0f73c583720d27808099f34e67c29126199900b3a9a5"} Sep 09 23:09:29.453101 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:29.453061 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bngkg" event={"ID":"9919def0-8417-43bd-b29e-af19906c55ca","Type":"ContainerStarted","Data":"e3be4f01db4d7cbe1a87a4ccaaa2215bff767255757269503bb9648164d25b72"} Sep 09 23:09:29.453579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:29.453183 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:09:29.454473 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:29.454449 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-skd4w" event={"ID":"f7f994f2-a498-4d06-8a5c-f14c842b48a9","Type":"ContainerStarted","Data":"902bde287f6b11277e86dca8c16e5d4699806107f1698f5361fa4b50a7bddcd7"} Sep 09 23:09:29.473965 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:29.473911 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bngkg" podStartSLOduration=66.984810898 podStartE2EDuration="1m11.473896595s" totalImagesPullingTime="4.489085697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:29.473767391 +0000 UTC m=+71.773774909" watchObservedRunningTime="2026-09-09 23:09:29.473896595 +0000 UTC m=+71.773904109" Sep 09 23:09:29.495632 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:29.495566 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-skd4w" podStartSLOduration=66.978948625 podStartE2EDuration="1m11.495552838s" totalImagesPullingTime="4.516604213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:29.494638348 +0000 UTC m=+71.794645863" watchObservedRunningTime="2026-09-09 23:09:29.495552838 +0000 UTC m=+71.795560353" Sep 09 23:09:46.099146 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:46.099026 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:46.149925 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:46.149883 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:09:55.357022 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:09:55.356989 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:09:55.357420 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:09:55.357110 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:09:55.357420 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:09:55.357169 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls podName:ad961056-ef98-4a07-947a-f503dafaa568 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:59.357156084 +0000 UTC m=+161.657163580 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls") pod "dns-default-rdtvn" (UID: "ad961056-ef98-4a07-947a-f503dafaa568") : secret "dns-default-metrics-tls" not found Sep 09 23:10:00.459348 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:10:00.459311 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bngkg" Sep 09 23:10:27.858856 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:10:27.858802 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs\") pod \"network-metrics-daemon-gmk7t\" (UID: \"2e433ce1-5876-44c1-bafd-cf7237901a04\") " pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:10:27.859341 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:10:27.858959 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 23:10:27.859341 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:10:27.859032 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs podName:2e433ce1-5876-44c1-bafd-cf7237901a04 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:29.859016971 +0000 UTC m=+252.159024467 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs") pod "network-metrics-daemon-gmk7t" (UID: "2e433ce1-5876-44c1-bafd-cf7237901a04") : secret "metrics-daemon-secret" not found Sep 09 23:10:54.563487 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:10:54.563442 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rdtvn" podUID="ad961056-ef98-4a07-947a-f503dafaa568" Sep 09 23:10:54.652086 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:10:54.652060 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rdtvn" Sep 09 23:10:56.211220 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:10:56.211186 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:10:59.358312 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:10:59.358275 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:10:59.358740 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:10:59.358394 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:10:59.358740 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:10:59.358455 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls podName:ad961056-ef98-4a07-947a-f503dafaa568 nodeName:}" failed. No retries permitted until 2026-09-09 23:13:01.358441329 +0000 UTC m=+283.658448825 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls") pod "dns-default-rdtvn" (UID: "ad961056-ef98-4a07-947a-f503dafaa568") : secret "dns-default-metrics-tls" not found Sep 09 23:11:11.188482 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:11:11.188395 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:11:49.860477 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:11:49.860440 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:11:55.625267 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:11:55.625229 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:13.661227 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.661190 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m"] Sep 09 23:12:13.663343 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.663322 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r"] Sep 09 23:12:13.663472 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.663436 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m" Sep 09 23:12:13.665395 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.665370 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" Sep 09 23:12:13.665519 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.665414 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:12:13.665519 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.665435 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 09 23:12:13.665519 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.665476 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 09 23:12:13.665519 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.665491 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9lbfw\"" Sep 09 23:12:13.666523 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.666506 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 09 23:12:13.667580 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.667562 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 09 23:12:13.668156 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.668135 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 23:12:13.668156 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.668148 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 09 23:12:13.668315 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.668193 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 23:12:13.668315 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.668211 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wf5z5\"" Sep 09 23:12:13.674301 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.674278 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m"] Sep 09 23:12:13.682771 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.682751 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r"] Sep 09 23:12:13.737193 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.737156 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5l8m\" (UniqueName: \"kubernetes.io/projected/7b4c2371-e07d-441d-8b9b-bf11e7336f7a-kube-api-access-z5l8m\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wm82m\" (UID: \"7b4c2371-e07d-441d-8b9b-bf11e7336f7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m" Sep 09 23:12:13.737382 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.737227 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b4c2371-e07d-441d-8b9b-bf11e7336f7a-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wm82m\" (UID: \"7b4c2371-e07d-441d-8b9b-bf11e7336f7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m" Sep 09 23:12:13.737382 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.737258 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b4c2371-e07d-441d-8b9b-bf11e7336f7a-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wm82m\" (UID: \"7b4c2371-e07d-441d-8b9b-bf11e7336f7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m" Sep 09 23:12:13.737382 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.737283 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-q9l5r\" (UID: \"b698db08-6f86-4c21-ac42-70e7eefba846\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" Sep 09 23:12:13.737382 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.737330 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znxhd\" (UniqueName: \"kubernetes.io/projected/b698db08-6f86-4c21-ac42-70e7eefba846-kube-api-access-znxhd\") pod \"cluster-monitoring-operator-6cdcc96965-q9l5r\" (UID: \"b698db08-6f86-4c21-ac42-70e7eefba846\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" Sep 09 23:12:13.737382 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.737370 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b698db08-6f86-4c21-ac42-70e7eefba846-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-q9l5r\" (UID: \"b698db08-6f86-4c21-ac42-70e7eefba846\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" Sep 09 23:12:13.756388 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.756348 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-ssjfn"] Sep 09 23:12:13.758686 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.758667 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-df7f76799-9xssh"] Sep 09 23:12:13.758794 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.758780 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:13.760661 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.760643 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.761666 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.761649 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 09 23:12:13.761786 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.761767 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 09 23:12:13.761904 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.761885 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 09 23:12:13.761990 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.761970 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-prdxl\"" Sep 09 23:12:13.762386 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.762368 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:12:13.762493 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.762472 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 09 23:12:13.762555 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.762507 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-48t55\"" Sep 09 23:12:13.763012 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.762997 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 09 23:12:13.763204 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.763188 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 09 23:12:13.767704 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.767685 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 09 23:12:13.768430 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.768412 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 09 23:12:13.771901 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.771882 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-ssjfn"] Sep 09 23:12:13.789241 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.789217 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-df7f76799-9xssh"] Sep 09 23:12:13.837683 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.837651 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5l8m\" (UniqueName: \"kubernetes.io/projected/7b4c2371-e07d-441d-8b9b-bf11e7336f7a-kube-api-access-z5l8m\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wm82m\" (UID: \"7b4c2371-e07d-441d-8b9b-bf11e7336f7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m" Sep 09 23:12:13.837683 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.837686 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2bcce2b0-0bd1-493e-b472-53b50f753f72-serving-cert\") pod \"console-operator-85b454874b-ssjfn\" (UID: \"2bcce2b0-0bd1-493e-b472-53b50f753f72\") " pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:13.837954 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.837707 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r675h\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-kube-api-access-r675h\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.837954 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.837755 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b4c2371-e07d-441d-8b9b-bf11e7336f7a-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wm82m\" (UID: \"7b4c2371-e07d-441d-8b9b-bf11e7336f7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m" Sep 09 23:12:13.837954 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.837773 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-image-registry-private-configuration\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.837954 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.837793 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-trusted-ca\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.837954 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.837817 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b4c2371-e07d-441d-8b9b-bf11e7336f7a-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wm82m\" (UID: \"7b4c2371-e07d-441d-8b9b-bf11e7336f7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m" Sep 09 23:12:13.837954 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.837853 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-installation-pull-secrets\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.837954 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.837877 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.837954 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.837911 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-q9l5r\" (UID: \"b698db08-6f86-4c21-ac42-70e7eefba846\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" Sep 09 23:12:13.837954 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.837946 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmh6n\" (UniqueName: \"kubernetes.io/projected/2bcce2b0-0bd1-493e-b472-53b50f753f72-kube-api-access-fmh6n\") pod \"console-operator-85b454874b-ssjfn\" (UID: \"2bcce2b0-0bd1-493e-b472-53b50f753f72\") " pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:13.838393 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:13.837971 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 23:12:13.838393 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.837979 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2bcce2b0-0bd1-493e-b472-53b50f753f72-config\") pod \"console-operator-85b454874b-ssjfn\" (UID: \"2bcce2b0-0bd1-493e-b472-53b50f753f72\") " pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:13.838393 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:13.838026 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls podName:b698db08-6f86-4c21-ac42-70e7eefba846 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:14.338012713 +0000 UTC m=+236.638020209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-q9l5r" (UID: "b698db08-6f86-4c21-ac42-70e7eefba846") : secret "cluster-monitoring-operator-tls" not found Sep 09 23:12:13.838393 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.838080 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znxhd\" (UniqueName: \"kubernetes.io/projected/b698db08-6f86-4c21-ac42-70e7eefba846-kube-api-access-znxhd\") pod \"cluster-monitoring-operator-6cdcc96965-q9l5r\" (UID: \"b698db08-6f86-4c21-ac42-70e7eefba846\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" Sep 09 23:12:13.838393 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.838113 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b698db08-6f86-4c21-ac42-70e7eefba846-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-q9l5r\" (UID: \"b698db08-6f86-4c21-ac42-70e7eefba846\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" Sep 09 23:12:13.838393 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.838138 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-ca-trust-extracted\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.838393 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.838162 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-certificates\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.838393 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.838183 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-bound-sa-token\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.838393 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.838232 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2bcce2b0-0bd1-493e-b472-53b50f753f72-trusted-ca\") pod \"console-operator-85b454874b-ssjfn\" (UID: \"2bcce2b0-0bd1-493e-b472-53b50f753f72\") " pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:13.838393 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.838392 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b4c2371-e07d-441d-8b9b-bf11e7336f7a-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wm82m\" (UID: \"7b4c2371-e07d-441d-8b9b-bf11e7336f7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m" Sep 09 23:12:13.838768 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.838750 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b698db08-6f86-4c21-ac42-70e7eefba846-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-q9l5r\" (UID: \"b698db08-6f86-4c21-ac42-70e7eefba846\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" Sep 09 23:12:13.840037 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.840017 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b4c2371-e07d-441d-8b9b-bf11e7336f7a-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wm82m\" (UID: \"7b4c2371-e07d-441d-8b9b-bf11e7336f7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m" Sep 09 23:12:13.845556 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.845529 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5l8m\" (UniqueName: \"kubernetes.io/projected/7b4c2371-e07d-441d-8b9b-bf11e7336f7a-kube-api-access-z5l8m\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wm82m\" (UID: \"7b4c2371-e07d-441d-8b9b-bf11e7336f7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m" Sep 09 23:12:13.845758 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.845736 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znxhd\" (UniqueName: \"kubernetes.io/projected/b698db08-6f86-4c21-ac42-70e7eefba846-kube-api-access-znxhd\") pod \"cluster-monitoring-operator-6cdcc96965-q9l5r\" (UID: \"b698db08-6f86-4c21-ac42-70e7eefba846\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" Sep 09 23:12:13.899844 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.899810 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:13.938816 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.938765 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-trusted-ca\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.938816 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.938794 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-installation-pull-secrets\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.938816 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.938811 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.939014 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.938837 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmh6n\" (UniqueName: \"kubernetes.io/projected/2bcce2b0-0bd1-493e-b472-53b50f753f72-kube-api-access-fmh6n\") pod \"console-operator-85b454874b-ssjfn\" (UID: \"2bcce2b0-0bd1-493e-b472-53b50f753f72\") " pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:13.939014 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:13.938955 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 23:12:13.939014 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:13.938972 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df7f76799-9xssh: secret "image-registry-tls" not found Sep 09 23:12:13.939014 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.938980 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2bcce2b0-0bd1-493e-b472-53b50f753f72-config\") pod \"console-operator-85b454874b-ssjfn\" (UID: \"2bcce2b0-0bd1-493e-b472-53b50f753f72\") " pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:13.939205 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.939020 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-ca-trust-extracted\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.939205 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:13.939037 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls podName:4f9f2509-b7bb-47cf-b47c-01938fbe8a3d nodeName:}" failed. No retries permitted until 2026-09-09 23:12:14.439016756 +0000 UTC m=+236.739024252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls") pod "image-registry-df7f76799-9xssh" (UID: "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d") : secret "image-registry-tls" not found Sep 09 23:12:13.939205 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.939068 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-certificates\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.939205 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.939099 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-bound-sa-token\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.939205 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.939134 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2bcce2b0-0bd1-493e-b472-53b50f753f72-trusted-ca\") pod \"console-operator-85b454874b-ssjfn\" (UID: \"2bcce2b0-0bd1-493e-b472-53b50f753f72\") " pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:13.939205 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.939164 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2bcce2b0-0bd1-493e-b472-53b50f753f72-serving-cert\") pod \"console-operator-85b454874b-ssjfn\" (UID: \"2bcce2b0-0bd1-493e-b472-53b50f753f72\") " pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:13.939205 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.939196 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r675h\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-kube-api-access-r675h\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.939548 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.939261 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-image-registry-private-configuration\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.939717 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.939692 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2bcce2b0-0bd1-493e-b472-53b50f753f72-config\") pod \"console-operator-85b454874b-ssjfn\" (UID: \"2bcce2b0-0bd1-493e-b472-53b50f753f72\") " pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:13.939864 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.939835 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-certificates\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.939864 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.939843 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-ca-trust-extracted\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.940029 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.940011 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-trusted-ca\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.940368 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.940346 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2bcce2b0-0bd1-493e-b472-53b50f753f72-trusted-ca\") pod \"console-operator-85b454874b-ssjfn\" (UID: \"2bcce2b0-0bd1-493e-b472-53b50f753f72\") " pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:13.941290 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.941269 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-installation-pull-secrets\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.941788 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.941765 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-image-registry-private-configuration\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.941858 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.941835 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2bcce2b0-0bd1-493e-b472-53b50f753f72-serving-cert\") pod \"console-operator-85b454874b-ssjfn\" (UID: \"2bcce2b0-0bd1-493e-b472-53b50f753f72\") " pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:13.947137 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.947114 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmh6n\" (UniqueName: \"kubernetes.io/projected/2bcce2b0-0bd1-493e-b472-53b50f753f72-kube-api-access-fmh6n\") pod \"console-operator-85b454874b-ssjfn\" (UID: \"2bcce2b0-0bd1-493e-b472-53b50f753f72\") " pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:13.947438 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.947417 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-bound-sa-token\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.947735 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.947718 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r675h\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-kube-api-access-r675h\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:13.973466 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:13.973444 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m" Sep 09 23:12:14.000725 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:14.000698 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:14.070269 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:14.070239 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:14.239569 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:14.239461 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m"] Sep 09 23:12:14.245221 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:12:14.245198 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4c2371_e07d_441d_8b9b_bf11e7336f7a.slice/crio-e9096fff815f306764b39e967d957ecb380e387c15f6a4aeb136af56700c851e WatchSource:0}: Error finding container e9096fff815f306764b39e967d957ecb380e387c15f6a4aeb136af56700c851e: Status 404 returned error can't find the container with id e9096fff815f306764b39e967d957ecb380e387c15f6a4aeb136af56700c851e Sep 09 23:12:14.332901 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:14.332872 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-ssjfn"] Sep 09 23:12:14.335934 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:12:14.335911 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bcce2b0_0bd1_493e_b472_53b50f753f72.slice/crio-d1bf22f7191a9d81c6db5e7cf1c0feb3a4fa8a99062a9a4b6bfb20a8f8cc6404 WatchSource:0}: Error finding container d1bf22f7191a9d81c6db5e7cf1c0feb3a4fa8a99062a9a4b6bfb20a8f8cc6404: Status 404 returned error can't find the container with id d1bf22f7191a9d81c6db5e7cf1c0feb3a4fa8a99062a9a4b6bfb20a8f8cc6404 Sep 09 23:12:14.343956 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:14.343933 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-q9l5r\" (UID: \"b698db08-6f86-4c21-ac42-70e7eefba846\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" Sep 09 23:12:14.344104 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:14.344087 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 23:12:14.344162 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:14.344153 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls podName:b698db08-6f86-4c21-ac42-70e7eefba846 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:15.344137666 +0000 UTC m=+237.644145162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-q9l5r" (UID: "b698db08-6f86-4c21-ac42-70e7eefba846") : secret "cluster-monitoring-operator-tls" not found Sep 09 23:12:14.444574 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:14.444541 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:14.444747 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:14.444709 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 23:12:14.444747 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:14.444730 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df7f76799-9xssh: secret "image-registry-tls" not found Sep 09 23:12:14.444858 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:14.444798 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls podName:4f9f2509-b7bb-47cf-b47c-01938fbe8a3d nodeName:}" failed. No retries permitted until 2026-09-09 23:12:15.444776742 +0000 UTC m=+237.744784241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls") pod "image-registry-df7f76799-9xssh" (UID: "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d") : secret "image-registry-tls" not found Sep 09 23:12:14.834251 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:14.834211 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" event={"ID":"2bcce2b0-0bd1-493e-b472-53b50f753f72","Type":"ContainerStarted","Data":"d1bf22f7191a9d81c6db5e7cf1c0feb3a4fa8a99062a9a4b6bfb20a8f8cc6404"} Sep 09 23:12:14.835206 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:14.835188 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m" event={"ID":"7b4c2371-e07d-441d-8b9b-bf11e7336f7a","Type":"ContainerStarted","Data":"e9096fff815f306764b39e967d957ecb380e387c15f6a4aeb136af56700c851e"} Sep 09 23:12:15.351080 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:15.351003 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-q9l5r\" (UID: \"b698db08-6f86-4c21-ac42-70e7eefba846\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" Sep 09 23:12:15.351243 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:15.351221 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 23:12:15.351294 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:15.351284 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls podName:b698db08-6f86-4c21-ac42-70e7eefba846 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:17.351265918 +0000 UTC m=+239.651273420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-q9l5r" (UID: "b698db08-6f86-4c21-ac42-70e7eefba846") : secret "cluster-monitoring-operator-tls" not found Sep 09 23:12:15.451984 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:15.451943 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:15.452266 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:15.452180 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 23:12:15.452266 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:15.452202 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df7f76799-9xssh: secret "image-registry-tls" not found Sep 09 23:12:15.452266 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:15.452263 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls podName:4f9f2509-b7bb-47cf-b47c-01938fbe8a3d nodeName:}" failed. No retries permitted until 2026-09-09 23:12:17.452242804 +0000 UTC m=+239.752250330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls") pod "image-registry-df7f76799-9xssh" (UID: "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d") : secret "image-registry-tls" not found Sep 09 23:12:16.069495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:16.069460 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:17.367530 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:17.367498 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-q9l5r\" (UID: \"b698db08-6f86-4c21-ac42-70e7eefba846\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" Sep 09 23:12:17.367900 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:17.367617 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 23:12:17.367900 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:17.367669 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls podName:b698db08-6f86-4c21-ac42-70e7eefba846 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:21.36765508 +0000 UTC m=+243.667662576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-q9l5r" (UID: "b698db08-6f86-4c21-ac42-70e7eefba846") : secret "cluster-monitoring-operator-tls" not found Sep 09 23:12:17.468496 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:17.468454 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:17.468668 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:17.468642 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 23:12:17.468732 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:17.468672 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df7f76799-9xssh: secret "image-registry-tls" not found Sep 09 23:12:17.468765 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:17.468737 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls podName:4f9f2509-b7bb-47cf-b47c-01938fbe8a3d nodeName:}" failed. No retries permitted until 2026-09-09 23:12:21.468719055 +0000 UTC m=+243.768726557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls") pod "image-registry-df7f76799-9xssh" (UID: "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d") : secret "image-registry-tls" not found Sep 09 23:12:17.844798 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:17.844769 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ssjfn_2bcce2b0-0bd1-493e-b472-53b50f753f72/console-operator/0.log" Sep 09 23:12:17.844954 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:17.844808 2567 generic.go:356] "Generic (PLEG): container finished" podID="2bcce2b0-0bd1-493e-b472-53b50f753f72" containerID="614acfad614fa4f08f70ad0963f8a59ae4af42194a41e911eec8b33ac2fc0ebc" exitCode=255 Sep 09 23:12:17.844954 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:17.844900 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" event={"ID":"2bcce2b0-0bd1-493e-b472-53b50f753f72","Type":"ContainerDied","Data":"614acfad614fa4f08f70ad0963f8a59ae4af42194a41e911eec8b33ac2fc0ebc"} Sep 09 23:12:17.845122 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:17.845105 2567 scope.go:117] "RemoveContainer" containerID="614acfad614fa4f08f70ad0963f8a59ae4af42194a41e911eec8b33ac2fc0ebc" Sep 09 23:12:17.846433 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:17.846414 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m" event={"ID":"7b4c2371-e07d-441d-8b9b-bf11e7336f7a","Type":"ContainerStarted","Data":"269e0a5753ed25d4e19e242372985330f9ebb54b5293adb7097cca69256a0544"} Sep 09 23:12:17.877922 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:17.877874 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m" podStartSLOduration=2.279026709 podStartE2EDuration="4.877854802s" totalImagesPullingTime="2.598828093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:17.876903745 +0000 UTC m=+240.176911288" watchObservedRunningTime="2026-09-09 23:12:17.877854802 +0000 UTC m=+240.177862325" Sep 09 23:12:18.377754 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.377721 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:18.410882 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.410851 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ktr96"] Sep 09 23:12:18.412985 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.412969 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ktr96" Sep 09 23:12:18.415976 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.415946 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 09 23:12:18.416081 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.416046 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-mdlz2\"" Sep 09 23:12:18.416396 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.416379 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 09 23:12:18.427843 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.427819 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ktr96"] Sep 09 23:12:18.473293 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.473263 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vjqdg"] Sep 09 23:12:18.473982 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.473961 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:18.475640 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.475624 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:18.477346 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.477324 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv6wf\" (UniqueName: \"kubernetes.io/projected/4d28512b-6ae7-421e-83ae-e1da3bab8bda-kube-api-access-cv6wf\") pod \"migrator-fdbb8fdff-ktr96\" (UID: \"4d28512b-6ae7-421e-83ae-e1da3bab8bda\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ktr96" Sep 09 23:12:18.477943 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.477928 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 23:12:18.477943 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.477937 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 23:12:18.478087 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.477976 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xkjxb\"" Sep 09 23:12:18.478250 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.478235 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 23:12:18.478318 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.478298 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 23:12:18.486385 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.486364 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vjqdg"] Sep 09 23:12:18.572385 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.572351 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:18.578341 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.578315 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:18.578460 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.578354 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv6wf\" (UniqueName: \"kubernetes.io/projected/4d28512b-6ae7-421e-83ae-e1da3bab8bda-kube-api-access-cv6wf\") pod \"migrator-fdbb8fdff-ktr96\" (UID: \"4d28512b-6ae7-421e-83ae-e1da3bab8bda\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ktr96" Sep 09 23:12:18.578460 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.578382 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:18.578460 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.578447 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81b00fbc-7e56-4591-b2d7-7342d6c80a96-crio-socket\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:18.578644 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.578512 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81b00fbc-7e56-4591-b2d7-7342d6c80a96-data-volume\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:18.578644 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.578542 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbn29\" (UniqueName: \"kubernetes.io/projected/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-api-access-lbn29\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:18.585948 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.585927 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv6wf\" (UniqueName: \"kubernetes.io/projected/4d28512b-6ae7-421e-83ae-e1da3bab8bda-kube-api-access-cv6wf\") pod \"migrator-fdbb8fdff-ktr96\" (UID: \"4d28512b-6ae7-421e-83ae-e1da3bab8bda\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ktr96" Sep 09 23:12:18.679038 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.678950 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81b00fbc-7e56-4591-b2d7-7342d6c80a96-crio-socket\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:18.679038 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.679008 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81b00fbc-7e56-4591-b2d7-7342d6c80a96-data-volume\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:18.679211 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.679076 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81b00fbc-7e56-4591-b2d7-7342d6c80a96-crio-socket\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:18.679211 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.679113 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbn29\" (UniqueName: \"kubernetes.io/projected/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-api-access-lbn29\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:18.679211 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.679168 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:18.679303 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.679233 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:18.679303 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.679257 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81b00fbc-7e56-4591-b2d7-7342d6c80a96-data-volume\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:18.679303 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:18.679272 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:12:18.679392 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:18.679320 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm podName:81b00fbc-7e56-4591-b2d7-7342d6c80a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:19.179305346 +0000 UTC m=+241.479312842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjqdg" (UID: "81b00fbc-7e56-4591-b2d7-7342d6c80a96") : configmap "kube-rbac-proxy" not found Sep 09 23:12:18.679392 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:18.679320 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:12:18.679392 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:18.679349 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls podName:81b00fbc-7e56-4591-b2d7-7342d6c80a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:19.179342685 +0000 UTC m=+241.479350181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjqdg" (UID: "81b00fbc-7e56-4591-b2d7-7342d6c80a96") : secret "insights-runtime-extractor-tls" not found Sep 09 23:12:18.686400 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.686377 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbn29\" (UniqueName: \"kubernetes.io/projected/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-api-access-lbn29\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:18.721453 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.721424 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ktr96" Sep 09 23:12:18.761140 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.761096 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:18.813335 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.813307 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:18.851356 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.851331 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ssjfn_2bcce2b0-0bd1-493e-b472-53b50f753f72/console-operator/1.log" Sep 09 23:12:18.851775 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.851760 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ssjfn_2bcce2b0-0bd1-493e-b472-53b50f753f72/console-operator/0.log" Sep 09 23:12:18.851878 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.851794 2567 generic.go:356] "Generic (PLEG): container finished" podID="2bcce2b0-0bd1-493e-b472-53b50f753f72" containerID="71242dfdb3fd6024bc247d64f3ec4adb04415dc5fd9902b36ddad11a870a8717" exitCode=255 Sep 09 23:12:18.851878 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.851847 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" event={"ID":"2bcce2b0-0bd1-493e-b472-53b50f753f72","Type":"ContainerDied","Data":"71242dfdb3fd6024bc247d64f3ec4adb04415dc5fd9902b36ddad11a870a8717"} Sep 09 23:12:18.851983 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.851900 2567 scope.go:117] "RemoveContainer" containerID="614acfad614fa4f08f70ad0963f8a59ae4af42194a41e911eec8b33ac2fc0ebc" Sep 09 23:12:18.852161 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.852139 2567 scope.go:117] "RemoveContainer" containerID="71242dfdb3fd6024bc247d64f3ec4adb04415dc5fd9902b36ddad11a870a8717" Sep 09 23:12:18.852347 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:18.852326 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-ssjfn_openshift-console-operator(2bcce2b0-0bd1-493e-b472-53b50f753f72)\"" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" podUID="2bcce2b0-0bd1-493e-b472-53b50f753f72" Sep 09 23:12:18.986750 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:18.986714 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ktr96"] Sep 09 23:12:18.989066 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:12:18.989042 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d28512b_6ae7_421e_83ae_e1da3bab8bda.slice/crio-0a63290de4371f26087820ed8b957a020fe0f230c50b21c92951c8d65fcec43e WatchSource:0}: Error finding container 0a63290de4371f26087820ed8b957a020fe0f230c50b21c92951c8d65fcec43e: Status 404 returned error can't find the container with id 0a63290de4371f26087820ed8b957a020fe0f230c50b21c92951c8d65fcec43e Sep 09 23:12:19.184037 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:19.183996 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:19.184170 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:19.184052 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:19.184170 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:19.184122 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:12:19.184268 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:19.184181 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:12:19.184268 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:19.184187 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm podName:81b00fbc-7e56-4591-b2d7-7342d6c80a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:20.18416828 +0000 UTC m=+242.484175776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjqdg" (UID: "81b00fbc-7e56-4591-b2d7-7342d6c80a96") : configmap "kube-rbac-proxy" not found Sep 09 23:12:19.184268 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:19.184214 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls podName:81b00fbc-7e56-4591-b2d7-7342d6c80a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:20.184204614 +0000 UTC m=+242.484212120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjqdg" (UID: "81b00fbc-7e56-4591-b2d7-7342d6c80a96") : secret "insights-runtime-extractor-tls" not found Sep 09 23:12:19.242200 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:19.242121 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:19.342533 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:19.342502 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:19.856424 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:19.856381 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ktr96" event={"ID":"4d28512b-6ae7-421e-83ae-e1da3bab8bda","Type":"ContainerStarted","Data":"0a63290de4371f26087820ed8b957a020fe0f230c50b21c92951c8d65fcec43e"} Sep 09 23:12:19.858143 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:19.858112 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ssjfn_2bcce2b0-0bd1-493e-b472-53b50f753f72/console-operator/1.log" Sep 09 23:12:19.858495 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:19.858474 2567 scope.go:117] "RemoveContainer" containerID="71242dfdb3fd6024bc247d64f3ec4adb04415dc5fd9902b36ddad11a870a8717" Sep 09 23:12:19.858686 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:19.858661 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-ssjfn_openshift-console-operator(2bcce2b0-0bd1-493e-b472-53b50f753f72)\"" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" podUID="2bcce2b0-0bd1-493e-b472-53b50f753f72" Sep 09 23:12:20.191930 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.191902 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:20.192055 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:20.192039 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:12:20.192096 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.192056 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:20.192096 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:20.192089 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls podName:81b00fbc-7e56-4591-b2d7-7342d6c80a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:22.19207483 +0000 UTC m=+244.492082326 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjqdg" (UID: "81b00fbc-7e56-4591-b2d7-7342d6c80a96") : secret "insights-runtime-extractor-tls" not found Sep 09 23:12:20.192162 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:20.192112 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:12:20.192162 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:20.192157 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm podName:81b00fbc-7e56-4591-b2d7-7342d6c80a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:22.192142499 +0000 UTC m=+244.492149995 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjqdg" (UID: "81b00fbc-7e56-4591-b2d7-7342d6c80a96") : configmap "kube-rbac-proxy" not found Sep 09 23:12:20.415814 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.415739 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9644c_8a832abe-6374-4c97-be59-eb9e1423903c/dns-node-resolver/0.log" Sep 09 23:12:20.829785 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.829752 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-989t6"] Sep 09 23:12:20.832370 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.832354 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-989t6" Sep 09 23:12:20.834408 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.834380 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 09 23:12:20.834541 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.834431 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 09 23:12:20.834541 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.834463 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 09 23:12:20.834642 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.834615 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 09 23:12:20.835214 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.835196 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kw652\"" Sep 09 23:12:20.840688 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.840666 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-989t6"] Sep 09 23:12:20.863187 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.863158 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ktr96" event={"ID":"4d28512b-6ae7-421e-83ae-e1da3bab8bda","Type":"ContainerStarted","Data":"19307b0848cdad031306530e3d09a4ef9969c941964be0c3dc9659d7278f3e6e"} Sep 09 23:12:20.863555 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.863209 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ktr96" event={"ID":"4d28512b-6ae7-421e-83ae-e1da3bab8bda","Type":"ContainerStarted","Data":"89450e1d0e292743b7f2ec434d2024f74becaffd5cbad5df3af228174a84a974"} Sep 09 23:12:20.867996 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.867971 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:20.876925 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.876888 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ktr96" podStartSLOduration=1.795671816 podStartE2EDuration="2.876875574s" totalImagesPullingTime="1.081203758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:20.876165379 +0000 UTC m=+243.176172898" watchObservedRunningTime="2026-09-09 23:12:20.876875574 +0000 UTC m=+243.176883093" Sep 09 23:12:20.897761 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.897738 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmztw\" (UniqueName: \"kubernetes.io/projected/2ea458cd-0d56-4881-8dc2-47818b7ff721-kube-api-access-zmztw\") pod \"service-ca-75d99c484-989t6\" (UID: \"2ea458cd-0d56-4881-8dc2-47818b7ff721\") " pod="openshift-service-ca/service-ca-75d99c484-989t6" Sep 09 23:12:20.897850 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.897790 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ea458cd-0d56-4881-8dc2-47818b7ff721-signing-cabundle\") pod \"service-ca-75d99c484-989t6\" (UID: \"2ea458cd-0d56-4881-8dc2-47818b7ff721\") " pod="openshift-service-ca/service-ca-75d99c484-989t6" Sep 09 23:12:20.897850 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.897813 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ea458cd-0d56-4881-8dc2-47818b7ff721-signing-key\") pod \"service-ca-75d99c484-989t6\" (UID: \"2ea458cd-0d56-4881-8dc2-47818b7ff721\") " pod="openshift-service-ca/service-ca-75d99c484-989t6" Sep 09 23:12:20.969622 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.969571 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:20.998379 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.998350 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmztw\" (UniqueName: \"kubernetes.io/projected/2ea458cd-0d56-4881-8dc2-47818b7ff721-kube-api-access-zmztw\") pod \"service-ca-75d99c484-989t6\" (UID: \"2ea458cd-0d56-4881-8dc2-47818b7ff721\") " pod="openshift-service-ca/service-ca-75d99c484-989t6" Sep 09 23:12:20.998458 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.998405 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ea458cd-0d56-4881-8dc2-47818b7ff721-signing-cabundle\") pod \"service-ca-75d99c484-989t6\" (UID: \"2ea458cd-0d56-4881-8dc2-47818b7ff721\") " pod="openshift-service-ca/service-ca-75d99c484-989t6" Sep 09 23:12:20.998458 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.998434 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ea458cd-0d56-4881-8dc2-47818b7ff721-signing-key\") pod \"service-ca-75d99c484-989t6\" (UID: \"2ea458cd-0d56-4881-8dc2-47818b7ff721\") " pod="openshift-service-ca/service-ca-75d99c484-989t6" Sep 09 23:12:20.999183 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:20.999158 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ea458cd-0d56-4881-8dc2-47818b7ff721-signing-cabundle\") pod \"service-ca-75d99c484-989t6\" (UID: \"2ea458cd-0d56-4881-8dc2-47818b7ff721\") " pod="openshift-service-ca/service-ca-75d99c484-989t6" Sep 09 23:12:21.000877 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:21.000856 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ea458cd-0d56-4881-8dc2-47818b7ff721-signing-key\") pod \"service-ca-75d99c484-989t6\" (UID: \"2ea458cd-0d56-4881-8dc2-47818b7ff721\") " pod="openshift-service-ca/service-ca-75d99c484-989t6" Sep 09 23:12:21.007196 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:21.007176 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmztw\" (UniqueName: \"kubernetes.io/projected/2ea458cd-0d56-4881-8dc2-47818b7ff721-kube-api-access-zmztw\") pod \"service-ca-75d99c484-989t6\" (UID: \"2ea458cd-0d56-4881-8dc2-47818b7ff721\") " pod="openshift-service-ca/service-ca-75d99c484-989t6" Sep 09 23:12:21.069863 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:21.069833 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:21.146195 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:21.146138 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-989t6" Sep 09 23:12:21.401328 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:21.401258 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-q9l5r\" (UID: \"b698db08-6f86-4c21-ac42-70e7eefba846\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" Sep 09 23:12:21.401453 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:21.401373 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 23:12:21.401453 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:21.401440 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls podName:b698db08-6f86-4c21-ac42-70e7eefba846 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:29.401423536 +0000 UTC m=+251.701431034 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-q9l5r" (UID: "b698db08-6f86-4c21-ac42-70e7eefba846") : secret "cluster-monitoring-operator-tls" not found Sep 09 23:12:21.417365 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:21.417339 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-989t6"] Sep 09 23:12:21.420010 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:21.419986 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rx9nk_1668ae93-f22d-4b5d-b86d-0c120fd1ac49/node-ca/0.log" Sep 09 23:12:21.420360 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:12:21.420337 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ea458cd_0d56_4881_8dc2_47818b7ff721.slice/crio-b7a4823cb862a41cf813ef7fe6dbd05049c40118b62fbb9225efdd75f11e73ad WatchSource:0}: Error finding container b7a4823cb862a41cf813ef7fe6dbd05049c40118b62fbb9225efdd75f11e73ad: Status 404 returned error can't find the container with id b7a4823cb862a41cf813ef7fe6dbd05049c40118b62fbb9225efdd75f11e73ad Sep 09 23:12:21.501897 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:21.501865 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:21.502005 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:21.501988 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 23:12:21.502005 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:21.502005 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df7f76799-9xssh: secret "image-registry-tls" not found Sep 09 23:12:21.502081 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:21.502060 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls podName:4f9f2509-b7bb-47cf-b47c-01938fbe8a3d nodeName:}" failed. No retries permitted until 2026-09-09 23:12:29.502045445 +0000 UTC m=+251.802052942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls") pod "image-registry-df7f76799-9xssh" (UID: "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d") : secret "image-registry-tls" not found Sep 09 23:12:21.868977 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:21.868940 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-989t6" event={"ID":"2ea458cd-0d56-4881-8dc2-47818b7ff721","Type":"ContainerStarted","Data":"b7a4823cb862a41cf813ef7fe6dbd05049c40118b62fbb9225efdd75f11e73ad"} Sep 09 23:12:21.958786 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:21.958740 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:22.208268 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:22.208183 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:22.208419 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:22.208312 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:22.208419 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:22.208358 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:12:22.208419 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:22.208402 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:12:22.208557 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:22.208434 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls podName:81b00fbc-7e56-4591-b2d7-7342d6c80a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:26.20841058 +0000 UTC m=+248.508424923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjqdg" (UID: "81b00fbc-7e56-4591-b2d7-7342d6c80a96") : secret "insights-runtime-extractor-tls" not found Sep 09 23:12:22.208557 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:22.208464 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm podName:81b00fbc-7e56-4591-b2d7-7342d6c80a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:26.208444492 +0000 UTC m=+248.508451995 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjqdg" (UID: "81b00fbc-7e56-4591-b2d7-7342d6c80a96") : configmap "kube-rbac-proxy" not found Sep 09 23:12:22.415380 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:22.415354 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z8p6x_6f0a8a36-41da-42f7-98ee-21b2fbf71348/serve-healthcheck-canary/0.log" Sep 09 23:12:23.876333 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:23.876301 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-989t6" event={"ID":"2ea458cd-0d56-4881-8dc2-47818b7ff721","Type":"ContainerStarted","Data":"97c29e3456102b0fa371571d65eb1f74d664de91a7ed21cef2f1bc84d125fd1e"} Sep 09 23:12:23.892119 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:23.892077 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-989t6" podStartSLOduration=2.078576952 podStartE2EDuration="3.892062685s" totalImagesPullingTime="1.813485733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:23.891319018 +0000 UTC m=+246.191326535" watchObservedRunningTime="2026-09-09 23:12:23.892062685 +0000 UTC m=+246.192070244" Sep 09 23:12:24.070708 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:24.070680 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:24.070839 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:24.070732 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:24.071037 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:24.071025 2567 scope.go:117] "RemoveContainer" containerID="71242dfdb3fd6024bc247d64f3ec4adb04415dc5fd9902b36ddad11a870a8717" Sep 09 23:12:24.071169 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:24.071153 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-ssjfn_openshift-console-operator(2bcce2b0-0bd1-493e-b472-53b50f753f72)\"" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" podUID="2bcce2b0-0bd1-493e-b472-53b50f753f72" Sep 09 23:12:24.716637 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:24.716585 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:24.975532 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:24.975435 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:25.195025 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:25.194992 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:25.316340 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:25.316260 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:25.416353 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:25.416280 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:25.517035 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:25.516999 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:25.641487 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:25.641389 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:25.833689 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:25.833644 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:26.245125 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:26.245090 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:26.245485 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:26.245139 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:26.245485 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:26.245225 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:12:26.245485 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:26.245290 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm podName:81b00fbc-7e56-4591-b2d7-7342d6c80a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:34.245273959 +0000 UTC m=+256.545281455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjqdg" (UID: "81b00fbc-7e56-4591-b2d7-7342d6c80a96") : configmap "kube-rbac-proxy" not found Sep 09 23:12:26.245485 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:26.245231 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:12:26.245485 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:26.245370 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls podName:81b00fbc-7e56-4591-b2d7-7342d6c80a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:34.245359043 +0000 UTC m=+256.545366539 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjqdg" (UID: "81b00fbc-7e56-4591-b2d7-7342d6c80a96") : secret "insights-runtime-extractor-tls" not found Sep 09 23:12:27.002365 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:27.002326 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:27.215034 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:27.215000 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:27.404923 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:27.404830 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:27.598277 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:27.598248 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:27.806291 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:27.806258 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:28.592963 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:28.592932 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:28.646668 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:28.646565 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:28.800014 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:28.799969 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:29.007110 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:29.007076 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:29.398339 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:29.398252 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:29.469492 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:29.469467 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-q9l5r\" (UID: \"b698db08-6f86-4c21-ac42-70e7eefba846\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" Sep 09 23:12:29.469646 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:29.469632 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 23:12:29.469693 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:29.469688 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls podName:b698db08-6f86-4c21-ac42-70e7eefba846 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:45.469672526 +0000 UTC m=+267.769680021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-q9l5r" (UID: "b698db08-6f86-4c21-ac42-70e7eefba846") : secret "cluster-monitoring-operator-tls" not found Sep 09 23:12:29.570676 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:29.570642 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:29.572942 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:29.572922 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls\") pod \"image-registry-df7f76799-9xssh\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:29.607698 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:29.607664 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:29.677128 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:29.677066 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-48t55\"" Sep 09 23:12:29.685443 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:29.685427 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:29.872611 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:29.872562 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs\") pod \"network-metrics-daemon-gmk7t\" (UID: \"2e433ce1-5876-44c1-bafd-cf7237901a04\") " pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:12:29.872770 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:29.872716 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 23:12:29.872810 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:29.872783 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs podName:2e433ce1-5876-44c1-bafd-cf7237901a04 nodeName:}" failed. No retries permitted until 2026-09-09 23:14:31.872767481 +0000 UTC m=+374.172774978 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs") pod "network-metrics-daemon-gmk7t" (UID: "2e433ce1-5876-44c1-bafd-cf7237901a04") : secret "metrics-daemon-secret" not found Sep 09 23:12:29.953038 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:29.952960 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-df7f76799-9xssh"] Sep 09 23:12:29.955650 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:12:29.955617 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f9f2509_b7bb_47cf_b47c_01938fbe8a3d.slice/crio-8d02117467aa519d046758878ae199b93a0141320e4ce2f554f337ec58e2f00c WatchSource:0}: Error finding container 8d02117467aa519d046758878ae199b93a0141320e4ce2f554f337ec58e2f00c: Status 404 returned error can't find the container with id 8d02117467aa519d046758878ae199b93a0141320e4ce2f554f337ec58e2f00c Sep 09 23:12:30.008683 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:30.008656 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:30.804644 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:30.804606 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:30.898497 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:30.898463 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df7f76799-9xssh" event={"ID":"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d","Type":"ContainerStarted","Data":"4a13d9b3b648f3987bc02b848ca0c7c2f66622ed4c91e351d233b8a612771cd5"} Sep 09 23:12:30.898700 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:30.898514 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df7f76799-9xssh" event={"ID":"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d","Type":"ContainerStarted","Data":"8d02117467aa519d046758878ae199b93a0141320e4ce2f554f337ec58e2f00c"} Sep 09 23:12:30.898700 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:30.898615 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:12:30.916256 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:30.916210 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-df7f76799-9xssh" podStartSLOduration=17.916196422 podStartE2EDuration="17.916196422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:30.914820111 +0000 UTC m=+253.214827629" watchObservedRunningTime="2026-09-09 23:12:30.916196422 +0000 UTC m=+253.216203939" Sep 09 23:12:30.998555 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:30.998522 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:31.173385 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:31.173308 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:31.402921 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:31.402883 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:31.610001 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:31.609967 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:31.668038 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:31.668008 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:32.054868 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:32.054798 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:32.601602 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:32.601567 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:33.009102 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:33.009060 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:33.198138 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:33.198086 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:33.415503 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:33.415408 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:33.729460 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:33.729431 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:34.310007 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:34.309972 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:34.310468 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:34.310073 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:34.310468 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:34.310119 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:12:34.310468 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:34.310181 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls podName:81b00fbc-7e56-4591-b2d7-7342d6c80a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:50.310165625 +0000 UTC m=+272.610173121 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjqdg" (UID: "81b00fbc-7e56-4591-b2d7-7342d6c80a96") : secret "insights-runtime-extractor-tls" not found Sep 09 23:12:34.310750 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:34.310730 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81b00fbc-7e56-4591-b2d7-7342d6c80a96-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:34.618055 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:34.617954 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:34.800916 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:34.800879 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:35.005395 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:35.005357 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:35.198817 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:35.198784 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:35.397222 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:35.397139 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:39.188718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:39.188692 2567 scope.go:117] "RemoveContainer" containerID="71242dfdb3fd6024bc247d64f3ec4adb04415dc5fd9902b36ddad11a870a8717" Sep 09 23:12:39.930368 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:39.930337 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ssjfn_2bcce2b0-0bd1-493e-b472-53b50f753f72/console-operator/2.log" Sep 09 23:12:39.930769 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:39.930751 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ssjfn_2bcce2b0-0bd1-493e-b472-53b50f753f72/console-operator/1.log" Sep 09 23:12:39.930852 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:39.930785 2567 generic.go:356] "Generic (PLEG): container finished" podID="2bcce2b0-0bd1-493e-b472-53b50f753f72" containerID="8995e635d1defdc84c8e67f53d3b2d31b25404563644710acd837f727cd26984" exitCode=255 Sep 09 23:12:39.930852 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:39.930847 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" event={"ID":"2bcce2b0-0bd1-493e-b472-53b50f753f72","Type":"ContainerDied","Data":"8995e635d1defdc84c8e67f53d3b2d31b25404563644710acd837f727cd26984"} Sep 09 23:12:39.930950 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:39.930890 2567 scope.go:117] "RemoveContainer" containerID="71242dfdb3fd6024bc247d64f3ec4adb04415dc5fd9902b36ddad11a870a8717" Sep 09 23:12:39.931263 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:39.931233 2567 scope.go:117] "RemoveContainer" containerID="8995e635d1defdc84c8e67f53d3b2d31b25404563644710acd837f727cd26984" Sep 09 23:12:39.931420 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:39.931397 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-ssjfn_openshift-console-operator(2bcce2b0-0bd1-493e-b472-53b50f753f72)\"" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" podUID="2bcce2b0-0bd1-493e-b472-53b50f753f72" Sep 09 23:12:40.935472 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:40.935403 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ssjfn_2bcce2b0-0bd1-493e-b472-53b50f753f72/console-operator/2.log" Sep 09 23:12:41.785630 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:41.785582 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-df7f76799-9xssh"] Sep 09 23:12:41.876128 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:41.876094 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:41.987075 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:41.987025 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:42.098875 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:42.098798 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:42.198258 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:42.198229 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:44.070682 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:44.070648 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:44.071086 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:44.070699 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:12:44.071086 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:44.071003 2567 scope.go:117] "RemoveContainer" containerID="8995e635d1defdc84c8e67f53d3b2d31b25404563644710acd837f727cd26984" Sep 09 23:12:44.071161 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:44.071139 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-ssjfn_openshift-console-operator(2bcce2b0-0bd1-493e-b472-53b50f753f72)\"" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" podUID="2bcce2b0-0bd1-493e-b472-53b50f753f72" Sep 09 23:12:45.491419 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:45.491380 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-q9l5r\" (UID: \"b698db08-6f86-4c21-ac42-70e7eefba846\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" Sep 09 23:12:45.493764 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:45.493744 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b698db08-6f86-4c21-ac42-70e7eefba846-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-q9l5r\" (UID: \"b698db08-6f86-4c21-ac42-70e7eefba846\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" Sep 09 23:12:45.780759 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:45.780683 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wf5z5\"" Sep 09 23:12:45.789083 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:45.789058 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" Sep 09 23:12:46.054943 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:46.054865 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r"] Sep 09 23:12:46.058750 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:12:46.058722 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb698db08_6f86_4c21_ac42_70e7eefba846.slice/crio-4bee6f3690685a3db78946c645993fe4f1f4a5c96dfeb3d54bb41130cec91f9f WatchSource:0}: Error finding container 4bee6f3690685a3db78946c645993fe4f1f4a5c96dfeb3d54bb41130cec91f9f: Status 404 returned error can't find the container with id 4bee6f3690685a3db78946c645993fe4f1f4a5c96dfeb3d54bb41130cec91f9f Sep 09 23:12:46.954011 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:46.953976 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" event={"ID":"b698db08-6f86-4c21-ac42-70e7eefba846","Type":"ContainerStarted","Data":"4bee6f3690685a3db78946c645993fe4f1f4a5c96dfeb3d54bb41130cec91f9f"} Sep 09 23:12:48.304035 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:48.303961 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:48.457120 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:48.457082 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-s799d"] Sep 09 23:12:48.459261 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:48.459239 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-s799d" Sep 09 23:12:48.460811 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:48.460789 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 09 23:12:48.460926 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:48.460900 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-nr5d7\"" Sep 09 23:12:48.467974 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:48.467951 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-s799d"] Sep 09 23:12:48.614674 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:48.614571 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a762f6a3-990f-4fcf-8fb4-e37ff174fb81-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-s799d\" (UID: \"a762f6a3-990f-4fcf-8fb4-e37ff174fb81\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-s799d" Sep 09 23:12:48.715758 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:48.715724 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a762f6a3-990f-4fcf-8fb4-e37ff174fb81-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-s799d\" (UID: \"a762f6a3-990f-4fcf-8fb4-e37ff174fb81\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-s799d" Sep 09 23:12:48.715906 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:48.715830 2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 09 23:12:48.715906 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:48.715876 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a762f6a3-990f-4fcf-8fb4-e37ff174fb81-tls-certificates podName:a762f6a3-990f-4fcf-8fb4-e37ff174fb81 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:49.215863581 +0000 UTC m=+271.515871076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a762f6a3-990f-4fcf-8fb4-e37ff174fb81-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-s799d" (UID: "a762f6a3-990f-4fcf-8fb4-e37ff174fb81") : secret "prometheus-operator-admission-webhook-tls" not found Sep 09 23:12:48.961526 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:48.961442 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" event={"ID":"b698db08-6f86-4c21-ac42-70e7eefba846","Type":"ContainerStarted","Data":"1848926da062828d2e0b368d83276581e884743b5521d4c596cf2d4751ee9f02"} Sep 09 23:12:48.994545 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:48.994494 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-q9l5r" podStartSLOduration=34.065635429 podStartE2EDuration="35.994478918s" totalImagesPullingTime="1.928843489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:48.993685655 +0000 UTC m=+271.293693173" watchObservedRunningTime="2026-09-09 23:12:48.994478918 +0000 UTC m=+271.294486434" Sep 09 23:12:49.219556 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:49.219460 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a762f6a3-990f-4fcf-8fb4-e37ff174fb81-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-s799d\" (UID: \"a762f6a3-990f-4fcf-8fb4-e37ff174fb81\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-s799d" Sep 09 23:12:49.221777 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:49.221756 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a762f6a3-990f-4fcf-8fb4-e37ff174fb81-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-s799d\" (UID: \"a762f6a3-990f-4fcf-8fb4-e37ff174fb81\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-s799d" Sep 09 23:12:49.369556 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:49.369523 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-s799d" Sep 09 23:12:49.636749 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:49.636716 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-s799d"] Sep 09 23:12:49.640451 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:12:49.640415 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda762f6a3_990f_4fcf_8fb4_e37ff174fb81.slice/crio-adf559fa9070088c93e41ad43ef8ab4a0c40b17fe64158f0fd44fe8376e5fd29 WatchSource:0}: Error finding container adf559fa9070088c93e41ad43ef8ab4a0c40b17fe64158f0fd44fe8376e5fd29: Status 404 returned error can't find the container with id adf559fa9070088c93e41ad43ef8ab4a0c40b17fe64158f0fd44fe8376e5fd29 Sep 09 23:12:49.770499 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:49.770468 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:49.965097 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:49.965025 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-s799d" event={"ID":"a762f6a3-990f-4fcf-8fb4-e37ff174fb81","Type":"ContainerStarted","Data":"adf559fa9070088c93e41ad43ef8ab4a0c40b17fe64158f0fd44fe8376e5fd29"} Sep 09 23:12:50.327456 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:50.327417 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:50.329947 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:50.329919 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81b00fbc-7e56-4591-b2d7-7342d6c80a96-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjqdg\" (UID: \"81b00fbc-7e56-4591-b2d7-7342d6c80a96\") " pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:50.584109 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:50.584019 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vjqdg" Sep 09 23:12:50.969802 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:50.969720 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-s799d" event={"ID":"a762f6a3-990f-4fcf-8fb4-e37ff174fb81","Type":"ContainerStarted","Data":"6bd4b16ce090fb931c0757dc277eb40208b3deae499a3f58661414e15c14b5f2"} Sep 09 23:12:50.969957 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:50.969873 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-s799d" Sep 09 23:12:50.974755 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:50.974733 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-s799d" Sep 09 23:12:50.978872 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:50.978854 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vjqdg"] Sep 09 23:12:50.981695 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:12:50.981669 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81b00fbc_7e56_4591_b2d7_7342d6c80a96.slice/crio-8444d2ca5e78734936e9706e2bda44af2c7810748e78b5d462c52dae386d972a WatchSource:0}: Error finding container 8444d2ca5e78734936e9706e2bda44af2c7810748e78b5d462c52dae386d972a: Status 404 returned error can't find the container with id 8444d2ca5e78734936e9706e2bda44af2c7810748e78b5d462c52dae386d972a Sep 09 23:12:50.984802 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:50.984759 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-s799d" podStartSLOduration=1.8761865100000001 podStartE2EDuration="2.984745833s" totalImagesPullingTime="1.108559323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:50.983923115 +0000 UTC m=+273.283930634" watchObservedRunningTime="2026-09-09 23:12:50.984745833 +0000 UTC m=+273.284753377" Sep 09 23:12:51.492293 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.492263 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:51.541872 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.541839 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-l958n"] Sep 09 23:12:51.544232 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.544208 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" Sep 09 23:12:51.546390 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.546333 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 09 23:12:51.547019 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.546812 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 23:12:51.547019 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.546852 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qwzms\"" Sep 09 23:12:51.547019 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.546860 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 09 23:12:51.555263 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.555181 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-l958n"] Sep 09 23:12:51.596133 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.596052 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:51.637670 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.637639 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqbrf\" (UniqueName: \"kubernetes.io/projected/0058bb86-72c9-4276-9e06-aa1d7b7897c3-kube-api-access-cqbrf\") pod \"prometheus-operator-6f4946db56-l958n\" (UID: \"0058bb86-72c9-4276-9e06-aa1d7b7897c3\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" Sep 09 23:12:51.637825 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.637678 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0058bb86-72c9-4276-9e06-aa1d7b7897c3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-l958n\" (UID: \"0058bb86-72c9-4276-9e06-aa1d7b7897c3\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" Sep 09 23:12:51.637825 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.637773 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0058bb86-72c9-4276-9e06-aa1d7b7897c3-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-l958n\" (UID: \"0058bb86-72c9-4276-9e06-aa1d7b7897c3\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" Sep 09 23:12:51.637825 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.637809 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0058bb86-72c9-4276-9e06-aa1d7b7897c3-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-l958n\" (UID: \"0058bb86-72c9-4276-9e06-aa1d7b7897c3\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" Sep 09 23:12:51.738680 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.738656 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0058bb86-72c9-4276-9e06-aa1d7b7897c3-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-l958n\" (UID: \"0058bb86-72c9-4276-9e06-aa1d7b7897c3\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" Sep 09 23:12:51.738772 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.738690 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0058bb86-72c9-4276-9e06-aa1d7b7897c3-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-l958n\" (UID: \"0058bb86-72c9-4276-9e06-aa1d7b7897c3\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" Sep 09 23:12:51.738772 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.738732 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqbrf\" (UniqueName: \"kubernetes.io/projected/0058bb86-72c9-4276-9e06-aa1d7b7897c3-kube-api-access-cqbrf\") pod \"prometheus-operator-6f4946db56-l958n\" (UID: \"0058bb86-72c9-4276-9e06-aa1d7b7897c3\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" Sep 09 23:12:51.738772 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.738751 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0058bb86-72c9-4276-9e06-aa1d7b7897c3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-l958n\" (UID: \"0058bb86-72c9-4276-9e06-aa1d7b7897c3\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" Sep 09 23:12:51.738876 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:51.738846 2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 09 23:12:51.738915 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:51.738905 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0058bb86-72c9-4276-9e06-aa1d7b7897c3-prometheus-operator-tls podName:0058bb86-72c9-4276-9e06-aa1d7b7897c3 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:52.238887624 +0000 UTC m=+274.538895138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/0058bb86-72c9-4276-9e06-aa1d7b7897c3-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-l958n" (UID: "0058bb86-72c9-4276-9e06-aa1d7b7897c3") : secret "prometheus-operator-tls" not found Sep 09 23:12:51.739426 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.739407 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0058bb86-72c9-4276-9e06-aa1d7b7897c3-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-l958n\" (UID: \"0058bb86-72c9-4276-9e06-aa1d7b7897c3\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" Sep 09 23:12:51.740957 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.740939 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0058bb86-72c9-4276-9e06-aa1d7b7897c3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-l958n\" (UID: \"0058bb86-72c9-4276-9e06-aa1d7b7897c3\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" Sep 09 23:12:51.748769 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.748719 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqbrf\" (UniqueName: \"kubernetes.io/projected/0058bb86-72c9-4276-9e06-aa1d7b7897c3-kube-api-access-cqbrf\") pod \"prometheus-operator-6f4946db56-l958n\" (UID: \"0058bb86-72c9-4276-9e06-aa1d7b7897c3\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" Sep 09 23:12:51.791181 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.791155 2567 patch_prober.go:28] interesting pod/image-registry-df7f76799-9xssh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 09 23:12:51.791277 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.791198 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-df7f76799-9xssh" podUID="4f9f2509-b7bb-47cf-b47c-01938fbe8a3d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 23:12:51.799420 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.799390 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:51.976508 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.976480 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vjqdg" event={"ID":"81b00fbc-7e56-4591-b2d7-7342d6c80a96","Type":"ContainerStarted","Data":"df37a8345b26b7784fdc6a22e2a38b4adb7d9481f75ee5b45da8b579fca4f951"} Sep 09 23:12:51.976660 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.976531 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vjqdg" event={"ID":"81b00fbc-7e56-4591-b2d7-7342d6c80a96","Type":"ContainerStarted","Data":"20bb964fa160fdeb5afe356506c4f64f56eaea2551fc7994ae711e144239bd34"} Sep 09 23:12:51.976660 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:51.976551 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vjqdg" event={"ID":"81b00fbc-7e56-4591-b2d7-7342d6c80a96","Type":"ContainerStarted","Data":"8444d2ca5e78734936e9706e2bda44af2c7810748e78b5d462c52dae386d972a"} Sep 09 23:12:52.243630 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:52.243576 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0058bb86-72c9-4276-9e06-aa1d7b7897c3-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-l958n\" (UID: \"0058bb86-72c9-4276-9e06-aa1d7b7897c3\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" Sep 09 23:12:52.246127 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:52.246104 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0058bb86-72c9-4276-9e06-aa1d7b7897c3-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-l958n\" (UID: \"0058bb86-72c9-4276-9e06-aa1d7b7897c3\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" Sep 09 23:12:52.455868 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:52.455835 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" Sep 09 23:12:52.726066 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:52.726033 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-l958n"] Sep 09 23:12:53.060899 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:12:53.060863 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0058bb86_72c9_4276_9e06_aa1d7b7897c3.slice/crio-32f25769d0a1737215aecbbd300bae9834553d09d2837ee539e0404447cc9726 WatchSource:0}: Error finding container 32f25769d0a1737215aecbbd300bae9834553d09d2837ee539e0404447cc9726: Status 404 returned error can't find the container with id 32f25769d0a1737215aecbbd300bae9834553d09d2837ee539e0404447cc9726 Sep 09 23:12:53.987190 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:53.987146 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vjqdg" event={"ID":"81b00fbc-7e56-4591-b2d7-7342d6c80a96","Type":"ContainerStarted","Data":"74fdd3438c1b4a9fbf6caea510870af03dc86c09f7b40ff88da948a8debc4121"} Sep 09 23:12:53.988544 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:53.988510 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" event={"ID":"0058bb86-72c9-4276-9e06-aa1d7b7897c3","Type":"ContainerStarted","Data":"32f25769d0a1737215aecbbd300bae9834553d09d2837ee539e0404447cc9726"} Sep 09 23:12:54.002469 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:54.002427 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vjqdg" podStartSLOduration=34.006154009 podStartE2EDuration="36.00241329s" totalImagesPullingTime="1.996259281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:12:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:54.002076836 +0000 UTC m=+276.302084363" watchObservedRunningTime="2026-09-09 23:12:54.00241329 +0000 UTC m=+276.302420804" Sep 09 23:12:54.677764 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:54.677669 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:54.780086 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:54.780058 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:54.846648 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:54.846612 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:54.993679 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:54.993646 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" event={"ID":"0058bb86-72c9-4276-9e06-aa1d7b7897c3","Type":"ContainerStarted","Data":"c048e7f6ff8bc52fc5a8f33b468f8bdec71d0e8df7b2442a46d3d53d0720963c"} Sep 09 23:12:54.994045 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:54.993728 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" event={"ID":"0058bb86-72c9-4276-9e06-aa1d7b7897c3","Type":"ContainerStarted","Data":"dd9ac19b888724d99e0c166c815e227d4531dfced6f96c2cf8a3f451e6189c24"} Sep 09 23:12:55.010419 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:55.010379 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-l958n" podStartSLOduration=2.66410168 podStartE2EDuration="4.010364724s" totalImagesPullingTime="1.346263044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:55.009138953 +0000 UTC m=+277.309146473" watchObservedRunningTime="2026-09-09 23:12:55.010364724 +0000 UTC m=+277.310372241" Sep 09 23:12:55.188087 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:55.188061 2567 scope.go:117] "RemoveContainer" containerID="8995e635d1defdc84c8e67f53d3b2d31b25404563644710acd837f727cd26984" Sep 09 23:12:55.188233 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:55.188210 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-ssjfn_openshift-console-operator(2bcce2b0-0bd1-493e-b472-53b50f753f72)\"" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" podUID="2bcce2b0-0bd1-493e-b472-53b50f753f72" Sep 09 23:12:56.652466 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.652435 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:56.787187 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.787157 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:56.882509 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.882474 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:56.884869 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.884837 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm"] Sep 09 23:12:56.887512 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.887492 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" Sep 09 23:12:56.889831 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.889810 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 09 23:12:56.889948 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.889810 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 09 23:12:56.890211 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.890195 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8r8w6\"" Sep 09 23:12:56.896474 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.896449 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq"] Sep 09 23:12:56.899578 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.899553 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:56.900273 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.900250 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm"] Sep 09 23:12:56.902099 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.901733 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 09 23:12:56.902099 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.901744 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qgvhp\"" Sep 09 23:12:56.902099 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.901819 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 09 23:12:56.902099 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.901963 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 09 23:12:56.910763 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.910743 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq"] Sep 09 23:12:56.917863 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.917841 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cj6xd"] Sep 09 23:12:56.920545 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.920525 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:56.922306 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.922281 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 23:12:56.922382 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.922307 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 23:12:56.922584 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.922565 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hzzbt\"" Sep 09 23:12:56.922705 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.922678 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 23:12:56.966277 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.966241 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:56.982151 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.982130 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8a225a8-9ad1-4095-9289-e345b477aece-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-n69zm\" (UID: \"f8a225a8-9ad1-4095-9289-e345b477aece\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" Sep 09 23:12:56.982257 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.982169 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xbfd\" (UniqueName: \"kubernetes.io/projected/f8a225a8-9ad1-4095-9289-e345b477aece-kube-api-access-8xbfd\") pod \"openshift-state-metrics-657fd6c54-n69zm\" (UID: \"f8a225a8-9ad1-4095-9289-e345b477aece\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" Sep 09 23:12:56.982257 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.982199 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8a225a8-9ad1-4095-9289-e345b477aece-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-n69zm\" (UID: \"f8a225a8-9ad1-4095-9289-e345b477aece\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" Sep 09 23:12:56.982362 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:56.982278 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8a225a8-9ad1-4095-9289-e345b477aece-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-n69zm\" (UID: \"f8a225a8-9ad1-4095-9289-e345b477aece\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" Sep 09 23:12:57.066418 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.066384 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:57.083426 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.083389 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8a225a8-9ad1-4095-9289-e345b477aece-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-n69zm\" (UID: \"f8a225a8-9ad1-4095-9289-e345b477aece\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" Sep 09 23:12:57.083426 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.083429 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6600f6ca-bb13-4b3d-b067-e34fa983f21b-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.083643 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.083448 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6600f6ca-bb13-4b3d-b067-e34fa983f21b-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.083643 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.083504 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6600f6ca-bb13-4b3d-b067-e34fa983f21b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.083643 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.083550 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8a225a8-9ad1-4095-9289-e345b477aece-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-n69zm\" (UID: \"f8a225a8-9ad1-4095-9289-e345b477aece\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" Sep 09 23:12:57.083643 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.083581 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18d8a16c-8fef-4299-be92-ccc4447b5d72-node-exporter-accelerators-collector-config\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.083643 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.083625 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f24l\" (UniqueName: \"kubernetes.io/projected/18d8a16c-8fef-4299-be92-ccc4447b5d72-kube-api-access-5f24l\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.083877 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.083655 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18d8a16c-8fef-4299-be92-ccc4447b5d72-node-exporter-tls\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.083877 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.083684 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18d8a16c-8fef-4299-be92-ccc4447b5d72-node-exporter-wtmp\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.083877 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.083717 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18d8a16c-8fef-4299-be92-ccc4447b5d72-root\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.083877 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.083780 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6600f6ca-bb13-4b3d-b067-e34fa983f21b-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.083877 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.083815 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18d8a16c-8fef-4299-be92-ccc4447b5d72-metrics-client-ca\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.083877 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.083873 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8a225a8-9ad1-4095-9289-e345b477aece-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-n69zm\" (UID: \"f8a225a8-9ad1-4095-9289-e345b477aece\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" Sep 09 23:12:57.084171 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.083903 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18d8a16c-8fef-4299-be92-ccc4447b5d72-node-exporter-textfile\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.084171 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.083938 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xbfd\" (UniqueName: \"kubernetes.io/projected/f8a225a8-9ad1-4095-9289-e345b477aece-kube-api-access-8xbfd\") pod \"openshift-state-metrics-657fd6c54-n69zm\" (UID: \"f8a225a8-9ad1-4095-9289-e345b477aece\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" Sep 09 23:12:57.084171 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.083970 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6600f6ca-bb13-4b3d-b067-e34fa983f21b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.084171 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.084000 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74g22\" (UniqueName: \"kubernetes.io/projected/6600f6ca-bb13-4b3d-b067-e34fa983f21b-kube-api-access-74g22\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.084171 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.084028 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18d8a16c-8fef-4299-be92-ccc4447b5d72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.084171 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.084056 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18d8a16c-8fef-4299-be92-ccc4447b5d72-sys\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.084432 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.084332 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8a225a8-9ad1-4095-9289-e345b477aece-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-n69zm\" (UID: \"f8a225a8-9ad1-4095-9289-e345b477aece\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" Sep 09 23:12:57.086245 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.086221 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8a225a8-9ad1-4095-9289-e345b477aece-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-n69zm\" (UID: \"f8a225a8-9ad1-4095-9289-e345b477aece\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" Sep 09 23:12:57.086363 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.086252 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8a225a8-9ad1-4095-9289-e345b477aece-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-n69zm\" (UID: \"f8a225a8-9ad1-4095-9289-e345b477aece\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" Sep 09 23:12:57.090583 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.090563 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xbfd\" (UniqueName: \"kubernetes.io/projected/f8a225a8-9ad1-4095-9289-e345b477aece-kube-api-access-8xbfd\") pod \"openshift-state-metrics-657fd6c54-n69zm\" (UID: \"f8a225a8-9ad1-4095-9289-e345b477aece\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" Sep 09 23:12:57.167335 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.167263 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:57.184719 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.184689 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18d8a16c-8fef-4299-be92-ccc4447b5d72-node-exporter-textfile\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.184898 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.184735 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6600f6ca-bb13-4b3d-b067-e34fa983f21b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.184898 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.184776 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74g22\" (UniqueName: \"kubernetes.io/projected/6600f6ca-bb13-4b3d-b067-e34fa983f21b-kube-api-access-74g22\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.184898 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.184797 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18d8a16c-8fef-4299-be92-ccc4447b5d72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.184898 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.184820 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18d8a16c-8fef-4299-be92-ccc4447b5d72-sys\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.184898 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.184857 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6600f6ca-bb13-4b3d-b067-e34fa983f21b-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.184898 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.184882 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6600f6ca-bb13-4b3d-b067-e34fa983f21b-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.185190 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.184919 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6600f6ca-bb13-4b3d-b067-e34fa983f21b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.185190 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.184940 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18d8a16c-8fef-4299-be92-ccc4447b5d72-sys\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.185190 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.184950 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18d8a16c-8fef-4299-be92-ccc4447b5d72-node-exporter-accelerators-collector-config\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.185190 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.185012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f24l\" (UniqueName: \"kubernetes.io/projected/18d8a16c-8fef-4299-be92-ccc4447b5d72-kube-api-access-5f24l\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.185190 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.185044 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18d8a16c-8fef-4299-be92-ccc4447b5d72-node-exporter-tls\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.185190 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.185068 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18d8a16c-8fef-4299-be92-ccc4447b5d72-node-exporter-textfile\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.185190 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.185076 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18d8a16c-8fef-4299-be92-ccc4447b5d72-node-exporter-wtmp\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.185190 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.185128 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18d8a16c-8fef-4299-be92-ccc4447b5d72-root\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.185190 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.185165 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6600f6ca-bb13-4b3d-b067-e34fa983f21b-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.185190 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.185186 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18d8a16c-8fef-4299-be92-ccc4447b5d72-metrics-client-ca\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.185709 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.185247 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6600f6ca-bb13-4b3d-b067-e34fa983f21b-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.185709 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.185318 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18d8a16c-8fef-4299-be92-ccc4447b5d72-root\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.185709 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.185693 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6600f6ca-bb13-4b3d-b067-e34fa983f21b-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.185880 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.185719 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18d8a16c-8fef-4299-be92-ccc4447b5d72-node-exporter-accelerators-collector-config\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.185880 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.185797 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18d8a16c-8fef-4299-be92-ccc4447b5d72-metrics-client-ca\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.185880 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.185797 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6600f6ca-bb13-4b3d-b067-e34fa983f21b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.185880 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.185853 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18d8a16c-8fef-4299-be92-ccc4447b5d72-node-exporter-wtmp\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.187255 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.187230 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18d8a16c-8fef-4299-be92-ccc4447b5d72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.187429 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.187414 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18d8a16c-8fef-4299-be92-ccc4447b5d72-node-exporter-tls\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.187656 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.187635 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6600f6ca-bb13-4b3d-b067-e34fa983f21b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.187887 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.187866 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6600f6ca-bb13-4b3d-b067-e34fa983f21b-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.191869 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.191849 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74g22\" (UniqueName: \"kubernetes.io/projected/6600f6ca-bb13-4b3d-b067-e34fa983f21b-kube-api-access-74g22\") pod \"kube-state-metrics-74cb57df7-wrgbq\" (UID: \"6600f6ca-bb13-4b3d-b067-e34fa983f21b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.191951 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.191885 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f24l\" (UniqueName: \"kubernetes.io/projected/18d8a16c-8fef-4299-be92-ccc4447b5d72-kube-api-access-5f24l\") pod \"node-exporter-cj6xd\" (UID: \"18d8a16c-8fef-4299-be92-ccc4447b5d72\") " pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.199931 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.199909 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" Sep 09 23:12:57.211648 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.211623 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" Sep 09 23:12:57.229629 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.229602 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cj6xd" Sep 09 23:12:57.269933 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.269875 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:57.367457 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.367421 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:57.478715 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.478662 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm"] Sep 09 23:12:57.481089 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:12:57.481063 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8a225a8_9ad1_4095_9289_e345b477aece.slice/crio-b222acd8ce3b28bb871afb789f64616b58459b468275e366f5329e150e0b6d39 WatchSource:0}: Error finding container b222acd8ce3b28bb871afb789f64616b58459b468275e366f5329e150e0b6d39: Status 404 returned error can't find the container with id b222acd8ce3b28bb871afb789f64616b58459b468275e366f5329e150e0b6d39 Sep 09 23:12:57.504019 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.503995 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq"] Sep 09 23:12:57.509661 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:12:57.509630 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6600f6ca_bb13_4b3d_b067_e34fa983f21b.slice/crio-b86797689a012884f474150b6f9e1632909e220311da7816cb5d35e282e79d45 WatchSource:0}: Error finding container b86797689a012884f474150b6f9e1632909e220311da7816cb5d35e282e79d45: Status 404 returned error can't find the container with id b86797689a012884f474150b6f9e1632909e220311da7816cb5d35e282e79d45 Sep 09 23:12:57.657827 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:12:57.653714 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rdtvn" podUID="ad961056-ef98-4a07-947a-f503dafaa568" Sep 09 23:12:57.875895 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.875818 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:57.960119 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:57.959807 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:58.007127 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:58.007081 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cj6xd" event={"ID":"18d8a16c-8fef-4299-be92-ccc4447b5d72","Type":"ContainerStarted","Data":"e4ae84336582feb445a1e6de36366d16cfbf271591e91d984d94beef22a0c20c"} Sep 09 23:12:58.008823 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:58.008797 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" event={"ID":"6600f6ca-bb13-4b3d-b067-e34fa983f21b","Type":"ContainerStarted","Data":"b86797689a012884f474150b6f9e1632909e220311da7816cb5d35e282e79d45"} Sep 09 23:12:58.014227 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:58.014195 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rdtvn" Sep 09 23:12:58.014523 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:58.014500 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" event={"ID":"f8a225a8-9ad1-4095-9289-e345b477aece","Type":"ContainerStarted","Data":"dd10f57899039d750f8196c934a2c1b9210c36251c5dcea448551004492a9e9e"} Sep 09 23:12:58.014652 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:58.014552 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" event={"ID":"f8a225a8-9ad1-4095-9289-e345b477aece","Type":"ContainerStarted","Data":"327700d00ed4f507fbb331f6cf3bebbba4020bbd6c1adc17b4cf72850c9f8680"} Sep 09 23:12:58.014652 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:58.014582 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" event={"ID":"f8a225a8-9ad1-4095-9289-e345b477aece","Type":"ContainerStarted","Data":"b222acd8ce3b28bb871afb789f64616b58459b468275e366f5329e150e0b6d39"} Sep 09 23:12:58.100934 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:58.100851 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:58.882214 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:58.882171 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:59.810022 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:59.809988 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:59.865149 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:59.865083 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:12:59.982003 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:12:59.981959 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:00.022773 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:00.022747 2567 generic.go:356] "Generic (PLEG): container finished" podID="18d8a16c-8fef-4299-be92-ccc4447b5d72" containerID="0802fa1c3dc6b3088324dab6f37534f49f557027d2c648d2f5d017e530661968" exitCode=0 Sep 09 23:13:00.022939 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:00.022840 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cj6xd" event={"ID":"18d8a16c-8fef-4299-be92-ccc4447b5d72","Type":"ContainerDied","Data":"0802fa1c3dc6b3088324dab6f37534f49f557027d2c648d2f5d017e530661968"} Sep 09 23:13:00.025150 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:00.025118 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" event={"ID":"6600f6ca-bb13-4b3d-b067-e34fa983f21b","Type":"ContainerStarted","Data":"f12498c2d62eac530bff77b04f23e00107dcf82aab3f85c03c7cb8914a2fdb1f"} Sep 09 23:13:00.025259 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:00.025168 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" event={"ID":"6600f6ca-bb13-4b3d-b067-e34fa983f21b","Type":"ContainerStarted","Data":"de2aad717b1ddb6ff14d453a56829f2e8d7ec3d4f2464468002b3ef8cbef5463"} Sep 09 23:13:00.025259 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:00.025193 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" event={"ID":"6600f6ca-bb13-4b3d-b067-e34fa983f21b","Type":"ContainerStarted","Data":"9d23bf2547daf5c196ff80f557e72a6f6678bf33bf8e8be8e577543c8d4b841e"} Sep 09 23:13:00.027660 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:00.027638 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" event={"ID":"f8a225a8-9ad1-4095-9289-e345b477aece","Type":"ContainerStarted","Data":"d55d317827bda63dffa10d9b245f1da3dff8f35f28da29dc89adac4442108cd3"} Sep 09 23:13:00.055342 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:00.055287 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-wrgbq" podStartSLOduration=2.409352393 podStartE2EDuration="4.055268179s" totalImagesPullingTime="1.645915786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:00.053779168 +0000 UTC m=+282.353786686" watchObservedRunningTime="2026-09-09 23:13:00.055268179 +0000 UTC m=+282.355275698" Sep 09 23:13:00.073938 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:00.073898 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-n69zm" podStartSLOduration=2.522482493 podStartE2EDuration="4.073882991s" totalImagesPullingTime="1.551400498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:00.073038157 +0000 UTC m=+282.373045705" watchObservedRunningTime="2026-09-09 23:13:00.073882991 +0000 UTC m=+282.373890508" Sep 09 23:13:00.382424 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:00.382338 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:01.032917 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:01.032873 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cj6xd" event={"ID":"18d8a16c-8fef-4299-be92-ccc4447b5d72","Type":"ContainerStarted","Data":"e36008df02ba2651974ad2611b84a5ff7b5e7bc2c50718f5ca7127edb19b95f1"} Sep 09 23:13:01.033262 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:01.032962 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cj6xd" event={"ID":"18d8a16c-8fef-4299-be92-ccc4447b5d72","Type":"ContainerStarted","Data":"e8adfc3a1c3c3e465187755d8102a969c7ea5ef071667365326846f26309ce86"} Sep 09 23:13:01.051350 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:01.051304 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cj6xd" podStartSLOduration=3.069397123 podStartE2EDuration="5.051289042s" totalImagesPullingTime="1.905453208s" totalInitContainerRuntime="76.438711ms" isStatefulPod=true podCreationTimestamp="2026-09-09 23:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:01.049678526 +0000 UTC m=+283.349686044" watchObservedRunningTime="2026-09-09 23:13:01.051289042 +0000 UTC m=+283.351296559" Sep 09 23:13:01.422540 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:01.422459 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:13:01.424740 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:01.424714 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad961056-ef98-4a07-947a-f503dafaa568-metrics-tls\") pod \"dns-default-rdtvn\" (UID: \"ad961056-ef98-4a07-947a-f503dafaa568\") " pod="openshift-dns/dns-default-rdtvn" Sep 09 23:13:01.617367 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:01.617331 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-249ln\"" Sep 09 23:13:01.626122 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:01.626096 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rdtvn" Sep 09 23:13:01.672225 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:01.672163 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:01.790843 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:01.790805 2567 patch_prober.go:28] interesting pod/image-registry-df7f76799-9xssh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 09 23:13:01.790995 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:01.790858 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-df7f76799-9xssh" podUID="4f9f2509-b7bb-47cf-b47c-01938fbe8a3d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 23:13:01.856759 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:01.856723 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:01.898585 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:01.898552 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rdtvn"] Sep 09 23:13:01.901184 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:13:01.901157 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad961056_ef98_4a07_947a_f503dafaa568.slice/crio-7a4174faa681de688ebd00b44a51226290fb4c013a67f4428c20a98aae6804f2 WatchSource:0}: Error finding container 7a4174faa681de688ebd00b44a51226290fb4c013a67f4428c20a98aae6804f2: Status 404 returned error can't find the container with id 7a4174faa681de688ebd00b44a51226290fb4c013a67f4428c20a98aae6804f2 Sep 09 23:13:02.038370 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:02.038341 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rdtvn" event={"ID":"ad961056-ef98-4a07-947a-f503dafaa568","Type":"ContainerStarted","Data":"7a4174faa681de688ebd00b44a51226290fb4c013a67f4428c20a98aae6804f2"} Sep 09 23:13:03.085565 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.085524 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:03.095632 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.093498 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:13:03.098070 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.098047 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.100189 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.100164 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 09 23:13:03.100603 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.100575 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 09 23:13:03.100892 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.100876 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 23:13:03.101084 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.101064 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 09 23:13:03.101277 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.101262 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 09 23:13:03.102262 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.102005 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 09 23:13:03.102262 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.102043 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 09 23:13:03.102262 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.102083 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 09 23:13:03.102262 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.102016 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 09 23:13:03.102262 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.102126 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c7pnn\"" Sep 09 23:13:03.102262 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.102009 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 09 23:13:03.102570 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.102276 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 09 23:13:03.102570 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.102537 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 09 23:13:03.102570 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.102558 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 09 23:13:03.104925 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.104016 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 09 23:13:03.104925 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.104442 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-am0a6kj7gd8jf\"" Sep 09 23:13:03.105882 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.105864 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 09 23:13:03.113878 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.113857 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:13:03.141051 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141019 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141209 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141058 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141209 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141082 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141209 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141104 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141209 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141130 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141209 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141176 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141447 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141219 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141447 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141245 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcpdt\" (UniqueName: \"kubernetes.io/projected/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-kube-api-access-kcpdt\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141447 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141277 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141447 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141300 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141447 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141332 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-config-out\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141447 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141379 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141447 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141406 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-web-config\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141447 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141436 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-config\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141783 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141463 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141783 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141504 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141783 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141653 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141783 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141677 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141783 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141700 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.141783 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.141725 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.242659 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.242621 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.242659 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.242665 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcpdt\" (UniqueName: \"kubernetes.io/projected/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-kube-api-access-kcpdt\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.242885 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.242806 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.242885 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.242846 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.242885 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.242876 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-config-out\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.243017 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.242910 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.243017 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.242940 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-web-config\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.243017 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.242970 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-config\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.243017 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.243002 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.243214 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.243044 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.243214 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.243110 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.243214 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.243134 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.243214 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.243161 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.243214 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.243185 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.243214 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.243213 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.243508 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.243331 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.244998 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.244244 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.244998 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.244610 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.244998 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.244653 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.244998 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.244696 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.244998 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.244732 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.244998 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.244770 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.245916 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.245891 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.246340 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.246318 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.246802 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.246774 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.249880 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.249008 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.249880 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.249407 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.249880 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.249847 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.250068 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.250023 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-web-config\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.250567 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.250529 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-config\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.251145 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.251108 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.251757 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.251349 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcpdt\" (UniqueName: \"kubernetes.io/projected/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-kube-api-access-kcpdt\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.251757 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.251514 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.251757 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.251648 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.251757 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.251724 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.252020 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.251995 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.252077 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.252043 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.252881 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.252843 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.253102 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.253083 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-config-out\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.254352 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.254330 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.411615 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.411517 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:03.885931 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:03.885902 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:13:03.888450 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:13:03.888416 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda943b6db_ec52_4599_a7ab_2bf8d484f2b0.slice/crio-c0887f5fa73ac3e019d9a57a4d003805b8869d3af40d2999fe8713e7b258c1a0 WatchSource:0}: Error finding container c0887f5fa73ac3e019d9a57a4d003805b8869d3af40d2999fe8713e7b258c1a0: Status 404 returned error can't find the container with id c0887f5fa73ac3e019d9a57a4d003805b8869d3af40d2999fe8713e7b258c1a0 Sep 09 23:13:04.048703 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:04.048640 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rdtvn" event={"ID":"ad961056-ef98-4a07-947a-f503dafaa568","Type":"ContainerStarted","Data":"8623eea3731fcbaf648e9240a0162bd05e5decd16a3942fedd225e00aa06988b"} Sep 09 23:13:04.048883 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:04.048720 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rdtvn" event={"ID":"ad961056-ef98-4a07-947a-f503dafaa568","Type":"ContainerStarted","Data":"50e35437eb2f3e4fabd9427008384bd89400d26c0eaeb39f8894083ef99e36de"} Sep 09 23:13:04.048883 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:04.048836 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rdtvn" Sep 09 23:13:04.049866 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:04.049839 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a943b6db-ec52-4599-a7ab-2bf8d484f2b0","Type":"ContainerStarted","Data":"c0887f5fa73ac3e019d9a57a4d003805b8869d3af40d2999fe8713e7b258c1a0"} Sep 09 23:13:04.065947 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:04.065906 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rdtvn" podStartSLOduration=251.30663245 podStartE2EDuration="4m13.065892039s" totalImagesPullingTime="1.759259589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:04.064306184 +0000 UTC m=+286.364313701" watchObservedRunningTime="2026-09-09 23:13:04.065892039 +0000 UTC m=+286.365899554" Sep 09 23:13:05.055369 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:05.055340 2567 generic.go:356] "Generic (PLEG): container finished" podID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerID="a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516" exitCode=0 Sep 09 23:13:05.055739 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:05.055433 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a943b6db-ec52-4599-a7ab-2bf8d484f2b0","Type":"ContainerDied","Data":"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516"} Sep 09 23:13:06.804639 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:06.804580 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-df7f76799-9xssh" podUID="4f9f2509-b7bb-47cf-b47c-01938fbe8a3d" containerName="registry" containerID="cri-o://4a13d9b3b648f3987bc02b848ca0c7c2f66622ed4c91e351d233b8a612771cd5" gracePeriod=30 Sep 09 23:13:07.067032 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.066959 2567 generic.go:356] "Generic (PLEG): container finished" podID="4f9f2509-b7bb-47cf-b47c-01938fbe8a3d" containerID="4a13d9b3b648f3987bc02b848ca0c7c2f66622ed4c91e351d233b8a612771cd5" exitCode=0 Sep 09 23:13:07.067160 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.067034 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df7f76799-9xssh" event={"ID":"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d","Type":"ContainerDied","Data":"4a13d9b3b648f3987bc02b848ca0c7c2f66622ed4c91e351d233b8a612771cd5"} Sep 09 23:13:07.067160 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.067091 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df7f76799-9xssh" event={"ID":"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d","Type":"ContainerDied","Data":"8d02117467aa519d046758878ae199b93a0141320e4ce2f554f337ec58e2f00c"} Sep 09 23:13:07.067160 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.067107 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d02117467aa519d046758878ae199b93a0141320e4ce2f554f337ec58e2f00c" Sep 09 23:13:07.068278 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.068257 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:13:07.183875 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.183832 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls\") pod \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " Sep 09 23:13:07.183875 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.183882 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-trusted-ca\") pod \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " Sep 09 23:13:07.184120 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.183923 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-installation-pull-secrets\") pod \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " Sep 09 23:13:07.184120 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.183945 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-certificates\") pod \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " Sep 09 23:13:07.184120 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.183990 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-image-registry-private-configuration\") pod \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " Sep 09 23:13:07.184120 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.184026 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r675h\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-kube-api-access-r675h\") pod \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " Sep 09 23:13:07.184120 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.184064 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-bound-sa-token\") pod \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " Sep 09 23:13:07.184377 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.184123 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-ca-trust-extracted\") pod \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\" (UID: \"4f9f2509-b7bb-47cf-b47c-01938fbe8a3d\") " Sep 09 23:13:07.184377 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.184333 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d" (UID: "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:13:07.184489 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.184443 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d" (UID: "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:13:07.187371 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.187346 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d" (UID: "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:13:07.187490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.187457 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-kube-api-access-r675h" (OuterVolumeSpecName: "kube-api-access-r675h") pod "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d" (UID: "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d"). InnerVolumeSpecName "kube-api-access-r675h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:13:07.187618 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.187576 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d" (UID: "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:13:07.187822 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.187797 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d" (UID: "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:13:07.187935 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.187897 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d" (UID: "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:13:07.187935 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.187912 2567 scope.go:117] "RemoveContainer" containerID="8995e635d1defdc84c8e67f53d3b2d31b25404563644710acd837f727cd26984" Sep 09 23:13:07.196606 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.196560 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d" (UID: "4f9f2509-b7bb-47cf-b47c-01938fbe8a3d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:13:07.285471 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.285436 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r675h\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-kube-api-access-r675h\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:13:07.285471 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.285470 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-bound-sa-token\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:13:07.285728 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.285487 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-ca-trust-extracted\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:13:07.285728 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.285501 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:13:07.285728 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.285515 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-trusted-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:13:07.285728 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.285529 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-installation-pull-secrets\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:13:07.285728 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.285543 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-registry-certificates\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:13:07.285728 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:07.285559 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d-image-registry-private-configuration\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:13:08.073708 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:08.073673 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df7f76799-9xssh" Sep 09 23:13:08.102558 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:08.102507 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-df7f76799-9xssh"] Sep 09 23:13:08.110621 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:08.110577 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-df7f76799-9xssh"] Sep 09 23:13:08.197534 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:08.197487 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f9f2509-b7bb-47cf-b47c-01938fbe8a3d" path="/var/lib/kubelet/pods/4f9f2509-b7bb-47cf-b47c-01938fbe8a3d/volumes" Sep 09 23:13:08.479043 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:08.479011 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:08.566958 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:08.566918 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:08.654479 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:08.654400 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:09.009640 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:09.009581 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:09.080452 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:09.080410 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a943b6db-ec52-4599-a7ab-2bf8d484f2b0","Type":"ContainerStarted","Data":"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276"} Sep 09 23:13:09.080917 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:09.080500 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a943b6db-ec52-4599-a7ab-2bf8d484f2b0","Type":"ContainerStarted","Data":"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff"} Sep 09 23:13:09.082383 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:09.082362 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ssjfn_2bcce2b0-0bd1-493e-b472-53b50f753f72/console-operator/2.log" Sep 09 23:13:09.082493 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:09.082419 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" event={"ID":"2bcce2b0-0bd1-493e-b472-53b50f753f72","Type":"ContainerStarted","Data":"8ab6ca978602e69ede2d5ebc0d2edc5301ec1760cc4f02cc23656be5fc92938f"} Sep 09 23:13:09.082720 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:09.082698 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:13:09.088865 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:09.088841 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" Sep 09 23:13:09.104009 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:09.103968 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-ssjfn" podStartSLOduration=53.598678136 podStartE2EDuration="56.103955838s" totalImagesPullingTime="2.505277702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:09.10220119 +0000 UTC m=+291.402208700" watchObservedRunningTime="2026-09-09 23:13:09.103955838 +0000 UTC m=+291.403963357" Sep 09 23:13:09.106564 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:09.106533 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:09.221313 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:09.221277 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:09.622144 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:09.622108 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:09.722550 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:09.722514 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:09.833779 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:09.833745 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:09.895731 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:09.895650 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:10.002878 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:10.002841 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:10.068413 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:10.068376 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:10.418135 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:10.418109 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:10.539746 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:10.539712 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:10.646714 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:10.646675 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:11.094289 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:11.094256 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a943b6db-ec52-4599-a7ab-2bf8d484f2b0","Type":"ContainerStarted","Data":"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823"} Sep 09 23:13:11.094451 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:11.094349 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a943b6db-ec52-4599-a7ab-2bf8d484f2b0","Type":"ContainerStarted","Data":"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758"} Sep 09 23:13:11.094451 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:11.094379 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a943b6db-ec52-4599-a7ab-2bf8d484f2b0","Type":"ContainerStarted","Data":"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44"} Sep 09 23:13:11.094451 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:11.094403 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a943b6db-ec52-4599-a7ab-2bf8d484f2b0","Type":"ContainerStarted","Data":"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f"} Sep 09 23:13:11.135085 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:11.135032 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.140979506 podStartE2EDuration="8.135011367s" totalImagesPullingTime="5.98252469s" totalInitContainerRuntime="11.507171ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:11.1334731 +0000 UTC m=+293.433480629" watchObservedRunningTime="2026-09-09 23:13:11.135011367 +0000 UTC m=+293.435018893" Sep 09 23:13:12.033631 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:12.033583 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:12.143433 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:12.143399 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:13.412212 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:13.412176 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:13:13.849034 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:13.848996 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:13.906778 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:13.906737 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:14.057403 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:14.057378 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rdtvn" Sep 09 23:13:14.189611 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:13:14.189519 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gmk7t" podUID="2e433ce1-5876-44c1-bafd-cf7237901a04" Sep 09 23:13:14.218427 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:14.218393 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:14.319196 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:14.319164 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:15.192827 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:15.192783 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:15.248935 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:15.248903 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:15.789855 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:15.789820 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:15.872827 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:15.872797 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:17.159625 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:17.159578 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:17.257661 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:17.257627 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:18.094790 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:18.094761 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ssjfn_2bcce2b0-0bd1-493e-b472-53b50f753f72/console-operator/2.log" Sep 09 23:13:18.095281 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:18.095254 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ssjfn_2bcce2b0-0bd1-493e-b472-53b50f753f72/console-operator/2.log" Sep 09 23:13:18.111398 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:18.111377 2567 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 23:13:20.906749 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:20.906712 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:21.007450 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:21.007413 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:24.021848 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:24.021815 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:24.075358 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:24.075322 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:24.276061 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:24.275981 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:24.340209 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:24.340175 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:24.782192 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:24.782155 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:24.883089 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:24.883050 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:27.072615 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:27.072563 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:27.172957 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:27.172929 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:27.432812 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:27.432721 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:28.189897 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:28.189861 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:13:33.822841 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:33.822799 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:33.879410 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:33.879375 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:35.032002 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:35.031968 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:35.084272 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:35.084243 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:37.027877 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:37.027843 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:37.844217 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:37.844183 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:37.945001 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:37.944966 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:42.077318 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:42.077286 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:42.178972 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:42.178932 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:42.858185 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:42.858149 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:44.660709 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:44.660668 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:13:47.233432 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:47.233405 2567 generic.go:356] "Generic (PLEG): container finished" podID="7b4c2371-e07d-441d-8b9b-bf11e7336f7a" containerID="269e0a5753ed25d4e19e242372985330f9ebb54b5293adb7097cca69256a0544" exitCode=0 Sep 09 23:13:47.233733 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:47.233442 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m" event={"ID":"7b4c2371-e07d-441d-8b9b-bf11e7336f7a","Type":"ContainerDied","Data":"269e0a5753ed25d4e19e242372985330f9ebb54b5293adb7097cca69256a0544"} Sep 09 23:13:47.233774 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:47.233756 2567 scope.go:117] "RemoveContainer" containerID="269e0a5753ed25d4e19e242372985330f9ebb54b5293adb7097cca69256a0544" Sep 09 23:13:48.237928 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:13:48.237893 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wm82m" event={"ID":"7b4c2371-e07d-441d-8b9b-bf11e7336f7a","Type":"ContainerStarted","Data":"f0b06436c31bfa6051f3f9ec06076ba570f9b713d47903dc4ac59a15768beb9c"} Sep 09 23:14:03.412611 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:03.412563 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:03.431891 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:03.431867 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:04.314741 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:04.314716 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:16.153616 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:16.153509 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:14:16.265513 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:16.265474 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:14:21.673051 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:21.673010 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:14:21.673462 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:21.673333 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="kube-rbac-proxy" containerID="cri-o://9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758" gracePeriod=600 Sep 09 23:14:21.673462 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:21.673381 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="config-reloader" containerID="cri-o://d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276" gracePeriod=600 Sep 09 23:14:21.673462 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:21.673373 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="kube-rbac-proxy-web" containerID="cri-o://0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44" gracePeriod=600 Sep 09 23:14:21.673637 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:21.673435 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823" gracePeriod=600 Sep 09 23:14:21.673637 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:21.673326 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="prometheus" containerID="cri-o://f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff" gracePeriod=600 Sep 09 23:14:21.673637 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:21.673353 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="thanos-sidecar" containerID="cri-o://d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f" gracePeriod=600 Sep 09 23:14:21.917198 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:21.917173 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.006069 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006037 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-2\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006069 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006074 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-tls-assets\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006301 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006093 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-metrics-client-certs\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006301 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006115 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-1\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006301 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006145 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006301 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006242 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-web-config\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006505 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006305 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-0\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006505 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006336 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-config\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006505 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006366 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-thanos-prometheus-http-client-file\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006505 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006411 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006505 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006448 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:14:22.006505 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006462 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-grpc-tls\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006505 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006491 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-kube-rbac-proxy\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006505 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006491 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:14:22.006921 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006522 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-kubelet-serving-ca-bundle\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006921 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006550 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-tls\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006921 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006583 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-config-out\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006921 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006637 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-db\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006921 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006662 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-serving-certs-ca-bundle\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006921 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006686 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-metrics-client-ca\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006921 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006710 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-trusted-ca-bundle\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.006921 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.006741 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcpdt\" (UniqueName: \"kubernetes.io/projected/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-kube-api-access-kcpdt\") pod \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\" (UID: \"a943b6db-ec52-4599-a7ab-2bf8d484f2b0\") " Sep 09 23:14:22.007318 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.007038 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.007318 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.007057 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.009799 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.007791 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:14:22.009799 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.008797 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:14:22.009799 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.009129 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:14:22.009799 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.009230 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:14:22.009799 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.009238 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:14:22.009799 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.009768 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:14:22.010735 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.010692 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:22.010845 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.010752 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:22.010912 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.010886 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-config" (OuterVolumeSpecName: "config") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:22.011063 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.011039 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:14:22.011342 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.011323 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:22.011911 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.011755 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:22.011911 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.011859 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-kube-api-access-kcpdt" (OuterVolumeSpecName: "kube-api-access-kcpdt") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "kube-api-access-kcpdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:14:22.012759 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.012726 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:22.012945 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.012921 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:22.015097 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.015035 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:22.015236 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.015212 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-config-out" (OuterVolumeSpecName: "config-out") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:14:22.022908 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.022886 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-web-config" (OuterVolumeSpecName: "web-config") pod "a943b6db-ec52-4599-a7ab-2bf8d484f2b0" (UID: "a943b6db-ec52-4599-a7ab-2bf8d484f2b0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:22.108304 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108275 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.108304 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108300 2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.108490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108311 2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.108490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108321 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.108490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108330 2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-grpc-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.108490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108339 2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-kube-rbac-proxy\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.108490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108347 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.108490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108355 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.108490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108363 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-config-out\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.108490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108371 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-k8s-db\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.108490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108378 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.108490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108386 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-configmap-metrics-client-ca\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.108490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108394 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.108490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108402 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcpdt\" (UniqueName: \"kubernetes.io/projected/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-kube-api-access-kcpdt\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.108490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108410 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-tls-assets\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.108490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108418 2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-metrics-client-certs\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.108490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108425 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.108490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.108433 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a943b6db-ec52-4599-a7ab-2bf8d484f2b0-web-config\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:14:22.371339 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.371257 2567 generic.go:356] "Generic (PLEG): container finished" podID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerID="58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823" exitCode=0 Sep 09 23:14:22.371339 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.371283 2567 generic.go:356] "Generic (PLEG): container finished" podID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerID="9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758" exitCode=0 Sep 09 23:14:22.371339 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.371292 2567 generic.go:356] "Generic (PLEG): container finished" podID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerID="0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44" exitCode=0 Sep 09 23:14:22.371339 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.371301 2567 generic.go:356] "Generic (PLEG): container finished" podID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerID="d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f" exitCode=0 Sep 09 23:14:22.371339 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.371309 2567 generic.go:356] "Generic (PLEG): container finished" podID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerID="d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276" exitCode=0 Sep 09 23:14:22.371339 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.371316 2567 generic.go:356] "Generic (PLEG): container finished" podID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerID="f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff" exitCode=0 Sep 09 23:14:22.371817 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.371340 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.371817 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.371335 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a943b6db-ec52-4599-a7ab-2bf8d484f2b0","Type":"ContainerDied","Data":"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823"} Sep 09 23:14:22.371817 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.371465 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a943b6db-ec52-4599-a7ab-2bf8d484f2b0","Type":"ContainerDied","Data":"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758"} Sep 09 23:14:22.371817 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.371492 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a943b6db-ec52-4599-a7ab-2bf8d484f2b0","Type":"ContainerDied","Data":"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44"} Sep 09 23:14:22.371817 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.371516 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a943b6db-ec52-4599-a7ab-2bf8d484f2b0","Type":"ContainerDied","Data":"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f"} Sep 09 23:14:22.371817 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.371530 2567 scope.go:117] "RemoveContainer" containerID="58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823" Sep 09 23:14:22.371817 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.371542 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a943b6db-ec52-4599-a7ab-2bf8d484f2b0","Type":"ContainerDied","Data":"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276"} Sep 09 23:14:22.371817 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.371568 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a943b6db-ec52-4599-a7ab-2bf8d484f2b0","Type":"ContainerDied","Data":"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff"} Sep 09 23:14:22.371817 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.371612 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a943b6db-ec52-4599-a7ab-2bf8d484f2b0","Type":"ContainerDied","Data":"c0887f5fa73ac3e019d9a57a4d003805b8869d3af40d2999fe8713e7b258c1a0"} Sep 09 23:14:22.381232 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.381206 2567 scope.go:117] "RemoveContainer" containerID="9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758" Sep 09 23:14:22.390256 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.390230 2567 scope.go:117] "RemoveContainer" containerID="0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44" Sep 09 23:14:22.397018 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.397000 2567 scope.go:117] "RemoveContainer" containerID="d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f" Sep 09 23:14:22.401819 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.401800 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:14:22.403960 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.403945 2567 scope.go:117] "RemoveContainer" containerID="d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276" Sep 09 23:14:22.410855 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.410788 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:14:22.410855 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.410849 2567 scope.go:117] "RemoveContainer" containerID="f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff" Sep 09 23:14:22.417940 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.417926 2567 scope.go:117] "RemoveContainer" containerID="a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516" Sep 09 23:14:22.424289 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.424273 2567 scope.go:117] "RemoveContainer" containerID="58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823" Sep 09 23:14:22.424550 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:14:22.424529 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823\": container with ID starting with 58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823 not found: ID does not exist" containerID="58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823" Sep 09 23:14:22.424615 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.424559 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823"} err="failed to get container status \"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823\": rpc error: code = NotFound desc = could not find container \"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823\": container with ID starting with 58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823 not found: ID does not exist" Sep 09 23:14:22.424615 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.424602 2567 scope.go:117] "RemoveContainer" containerID="9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758" Sep 09 23:14:22.424883 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:14:22.424864 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758\": container with ID starting with 9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758 not found: ID does not exist" containerID="9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758" Sep 09 23:14:22.424965 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.424891 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758"} err="failed to get container status \"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758\": rpc error: code = NotFound desc = could not find container \"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758\": container with ID starting with 9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758 not found: ID does not exist" Sep 09 23:14:22.424965 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.424912 2567 scope.go:117] "RemoveContainer" containerID="0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44" Sep 09 23:14:22.425154 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:14:22.425139 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44\": container with ID starting with 0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44 not found: ID does not exist" containerID="0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44" Sep 09 23:14:22.425192 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.425158 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44"} err="failed to get container status \"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44\": rpc error: code = NotFound desc = could not find container \"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44\": container with ID starting with 0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44 not found: ID does not exist" Sep 09 23:14:22.425192 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.425176 2567 scope.go:117] "RemoveContainer" containerID="d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f" Sep 09 23:14:22.425396 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:14:22.425379 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f\": container with ID starting with d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f not found: ID does not exist" containerID="d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f" Sep 09 23:14:22.425450 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.425404 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f"} err="failed to get container status \"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f\": rpc error: code = NotFound desc = could not find container \"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f\": container with ID starting with d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f not found: ID does not exist" Sep 09 23:14:22.425450 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.425424 2567 scope.go:117] "RemoveContainer" containerID="d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276" Sep 09 23:14:22.425924 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:14:22.425904 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276\": container with ID starting with d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276 not found: ID does not exist" containerID="d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276" Sep 09 23:14:22.425967 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.425928 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276"} err="failed to get container status \"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276\": rpc error: code = NotFound desc = could not find container \"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276\": container with ID starting with d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276 not found: ID does not exist" Sep 09 23:14:22.425967 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.425944 2567 scope.go:117] "RemoveContainer" containerID="f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff" Sep 09 23:14:22.426149 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:14:22.426136 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff\": container with ID starting with f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff not found: ID does not exist" containerID="f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff" Sep 09 23:14:22.426191 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.426150 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff"} err="failed to get container status \"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff\": rpc error: code = NotFound desc = could not find container \"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff\": container with ID starting with f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff not found: ID does not exist" Sep 09 23:14:22.426191 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.426161 2567 scope.go:117] "RemoveContainer" containerID="a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516" Sep 09 23:14:22.426328 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:14:22.426315 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516\": container with ID starting with a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516 not found: ID does not exist" containerID="a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516" Sep 09 23:14:22.426369 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.426329 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516"} err="failed to get container status \"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516\": rpc error: code = NotFound desc = could not find container \"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516\": container with ID starting with a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516 not found: ID does not exist" Sep 09 23:14:22.426369 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.426339 2567 scope.go:117] "RemoveContainer" containerID="58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823" Sep 09 23:14:22.426509 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.426495 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823"} err="failed to get container status \"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823\": rpc error: code = NotFound desc = could not find container \"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823\": container with ID starting with 58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823 not found: ID does not exist" Sep 09 23:14:22.426509 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.426508 2567 scope.go:117] "RemoveContainer" containerID="9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758" Sep 09 23:14:22.426734 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.426716 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758"} err="failed to get container status \"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758\": rpc error: code = NotFound desc = could not find container \"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758\": container with ID starting with 9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758 not found: ID does not exist" Sep 09 23:14:22.426782 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.426734 2567 scope.go:117] "RemoveContainer" containerID="0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44" Sep 09 23:14:22.426975 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.426955 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44"} err="failed to get container status \"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44\": rpc error: code = NotFound desc = could not find container \"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44\": container with ID starting with 0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44 not found: ID does not exist" Sep 09 23:14:22.427018 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.426976 2567 scope.go:117] "RemoveContainer" containerID="d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f" Sep 09 23:14:22.427189 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.427171 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f"} err="failed to get container status \"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f\": rpc error: code = NotFound desc = could not find container \"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f\": container with ID starting with d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f not found: ID does not exist" Sep 09 23:14:22.427261 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.427192 2567 scope.go:117] "RemoveContainer" containerID="d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276" Sep 09 23:14:22.427413 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.427396 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276"} err="failed to get container status \"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276\": rpc error: code = NotFound desc = could not find container \"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276\": container with ID starting with d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276 not found: ID does not exist" Sep 09 23:14:22.427480 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.427414 2567 scope.go:117] "RemoveContainer" containerID="f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff" Sep 09 23:14:22.427654 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.427636 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff"} err="failed to get container status \"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff\": rpc error: code = NotFound desc = could not find container \"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff\": container with ID starting with f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff not found: ID does not exist" Sep 09 23:14:22.427701 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.427655 2567 scope.go:117] "RemoveContainer" containerID="a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516" Sep 09 23:14:22.427849 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.427832 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516"} err="failed to get container status \"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516\": rpc error: code = NotFound desc = could not find container \"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516\": container with ID starting with a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516 not found: ID does not exist" Sep 09 23:14:22.427892 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.427849 2567 scope.go:117] "RemoveContainer" containerID="58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823" Sep 09 23:14:22.428036 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.428019 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823"} err="failed to get container status \"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823\": rpc error: code = NotFound desc = could not find container \"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823\": container with ID starting with 58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823 not found: ID does not exist" Sep 09 23:14:22.428080 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.428036 2567 scope.go:117] "RemoveContainer" containerID="9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758" Sep 09 23:14:22.428219 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.428204 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758"} err="failed to get container status \"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758\": rpc error: code = NotFound desc = could not find container \"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758\": container with ID starting with 9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758 not found: ID does not exist" Sep 09 23:14:22.428260 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.428219 2567 scope.go:117] "RemoveContainer" containerID="0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44" Sep 09 23:14:22.428406 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.428388 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44"} err="failed to get container status \"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44\": rpc error: code = NotFound desc = could not find container \"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44\": container with ID starting with 0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44 not found: ID does not exist" Sep 09 23:14:22.428480 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.428407 2567 scope.go:117] "RemoveContainer" containerID="d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f" Sep 09 23:14:22.428634 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.428619 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f"} err="failed to get container status \"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f\": rpc error: code = NotFound desc = could not find container \"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f\": container with ID starting with d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f not found: ID does not exist" Sep 09 23:14:22.428689 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.428634 2567 scope.go:117] "RemoveContainer" containerID="d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276" Sep 09 23:14:22.428830 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.428815 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276"} err="failed to get container status \"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276\": rpc error: code = NotFound desc = could not find container \"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276\": container with ID starting with d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276 not found: ID does not exist" Sep 09 23:14:22.428830 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.428830 2567 scope.go:117] "RemoveContainer" containerID="f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff" Sep 09 23:14:22.429025 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.429006 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff"} err="failed to get container status \"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff\": rpc error: code = NotFound desc = could not find container \"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff\": container with ID starting with f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff not found: ID does not exist" Sep 09 23:14:22.429090 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.429027 2567 scope.go:117] "RemoveContainer" containerID="a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516" Sep 09 23:14:22.429223 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.429207 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516"} err="failed to get container status \"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516\": rpc error: code = NotFound desc = could not find container \"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516\": container with ID starting with a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516 not found: ID does not exist" Sep 09 23:14:22.429267 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.429223 2567 scope.go:117] "RemoveContainer" containerID="58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823" Sep 09 23:14:22.429400 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.429386 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823"} err="failed to get container status \"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823\": rpc error: code = NotFound desc = could not find container \"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823\": container with ID starting with 58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823 not found: ID does not exist" Sep 09 23:14:22.429443 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.429400 2567 scope.go:117] "RemoveContainer" containerID="9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758" Sep 09 23:14:22.429584 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.429569 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758"} err="failed to get container status \"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758\": rpc error: code = NotFound desc = could not find container \"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758\": container with ID starting with 9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758 not found: ID does not exist" Sep 09 23:14:22.429647 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.429584 2567 scope.go:117] "RemoveContainer" containerID="0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44" Sep 09 23:14:22.429821 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.429804 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44"} err="failed to get container status \"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44\": rpc error: code = NotFound desc = could not find container \"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44\": container with ID starting with 0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44 not found: ID does not exist" Sep 09 23:14:22.429886 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.429823 2567 scope.go:117] "RemoveContainer" containerID="d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f" Sep 09 23:14:22.430024 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.430008 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f"} err="failed to get container status \"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f\": rpc error: code = NotFound desc = could not find container \"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f\": container with ID starting with d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f not found: ID does not exist" Sep 09 23:14:22.430068 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.430024 2567 scope.go:117] "RemoveContainer" containerID="d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276" Sep 09 23:14:22.430213 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.430198 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276"} err="failed to get container status \"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276\": rpc error: code = NotFound desc = could not find container \"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276\": container with ID starting with d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276 not found: ID does not exist" Sep 09 23:14:22.430299 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.430214 2567 scope.go:117] "RemoveContainer" containerID="f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff" Sep 09 23:14:22.430388 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.430373 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff"} err="failed to get container status \"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff\": rpc error: code = NotFound desc = could not find container \"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff\": container with ID starting with f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff not found: ID does not exist" Sep 09 23:14:22.430429 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.430388 2567 scope.go:117] "RemoveContainer" containerID="a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516" Sep 09 23:14:22.430566 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.430550 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516"} err="failed to get container status \"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516\": rpc error: code = NotFound desc = could not find container \"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516\": container with ID starting with a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516 not found: ID does not exist" Sep 09 23:14:22.430566 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.430566 2567 scope.go:117] "RemoveContainer" containerID="58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823" Sep 09 23:14:22.430831 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.430812 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823"} err="failed to get container status \"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823\": rpc error: code = NotFound desc = could not find container \"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823\": container with ID starting with 58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823 not found: ID does not exist" Sep 09 23:14:22.430890 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.430832 2567 scope.go:117] "RemoveContainer" containerID="9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758" Sep 09 23:14:22.431063 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.431046 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758"} err="failed to get container status \"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758\": rpc error: code = NotFound desc = could not find container \"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758\": container with ID starting with 9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758 not found: ID does not exist" Sep 09 23:14:22.431121 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.431066 2567 scope.go:117] "RemoveContainer" containerID="0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44" Sep 09 23:14:22.431299 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.431281 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44"} err="failed to get container status \"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44\": rpc error: code = NotFound desc = could not find container \"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44\": container with ID starting with 0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44 not found: ID does not exist" Sep 09 23:14:22.431344 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.431302 2567 scope.go:117] "RemoveContainer" containerID="d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f" Sep 09 23:14:22.431536 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.431519 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f"} err="failed to get container status \"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f\": rpc error: code = NotFound desc = could not find container \"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f\": container with ID starting with d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f not found: ID does not exist" Sep 09 23:14:22.431622 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.431537 2567 scope.go:117] "RemoveContainer" containerID="d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276" Sep 09 23:14:22.431781 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.431761 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276"} err="failed to get container status \"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276\": rpc error: code = NotFound desc = could not find container \"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276\": container with ID starting with d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276 not found: ID does not exist" Sep 09 23:14:22.431846 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.431782 2567 scope.go:117] "RemoveContainer" containerID="f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff" Sep 09 23:14:22.432022 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.432004 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff"} err="failed to get container status \"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff\": rpc error: code = NotFound desc = could not find container \"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff\": container with ID starting with f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff not found: ID does not exist" Sep 09 23:14:22.432065 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.432024 2567 scope.go:117] "RemoveContainer" containerID="a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516" Sep 09 23:14:22.432247 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.432223 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516"} err="failed to get container status \"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516\": rpc error: code = NotFound desc = could not find container \"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516\": container with ID starting with a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516 not found: ID does not exist" Sep 09 23:14:22.432297 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.432248 2567 scope.go:117] "RemoveContainer" containerID="58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823" Sep 09 23:14:22.432447 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.432430 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823"} err="failed to get container status \"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823\": rpc error: code = NotFound desc = could not find container \"58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823\": container with ID starting with 58b11f028ac41c3980c9d3d472841cf19e3ec44544be271502fbf2cf0c516823 not found: ID does not exist" Sep 09 23:14:22.432526 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.432448 2567 scope.go:117] "RemoveContainer" containerID="9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758" Sep 09 23:14:22.432707 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.432687 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758"} err="failed to get container status \"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758\": rpc error: code = NotFound desc = could not find container \"9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758\": container with ID starting with 9c997de22206679baa1e02e346bcc195c089a0fba3eda6d4a4eb9f757ae0e758 not found: ID does not exist" Sep 09 23:14:22.432763 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.432708 2567 scope.go:117] "RemoveContainer" containerID="0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44" Sep 09 23:14:22.432925 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.432906 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44"} err="failed to get container status \"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44\": rpc error: code = NotFound desc = could not find container \"0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44\": container with ID starting with 0165707274e489eb9e26971673a2ce0a2b45ec0a8322085811f49967726cfa44 not found: ID does not exist" Sep 09 23:14:22.432965 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.432925 2567 scope.go:117] "RemoveContainer" containerID="d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f" Sep 09 23:14:22.433155 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.433138 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f"} err="failed to get container status \"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f\": rpc error: code = NotFound desc = could not find container \"d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f\": container with ID starting with d33893c02b8c7e6c93974c319fda647bb202608566352fc66e980374d043e20f not found: ID does not exist" Sep 09 23:14:22.433155 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.433154 2567 scope.go:117] "RemoveContainer" containerID="d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276" Sep 09 23:14:22.433338 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.433323 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276"} err="failed to get container status \"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276\": rpc error: code = NotFound desc = could not find container \"d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276\": container with ID starting with d84c96038ab810eab0ebbdcf0b1d7a0b8dae71256c699792d16eedf2c7ac4276 not found: ID does not exist" Sep 09 23:14:22.433338 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.433337 2567 scope.go:117] "RemoveContainer" containerID="f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff" Sep 09 23:14:22.433505 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.433490 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff"} err="failed to get container status \"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff\": rpc error: code = NotFound desc = could not find container \"f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff\": container with ID starting with f38b249074e999a1d611774660cdba2335ddf61fe4476657322d5e1e9ad01eff not found: ID does not exist" Sep 09 23:14:22.433546 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.433505 2567 scope.go:117] "RemoveContainer" containerID="a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516" Sep 09 23:14:22.433727 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.433710 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516"} err="failed to get container status \"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516\": rpc error: code = NotFound desc = could not find container \"a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516\": container with ID starting with a8fb9f9eaa50e11536e0d60a46e0a434d6c1c5a657262d507bd7669c425cb516 not found: ID does not exist" Sep 09 23:14:22.452673 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.452650 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:14:22.452997 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.452981 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="kube-rbac-proxy-thanos" Sep 09 23:14:22.453075 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453000 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="kube-rbac-proxy-thanos" Sep 09 23:14:22.453075 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453013 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f9f2509-b7bb-47cf-b47c-01938fbe8a3d" containerName="registry" Sep 09 23:14:22.453075 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453021 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f9f2509-b7bb-47cf-b47c-01938fbe8a3d" containerName="registry" Sep 09 23:14:22.453075 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453030 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="thanos-sidecar" Sep 09 23:14:22.453075 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453035 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="thanos-sidecar" Sep 09 23:14:22.453075 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453041 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="kube-rbac-proxy" Sep 09 23:14:22.453075 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453046 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="kube-rbac-proxy" Sep 09 23:14:22.453075 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453054 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="config-reloader" Sep 09 23:14:22.453075 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453061 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="config-reloader" Sep 09 23:14:22.453075 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453069 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="kube-rbac-proxy-web" Sep 09 23:14:22.453075 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453077 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="kube-rbac-proxy-web" Sep 09 23:14:22.453421 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453085 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="init-config-reloader" Sep 09 23:14:22.453421 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453090 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="init-config-reloader" Sep 09 23:14:22.453421 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453098 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="prometheus" Sep 09 23:14:22.453421 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453103 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="prometheus" Sep 09 23:14:22.453421 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453162 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="config-reloader" Sep 09 23:14:22.453421 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453170 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="kube-rbac-proxy" Sep 09 23:14:22.453421 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453176 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f9f2509-b7bb-47cf-b47c-01938fbe8a3d" containerName="registry" Sep 09 23:14:22.453421 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453181 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="prometheus" Sep 09 23:14:22.453421 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453186 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="kube-rbac-proxy-web" Sep 09 23:14:22.453421 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453192 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="kube-rbac-proxy-thanos" Sep 09 23:14:22.453421 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.453197 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" containerName="thanos-sidecar" Sep 09 23:14:22.457091 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.457077 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.459383 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.459363 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 09 23:14:22.459560 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.459540 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 09 23:14:22.460259 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.460223 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 09 23:14:22.460542 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.460522 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 09 23:14:22.460634 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.460524 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 09 23:14:22.460943 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.460925 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 09 23:14:22.461134 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.461047 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 09 23:14:22.461134 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.460927 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 23:14:22.461267 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.461166 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 09 23:14:22.461267 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.461186 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c7pnn\"" Sep 09 23:14:22.461267 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.461216 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 09 23:14:22.464692 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.464218 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 09 23:14:22.464692 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.464245 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 09 23:14:22.464692 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.464346 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 09 23:14:22.464692 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.464638 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 09 23:14:22.465062 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.465036 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-am0a6kj7gd8jf\"" Sep 09 23:14:22.466029 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.465978 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 09 23:14:22.485568 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.485544 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:14:22.611350 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611319 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.611350 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611354 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b4906a8-9df5-4af8-babe-1c9ab2301c88-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.611560 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611371 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.611560 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611443 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwjkv\" (UniqueName: \"kubernetes.io/projected/6b4906a8-9df5-4af8-babe-1c9ab2301c88-kube-api-access-wwjkv\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.611560 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611481 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.611560 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611503 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.611560 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611521 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-web-config\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.611560 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611538 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.611829 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611572 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.611829 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611613 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.611829 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611675 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.611829 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611709 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b4906a8-9df5-4af8-babe-1c9ab2301c88-config-out\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.611829 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611749 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-config\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.611829 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611780 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.611829 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611814 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.612043 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611844 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.612043 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611862 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.612043 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611882 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.612043 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611903 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.612043 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.611916 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6b4906a8-9df5-4af8-babe-1c9ab2301c88-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.713223 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713188 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-config\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.713618 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713225 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.713618 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713243 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.713618 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713263 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.713618 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713288 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.713618 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713312 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.713618 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713334 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.713618 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713358 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6b4906a8-9df5-4af8-babe-1c9ab2301c88-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.713618 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713397 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.713618 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713431 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b4906a8-9df5-4af8-babe-1c9ab2301c88-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.713618 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713450 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.713618 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713490 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwjkv\" (UniqueName: \"kubernetes.io/projected/6b4906a8-9df5-4af8-babe-1c9ab2301c88-kube-api-access-wwjkv\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.713618 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713525 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.713618 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713552 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.713618 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713579 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-web-config\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.714302 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713632 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.714302 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713665 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.714302 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713691 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.714302 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713719 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.714302 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.713743 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b4906a8-9df5-4af8-babe-1c9ab2301c88-config-out\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.714302 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.714003 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.714302 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.714117 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.714753 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.714634 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.715520 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.714904 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6b4906a8-9df5-4af8-babe-1c9ab2301c88-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.715520 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.714925 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.716500 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.716299 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b4906a8-9df5-4af8-babe-1c9ab2301c88-config-out\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.716500 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.716482 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.716500 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.716489 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.716738 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.716580 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-config\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.717242 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.716851 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.717242 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.717189 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.717242 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.717207 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.717242 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.717212 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.718220 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.718192 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.718888 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.718859 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6b4906a8-9df5-4af8-babe-1c9ab2301c88-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.718888 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.718884 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-web-config\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.719062 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.719046 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b4906a8-9df5-4af8-babe-1c9ab2301c88-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.719234 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.719214 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.719730 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.719714 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b4906a8-9df5-4af8-babe-1c9ab2301c88-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.750174 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.750145 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwjkv\" (UniqueName: \"kubernetes.io/projected/6b4906a8-9df5-4af8-babe-1c9ab2301c88-kube-api-access-wwjkv\") pod \"prometheus-k8s-0\" (UID: \"6b4906a8-9df5-4af8-babe-1c9ab2301c88\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:22.767022 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:22.766992 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:23.050065 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:23.050040 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:14:23.051812 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:14:23.051787 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4906a8_9df5_4af8_babe_1c9ab2301c88.slice/crio-218035fd0469c918228a2dee11d3c4acea5f1c3f37c7b110ec3b8ff578a4f919 WatchSource:0}: Error finding container 218035fd0469c918228a2dee11d3c4acea5f1c3f37c7b110ec3b8ff578a4f919: Status 404 returned error can't find the container with id 218035fd0469c918228a2dee11d3c4acea5f1c3f37c7b110ec3b8ff578a4f919 Sep 09 23:14:23.376458 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:23.376363 2567 generic.go:356] "Generic (PLEG): container finished" podID="6b4906a8-9df5-4af8-babe-1c9ab2301c88" containerID="7e56b11df09d0b23d4e72faedfe6eb16d992b2b5f0650465631213a610b4bd11" exitCode=0 Sep 09 23:14:23.376642 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:23.376446 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b4906a8-9df5-4af8-babe-1c9ab2301c88","Type":"ContainerDied","Data":"7e56b11df09d0b23d4e72faedfe6eb16d992b2b5f0650465631213a610b4bd11"} Sep 09 23:14:23.376642 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:23.376521 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b4906a8-9df5-4af8-babe-1c9ab2301c88","Type":"ContainerStarted","Data":"218035fd0469c918228a2dee11d3c4acea5f1c3f37c7b110ec3b8ff578a4f919"} Sep 09 23:14:24.193601 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:24.193552 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a943b6db-ec52-4599-a7ab-2bf8d484f2b0" path="/var/lib/kubelet/pods/a943b6db-ec52-4599-a7ab-2bf8d484f2b0/volumes" Sep 09 23:14:24.385258 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:24.385222 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b4906a8-9df5-4af8-babe-1c9ab2301c88","Type":"ContainerStarted","Data":"2c5b3f5034ec3747d393bca7b3a66bc1a5f25c84517fbc92d3063922f201fcea"} Sep 09 23:14:24.385410 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:24.385288 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b4906a8-9df5-4af8-babe-1c9ab2301c88","Type":"ContainerStarted","Data":"15110d36af887bef44b4664d0c317684a27003f7af4eb16c5879f4ed2071c4c7"} Sep 09 23:14:24.385410 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:24.385316 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b4906a8-9df5-4af8-babe-1c9ab2301c88","Type":"ContainerStarted","Data":"9f10596ac4fd150b6c35fe37a9eda831f5a8df3141a3449cb51e09589a852553"} Sep 09 23:14:24.385410 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:24.385361 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b4906a8-9df5-4af8-babe-1c9ab2301c88","Type":"ContainerStarted","Data":"9650e9ea52598bf53d6e343ba634982f94e235b6697bfa37a4b616e7332165c2"} Sep 09 23:14:24.385410 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:24.385385 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b4906a8-9df5-4af8-babe-1c9ab2301c88","Type":"ContainerStarted","Data":"3072ac508edc984b006ffad6fd6e3d5e961479b9f3ee3d5b6c0ef8c60633bb54"} Sep 09 23:14:24.385410 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:24.385407 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b4906a8-9df5-4af8-babe-1c9ab2301c88","Type":"ContainerStarted","Data":"a942e6b3b69e508ce588917c41f559749f33ab72f37f1fa0c6e4e7c69ad59764"} Sep 09 23:14:24.417106 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:24.417055 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.397866188 podStartE2EDuration="2.417038614s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.172426ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:14:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:14:24.415437526 +0000 UTC m=+366.715445044" watchObservedRunningTime="2026-09-09 23:14:24.417038614 +0000 UTC m=+366.717046131" Sep 09 23:14:24.799402 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:24.799370 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:14:24.897424 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:24.897382 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:14:25.049295 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:25.049262 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:14:25.109698 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:25.109623 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:14:26.683265 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:26.683232 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:14:26.783509 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:26.783478 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:14:27.767508 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:27.767465 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:14:31.893680 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:31.893645 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs\") pod \"network-metrics-daemon-gmk7t\" (UID: \"2e433ce1-5876-44c1-bafd-cf7237901a04\") " pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:14:31.895885 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:31.895863 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e433ce1-5876-44c1-bafd-cf7237901a04-metrics-certs\") pod \"network-metrics-daemon-gmk7t\" (UID: \"2e433ce1-5876-44c1-bafd-cf7237901a04\") " pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:14:32.092902 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:32.092873 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hgrbx\"" Sep 09 23:14:32.101598 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:32.101575 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gmk7t" Sep 09 23:14:32.369488 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:32.369428 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gmk7t"] Sep 09 23:14:32.371747 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:14:32.371718 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e433ce1_5876_44c1_bafd_cf7237901a04.slice/crio-23db185055144bbea55ccc7054d7f1299aab286bd299049de665143343cd198e WatchSource:0}: Error finding container 23db185055144bbea55ccc7054d7f1299aab286bd299049de665143343cd198e: Status 404 returned error can't find the container with id 23db185055144bbea55ccc7054d7f1299aab286bd299049de665143343cd198e Sep 09 23:14:32.373639 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:32.373620 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:14:32.420086 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:32.420013 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gmk7t" event={"ID":"2e433ce1-5876-44c1-bafd-cf7237901a04","Type":"ContainerStarted","Data":"23db185055144bbea55ccc7054d7f1299aab286bd299049de665143343cd198e"} Sep 09 23:14:33.426243 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:33.426208 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gmk7t" event={"ID":"2e433ce1-5876-44c1-bafd-cf7237901a04","Type":"ContainerStarted","Data":"1f50c176b6a9508749116c9c0c18e76e978f1f201b97d5ba8f4158a87088da89"} Sep 09 23:14:34.431497 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:34.431457 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gmk7t" event={"ID":"2e433ce1-5876-44c1-bafd-cf7237901a04","Type":"ContainerStarted","Data":"f24c85de5ad8c2508f56368b69e8024b6897a6ae4e7b1c779da913168f9c8a77"} Sep 09 23:14:34.447682 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:34.447634 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gmk7t" podStartSLOduration=375.501394528 podStartE2EDuration="6m16.447619161s" totalImagesPullingTime="946.224633ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:14:34.446523772 +0000 UTC m=+376.746531291" watchObservedRunningTime="2026-09-09 23:14:34.447619161 +0000 UTC m=+376.747626672" Sep 09 23:14:34.535230 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:34.535198 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:14:34.591359 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:34.591292 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:14:35.767252 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:35.767219 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:14:35.867799 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:35.867764 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:14:35.926936 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:14:35.926902 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:15:22.767575 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:15:22.767539 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:15:22.782871 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:15:22.782847 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:15:23.632831 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:15:23.632804 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:15:31.523461 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:15:31.523408 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:15:31.606334 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:15:31.606300 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:15:43.523559 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:15:43.523463 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:15:43.594111 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:15:43.594076 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:15:57.220157 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:15:57.220122 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:15:57.321835 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:15:57.321799 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:15:57.566042 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:15:57.566010 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:16:09.020221 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:16:09.020175 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:16:09.084504 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:16:09.084460 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:16:09.326232 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:16:09.326153 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:16:09.383509 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:16:09.383474 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:16:10.123351 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:16:10.123275 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:16:10.187706 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:16:10.187674 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:16:20.204633 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:16:20.204540 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:16:20.256682 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:16:20.256626 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:16:20.311449 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:16:20.311416 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:16:38.585413 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:16:38.585375 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:16:38.679531 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:16:38.679490 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:00.311943 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:00.311908 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:01.226072 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:01.226033 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:03.875558 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:03.875517 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:03.981920 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:03.981882 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:06.147304 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:06.147270 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:06.242825 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:06.242791 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:06.558574 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:06.558542 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wbcjl"] Sep 09 23:17:06.561830 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:06.561804 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wbcjl" Sep 09 23:17:06.566247 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:06.566225 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-n26cb\"" Sep 09 23:17:06.566247 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:06.566227 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 09 23:17:06.566727 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:06.566711 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 09 23:17:06.575564 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:06.575539 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wbcjl"] Sep 09 23:17:06.613245 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:06.613207 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb9bf49c-c09c-4af0-b16b-26ea4f23f9b3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wbcjl\" (UID: \"fb9bf49c-c09c-4af0-b16b-26ea4f23f9b3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wbcjl" Sep 09 23:17:06.613401 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:06.613259 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x95tk\" (UniqueName: \"kubernetes.io/projected/fb9bf49c-c09c-4af0-b16b-26ea4f23f9b3-kube-api-access-x95tk\") pod \"cert-manager-webhook-6486ffd997-wbcjl\" (UID: \"fb9bf49c-c09c-4af0-b16b-26ea4f23f9b3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wbcjl" Sep 09 23:17:06.643517 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:06.643485 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:06.714328 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:06.714295 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x95tk\" (UniqueName: \"kubernetes.io/projected/fb9bf49c-c09c-4af0-b16b-26ea4f23f9b3-kube-api-access-x95tk\") pod \"cert-manager-webhook-6486ffd997-wbcjl\" (UID: \"fb9bf49c-c09c-4af0-b16b-26ea4f23f9b3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wbcjl" Sep 09 23:17:06.714490 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:06.714448 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb9bf49c-c09c-4af0-b16b-26ea4f23f9b3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wbcjl\" (UID: \"fb9bf49c-c09c-4af0-b16b-26ea4f23f9b3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wbcjl" Sep 09 23:17:06.727012 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:06.726983 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb9bf49c-c09c-4af0-b16b-26ea4f23f9b3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wbcjl\" (UID: \"fb9bf49c-c09c-4af0-b16b-26ea4f23f9b3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wbcjl" Sep 09 23:17:06.738520 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:06.738487 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x95tk\" (UniqueName: \"kubernetes.io/projected/fb9bf49c-c09c-4af0-b16b-26ea4f23f9b3-kube-api-access-x95tk\") pod \"cert-manager-webhook-6486ffd997-wbcjl\" (UID: \"fb9bf49c-c09c-4af0-b16b-26ea4f23f9b3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wbcjl" Sep 09 23:17:06.782128 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:06.782089 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:06.880609 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:06.880521 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wbcjl" Sep 09 23:17:07.154158 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:07.154131 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wbcjl"] Sep 09 23:17:07.156210 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:17:07.156179 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb9bf49c_c09c_4af0_b16b_26ea4f23f9b3.slice/crio-568b5540dc5d4bb125bc072c6880d3312d319c981699698a82908df6e545b777 WatchSource:0}: Error finding container 568b5540dc5d4bb125bc072c6880d3312d319c981699698a82908df6e545b777: Status 404 returned error can't find the container with id 568b5540dc5d4bb125bc072c6880d3312d319c981699698a82908df6e545b777 Sep 09 23:17:08.005668 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:08.005627 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wbcjl" event={"ID":"fb9bf49c-c09c-4af0-b16b-26ea4f23f9b3","Type":"ContainerStarted","Data":"568b5540dc5d4bb125bc072c6880d3312d319c981699698a82908df6e545b777"} Sep 09 23:17:08.164016 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:08.163973 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:08.562128 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:08.562089 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:10.872746 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:10.872709 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:10.973954 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:10.973912 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:11.020652 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:11.020618 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wbcjl" event={"ID":"fb9bf49c-c09c-4af0-b16b-26ea4f23f9b3","Type":"ContainerStarted","Data":"16614b3348f88697998e5de89d8ebe2d940d2ba05ed8bd82a228a910c2abcea6"} Sep 09 23:17:11.020812 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:11.020740 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wbcjl" Sep 09 23:17:11.036040 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:11.035995 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-wbcjl" podStartSLOduration=1.8712578149999999 podStartE2EDuration="5.035979038s" totalImagesPullingTime="3.164721223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:11.034756508 +0000 UTC m=+533.334764026" watchObservedRunningTime="2026-09-09 23:17:11.035979038 +0000 UTC m=+533.335986565" Sep 09 23:17:13.468066 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:13.468024 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:13.534024 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:13.533994 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:15.081061 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:15.081026 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:15.179464 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:15.179434 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:17.027913 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:17.027877 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wbcjl" Sep 09 23:17:17.381483 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:17.381395 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:18.674427 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:18.674391 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fhd5x"] Sep 09 23:17:18.677700 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:18.677677 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fhd5x" Sep 09 23:17:18.679515 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:18.679497 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-v46zl\"" Sep 09 23:17:18.687112 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:18.687090 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fhd5x"] Sep 09 23:17:18.709880 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:18.709852 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x42t\" (UniqueName: \"kubernetes.io/projected/5f57a2d7-0b7c-4b8d-91aa-3555d4a3ef6d-kube-api-access-5x42t\") pod \"cert-manager-55b4d954d5-fhd5x\" (UID: \"5f57a2d7-0b7c-4b8d-91aa-3555d4a3ef6d\") " pod="cert-manager/cert-manager-55b4d954d5-fhd5x" Sep 09 23:17:18.709979 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:18.709915 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f57a2d7-0b7c-4b8d-91aa-3555d4a3ef6d-bound-sa-token\") pod \"cert-manager-55b4d954d5-fhd5x\" (UID: \"5f57a2d7-0b7c-4b8d-91aa-3555d4a3ef6d\") " pod="cert-manager/cert-manager-55b4d954d5-fhd5x" Sep 09 23:17:18.810795 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:18.810761 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f57a2d7-0b7c-4b8d-91aa-3555d4a3ef6d-bound-sa-token\") pod \"cert-manager-55b4d954d5-fhd5x\" (UID: \"5f57a2d7-0b7c-4b8d-91aa-3555d4a3ef6d\") " pod="cert-manager/cert-manager-55b4d954d5-fhd5x" Sep 09 23:17:18.810922 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:18.810829 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x42t\" (UniqueName: \"kubernetes.io/projected/5f57a2d7-0b7c-4b8d-91aa-3555d4a3ef6d-kube-api-access-5x42t\") pod \"cert-manager-55b4d954d5-fhd5x\" (UID: \"5f57a2d7-0b7c-4b8d-91aa-3555d4a3ef6d\") " pod="cert-manager/cert-manager-55b4d954d5-fhd5x" Sep 09 23:17:18.818315 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:18.818287 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f57a2d7-0b7c-4b8d-91aa-3555d4a3ef6d-bound-sa-token\") pod \"cert-manager-55b4d954d5-fhd5x\" (UID: \"5f57a2d7-0b7c-4b8d-91aa-3555d4a3ef6d\") " pod="cert-manager/cert-manager-55b4d954d5-fhd5x" Sep 09 23:17:18.818415 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:18.818345 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x42t\" (UniqueName: \"kubernetes.io/projected/5f57a2d7-0b7c-4b8d-91aa-3555d4a3ef6d-kube-api-access-5x42t\") pod \"cert-manager-55b4d954d5-fhd5x\" (UID: \"5f57a2d7-0b7c-4b8d-91aa-3555d4a3ef6d\") " pod="cert-manager/cert-manager-55b4d954d5-fhd5x" Sep 09 23:17:18.986863 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:18.986838 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fhd5x" Sep 09 23:17:19.258265 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:19.258182 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fhd5x"] Sep 09 23:17:19.264060 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:17:19.264026 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f57a2d7_0b7c_4b8d_91aa_3555d4a3ef6d.slice/crio-c0676f55b96a2375d1d4a484018907894d155f6b39b2315579e7833da0a4bbc4 WatchSource:0}: Error finding container c0676f55b96a2375d1d4a484018907894d155f6b39b2315579e7833da0a4bbc4: Status 404 returned error can't find the container with id c0676f55b96a2375d1d4a484018907894d155f6b39b2315579e7833da0a4bbc4 Sep 09 23:17:20.058426 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:20.058389 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fhd5x" event={"ID":"5f57a2d7-0b7c-4b8d-91aa-3555d4a3ef6d","Type":"ContainerStarted","Data":"448c51d143143519b2f75dcab514e9ad9b9df1b14897cd62ed2fee5bc842c6bb"} Sep 09 23:17:20.058426 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:20.058432 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fhd5x" event={"ID":"5f57a2d7-0b7c-4b8d-91aa-3555d4a3ef6d","Type":"ContainerStarted","Data":"c0676f55b96a2375d1d4a484018907894d155f6b39b2315579e7833da0a4bbc4"} Sep 09 23:17:20.076830 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:20.076778 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-fhd5x" podStartSLOduration=2.076763135 podStartE2EDuration="2.076763135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:20.075684641 +0000 UTC m=+542.375692158" watchObservedRunningTime="2026-09-09 23:17:20.076763135 +0000 UTC m=+542.376770653" Sep 09 23:17:21.044149 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:21.044117 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:21.144344 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:21.144298 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:23.261148 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:23.261111 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:37.224228 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:37.224178 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:37.325359 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:37.325322 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:37.785427 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:37.785389 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:38.171770 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.171690 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:38.271434 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.271391 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:38.348937 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.348902 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd"] Sep 09 23:17:38.352654 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.352636 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:38.357103 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.357083 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 09 23:17:38.357844 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.357820 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 09 23:17:38.358059 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.358042 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 09 23:17:38.358132 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.358084 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n2m42\"" Sep 09 23:17:38.358182 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.358085 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 09 23:17:38.376483 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.376452 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd"] Sep 09 23:17:38.467266 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.467180 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:38.473210 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.473187 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b8903f2-8401-46e4-bfb0-de3a5c8d14f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fd95c47c-g8hsd\" (UID: \"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:38.473278 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.473234 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdrrv\" (UniqueName: \"kubernetes.io/projected/3b8903f2-8401-46e4-bfb0-de3a5c8d14f5-kube-api-access-kdrrv\") pod \"opendatahub-operator-controller-manager-68fd95c47c-g8hsd\" (UID: \"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:38.473278 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.473267 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b8903f2-8401-46e4-bfb0-de3a5c8d14f5-manifests\") pod \"opendatahub-operator-controller-manager-68fd95c47c-g8hsd\" (UID: \"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:38.473349 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.473297 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b8903f2-8401-46e4-bfb0-de3a5c8d14f5-tmp\") pod \"opendatahub-operator-controller-manager-68fd95c47c-g8hsd\" (UID: \"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:38.473349 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.473321 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b8903f2-8401-46e4-bfb0-de3a5c8d14f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fd95c47c-g8hsd\" (UID: \"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:38.532002 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.531959 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:38.574099 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.574064 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b8903f2-8401-46e4-bfb0-de3a5c8d14f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fd95c47c-g8hsd\" (UID: \"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:38.574254 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.574135 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b8903f2-8401-46e4-bfb0-de3a5c8d14f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fd95c47c-g8hsd\" (UID: \"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:38.574254 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.574187 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdrrv\" (UniqueName: \"kubernetes.io/projected/3b8903f2-8401-46e4-bfb0-de3a5c8d14f5-kube-api-access-kdrrv\") pod \"opendatahub-operator-controller-manager-68fd95c47c-g8hsd\" (UID: \"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:38.574254 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.574220 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b8903f2-8401-46e4-bfb0-de3a5c8d14f5-manifests\") pod \"opendatahub-operator-controller-manager-68fd95c47c-g8hsd\" (UID: \"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:38.574413 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.574259 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b8903f2-8401-46e4-bfb0-de3a5c8d14f5-tmp\") pod \"opendatahub-operator-controller-manager-68fd95c47c-g8hsd\" (UID: \"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:38.574664 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.574630 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b8903f2-8401-46e4-bfb0-de3a5c8d14f5-manifests\") pod \"opendatahub-operator-controller-manager-68fd95c47c-g8hsd\" (UID: \"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:38.576411 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.576387 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b8903f2-8401-46e4-bfb0-de3a5c8d14f5-tmp\") pod \"opendatahub-operator-controller-manager-68fd95c47c-g8hsd\" (UID: \"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:38.576528 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.576509 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b8903f2-8401-46e4-bfb0-de3a5c8d14f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fd95c47c-g8hsd\" (UID: \"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:38.576578 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.576513 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b8903f2-8401-46e4-bfb0-de3a5c8d14f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fd95c47c-g8hsd\" (UID: \"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:38.585691 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.585667 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdrrv\" (UniqueName: \"kubernetes.io/projected/3b8903f2-8401-46e4-bfb0-de3a5c8d14f5-kube-api-access-kdrrv\") pod \"opendatahub-operator-controller-manager-68fd95c47c-g8hsd\" (UID: \"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:38.638737 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.638716 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:38.667745 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.667723 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:38.732730 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.732699 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:38.837437 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.837404 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:38.903860 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.903822 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:38.941744 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.941721 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd"] Sep 09 23:17:38.944354 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:17:38.944329 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b8903f2_8401_46e4_bfb0_de3a5c8d14f5.slice/crio-9ff52728316a44329077a80e4c963c0f193c9448b89d38a52596eac85c3db196 WatchSource:0}: Error finding container 9ff52728316a44329077a80e4c963c0f193c9448b89d38a52596eac85c3db196: Status 404 returned error can't find the container with id 9ff52728316a44329077a80e4c963c0f193c9448b89d38a52596eac85c3db196 Sep 09 23:17:38.959921 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:38.959894 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:39.064730 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:39.064650 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:39.132824 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:39.132791 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" event={"ID":"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5","Type":"ContainerStarted","Data":"9ff52728316a44329077a80e4c963c0f193c9448b89d38a52596eac85c3db196"} Sep 09 23:17:42.148897 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:42.148815 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" event={"ID":"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5","Type":"ContainerStarted","Data":"1232a99f6f9cfd98d28aca344092cb0e147f8d1ada3c6c5ccf86b07be9dc5ce5"} Sep 09 23:17:42.465258 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:42.465177 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:43.154847 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:43.154767 2567 generic.go:356] "Generic (PLEG): container finished" podID="3b8903f2-8401-46e4-bfb0-de3a5c8d14f5" containerID="1232a99f6f9cfd98d28aca344092cb0e147f8d1ada3c6c5ccf86b07be9dc5ce5" exitCode=0 Sep 09 23:17:43.154847 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:43.154836 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" event={"ID":"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5","Type":"ContainerDied","Data":"1232a99f6f9cfd98d28aca344092cb0e147f8d1ada3c6c5ccf86b07be9dc5ce5"} Sep 09 23:17:44.162231 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:44.162191 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" event={"ID":"3b8903f2-8401-46e4-bfb0-de3a5c8d14f5","Type":"ContainerStarted","Data":"4407d5abb3884653dd78cc597b8da72697af051332d35d02037ecdaff02a2535"} Sep 09 23:17:44.162874 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:44.162351 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:44.183003 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:44.182946 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" podStartSLOduration=1.775851434 podStartE2EDuration="6.182926202s" totalImagesPullingTime="3.403972101s" totalInitContainerRuntime="1.003102667s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:44.180432248 +0000 UTC m=+566.480439767" watchObservedRunningTime="2026-09-09 23:17:44.182926202 +0000 UTC m=+566.482933722" Sep 09 23:17:45.497322 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:45.497286 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:45.561441 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:45.561408 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:47.899572 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:47.899531 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:53.611884 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:53.611842 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:55.169381 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:55.169350 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-g8hsd" Sep 09 23:17:57.197094 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:57.197060 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:57.338866 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:57.338828 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:57.542792 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:57.542738 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:58.200707 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:58.200676 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:59.004163 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:59.004121 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:59.070308 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:59.070274 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:59.989651 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:17:59.989613 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:04.150483 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:04.150450 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:04.247822 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:04.247789 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:04.798478 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:04.798437 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:04.994577 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:04.994539 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:05.369090 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:05.369060 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:08.226816 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:08.226773 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:08.326346 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:08.326310 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:08.426079 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:08.426033 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:08.755405 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:08.755354 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:08.849856 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:08.849807 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:08.953739 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:08.953702 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:12.863003 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:12.862955 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:15.566680 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.566648 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp"] Sep 09 23:18:15.574584 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.574557 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" Sep 09 23:18:15.578038 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.577882 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 09 23:18:15.578337 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.578308 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 09 23:18:15.578455 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.578332 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 09 23:18:15.578545 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.578523 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:18:15.578677 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.578581 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4dpxv\"" Sep 09 23:18:15.579411 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.579389 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 09 23:18:15.632616 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.632575 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp"] Sep 09 23:18:15.677845 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.677820 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc117c48-8cc2-4e58-8a92-f14e703a271b-cert\") pod \"lws-controller-manager-66c6d9b8f-slhdp\" (UID: \"bc117c48-8cc2-4e58-8a92-f14e703a271b\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" Sep 09 23:18:15.677990 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.677857 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bc117c48-8cc2-4e58-8a92-f14e703a271b-manager-config\") pod \"lws-controller-manager-66c6d9b8f-slhdp\" (UID: \"bc117c48-8cc2-4e58-8a92-f14e703a271b\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" Sep 09 23:18:15.677990 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.677930 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc117c48-8cc2-4e58-8a92-f14e703a271b-metrics-cert\") pod \"lws-controller-manager-66c6d9b8f-slhdp\" (UID: \"bc117c48-8cc2-4e58-8a92-f14e703a271b\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" Sep 09 23:18:15.677990 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.677960 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k25sf\" (UniqueName: \"kubernetes.io/projected/bc117c48-8cc2-4e58-8a92-f14e703a271b-kube-api-access-k25sf\") pod \"lws-controller-manager-66c6d9b8f-slhdp\" (UID: \"bc117c48-8cc2-4e58-8a92-f14e703a271b\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" Sep 09 23:18:15.779074 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.779043 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k25sf\" (UniqueName: \"kubernetes.io/projected/bc117c48-8cc2-4e58-8a92-f14e703a271b-kube-api-access-k25sf\") pod \"lws-controller-manager-66c6d9b8f-slhdp\" (UID: \"bc117c48-8cc2-4e58-8a92-f14e703a271b\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" Sep 09 23:18:15.779214 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.779078 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc117c48-8cc2-4e58-8a92-f14e703a271b-cert\") pod \"lws-controller-manager-66c6d9b8f-slhdp\" (UID: \"bc117c48-8cc2-4e58-8a92-f14e703a271b\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" Sep 09 23:18:15.779214 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.779104 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bc117c48-8cc2-4e58-8a92-f14e703a271b-manager-config\") pod \"lws-controller-manager-66c6d9b8f-slhdp\" (UID: \"bc117c48-8cc2-4e58-8a92-f14e703a271b\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" Sep 09 23:18:15.779214 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.779150 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc117c48-8cc2-4e58-8a92-f14e703a271b-metrics-cert\") pod \"lws-controller-manager-66c6d9b8f-slhdp\" (UID: \"bc117c48-8cc2-4e58-8a92-f14e703a271b\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" Sep 09 23:18:15.779824 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.779801 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bc117c48-8cc2-4e58-8a92-f14e703a271b-manager-config\") pod \"lws-controller-manager-66c6d9b8f-slhdp\" (UID: \"bc117c48-8cc2-4e58-8a92-f14e703a271b\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" Sep 09 23:18:15.781546 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.781523 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc117c48-8cc2-4e58-8a92-f14e703a271b-cert\") pod \"lws-controller-manager-66c6d9b8f-slhdp\" (UID: \"bc117c48-8cc2-4e58-8a92-f14e703a271b\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" Sep 09 23:18:15.781663 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.781559 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc117c48-8cc2-4e58-8a92-f14e703a271b-metrics-cert\") pod \"lws-controller-manager-66c6d9b8f-slhdp\" (UID: \"bc117c48-8cc2-4e58-8a92-f14e703a271b\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" Sep 09 23:18:15.787846 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.787821 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k25sf\" (UniqueName: \"kubernetes.io/projected/bc117c48-8cc2-4e58-8a92-f14e703a271b-kube-api-access-k25sf\") pod \"lws-controller-manager-66c6d9b8f-slhdp\" (UID: \"bc117c48-8cc2-4e58-8a92-f14e703a271b\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" Sep 09 23:18:15.800342 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.800316 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:15.886514 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.886459 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" Sep 09 23:18:15.900328 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:15.900309 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:16.229088 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:16.229058 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp"] Sep 09 23:18:16.242563 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:18:16.242533 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc117c48_8cc2_4e58_8a92_f14e703a271b.slice/crio-ce534ce1b73340e54718fa47097eb41e0e5b2cc71e0b19c0502465a5fcd5fd6f WatchSource:0}: Error finding container ce534ce1b73340e54718fa47097eb41e0e5b2cc71e0b19c0502465a5fcd5fd6f: Status 404 returned error can't find the container with id ce534ce1b73340e54718fa47097eb41e0e5b2cc71e0b19c0502465a5fcd5fd6f Sep 09 23:18:16.303864 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:16.303830 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" event={"ID":"bc117c48-8cc2-4e58-8a92-f14e703a271b","Type":"ContainerStarted","Data":"ce534ce1b73340e54718fa47097eb41e0e5b2cc71e0b19c0502465a5fcd5fd6f"} Sep 09 23:18:18.015183 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.015139 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:18.070858 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.070825 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9b48k"] Sep 09 23:18:18.079015 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.078033 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b48k" Sep 09 23:18:18.082288 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.082105 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dfnqd\"" Sep 09 23:18:18.082288 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.082249 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 09 23:18:18.087688 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.087642 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9b48k"] Sep 09 23:18:18.099279 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.095340 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kqsqj"] Sep 09 23:18:18.102239 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.100965 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqsqj" Sep 09 23:18:18.103896 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.103875 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 09 23:18:18.105763 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.105285 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-72jc4\"" Sep 09 23:18:18.126704 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.124192 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kqsqj"] Sep 09 23:18:18.128373 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.128235 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:18.201987 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.201947 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/158a1ed6-f6be-48ab-9ffe-3399a96fe8e5-cert\") pod \"kserve-controller-manager-d6f4b65b8-9b48k\" (UID: \"158a1ed6-f6be-48ab-9ffe-3399a96fe8e5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b48k" Sep 09 23:18:18.202159 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.202002 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdfpz\" (UniqueName: \"kubernetes.io/projected/158a1ed6-f6be-48ab-9ffe-3399a96fe8e5-kube-api-access-wdfpz\") pod \"kserve-controller-manager-d6f4b65b8-9b48k\" (UID: \"158a1ed6-f6be-48ab-9ffe-3399a96fe8e5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b48k" Sep 09 23:18:18.202159 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.202050 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dbd9432-d2b6-4e59-9eb7-08fa149b0c36-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kqsqj\" (UID: \"1dbd9432-d2b6-4e59-9eb7-08fa149b0c36\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqsqj" Sep 09 23:18:18.202159 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.202099 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b8gj\" (UniqueName: \"kubernetes.io/projected/1dbd9432-d2b6-4e59-9eb7-08fa149b0c36-kube-api-access-6b8gj\") pod \"llmisvc-controller-manager-777c6bd7d5-kqsqj\" (UID: \"1dbd9432-d2b6-4e59-9eb7-08fa149b0c36\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqsqj" Sep 09 23:18:18.303324 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.303246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b8gj\" (UniqueName: \"kubernetes.io/projected/1dbd9432-d2b6-4e59-9eb7-08fa149b0c36-kube-api-access-6b8gj\") pod \"llmisvc-controller-manager-777c6bd7d5-kqsqj\" (UID: \"1dbd9432-d2b6-4e59-9eb7-08fa149b0c36\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqsqj" Sep 09 23:18:18.303324 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.303321 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/158a1ed6-f6be-48ab-9ffe-3399a96fe8e5-cert\") pod \"kserve-controller-manager-d6f4b65b8-9b48k\" (UID: \"158a1ed6-f6be-48ab-9ffe-3399a96fe8e5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b48k" Sep 09 23:18:18.303537 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.303344 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdfpz\" (UniqueName: \"kubernetes.io/projected/158a1ed6-f6be-48ab-9ffe-3399a96fe8e5-kube-api-access-wdfpz\") pod \"kserve-controller-manager-d6f4b65b8-9b48k\" (UID: \"158a1ed6-f6be-48ab-9ffe-3399a96fe8e5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b48k" Sep 09 23:18:18.303537 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.303409 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dbd9432-d2b6-4e59-9eb7-08fa149b0c36-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kqsqj\" (UID: \"1dbd9432-d2b6-4e59-9eb7-08fa149b0c36\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqsqj" Sep 09 23:18:18.303774 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:18:18.303745 2567 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Sep 09 23:18:18.303845 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:18:18.303809 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbd9432-d2b6-4e59-9eb7-08fa149b0c36-cert podName:1dbd9432-d2b6-4e59-9eb7-08fa149b0c36 nodeName:}" failed. No retries permitted until 2026-09-09 23:18:18.803789999 +0000 UTC m=+601.103797502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1dbd9432-d2b6-4e59-9eb7-08fa149b0c36-cert") pod "llmisvc-controller-manager-777c6bd7d5-kqsqj" (UID: "1dbd9432-d2b6-4e59-9eb7-08fa149b0c36") : secret "llmisvc-webhook-server-cert" not found Sep 09 23:18:18.304009 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:18:18.303986 2567 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Sep 09 23:18:18.304120 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:18:18.304071 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/158a1ed6-f6be-48ab-9ffe-3399a96fe8e5-cert podName:158a1ed6-f6be-48ab-9ffe-3399a96fe8e5 nodeName:}" failed. No retries permitted until 2026-09-09 23:18:18.804054017 +0000 UTC m=+601.104061515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/158a1ed6-f6be-48ab-9ffe-3399a96fe8e5-cert") pod "kserve-controller-manager-d6f4b65b8-9b48k" (UID: "158a1ed6-f6be-48ab-9ffe-3399a96fe8e5") : secret "kserve-webhook-server-cert" not found Sep 09 23:18:18.330726 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.326510 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b8gj\" (UniqueName: \"kubernetes.io/projected/1dbd9432-d2b6-4e59-9eb7-08fa149b0c36-kube-api-access-6b8gj\") pod \"llmisvc-controller-manager-777c6bd7d5-kqsqj\" (UID: \"1dbd9432-d2b6-4e59-9eb7-08fa149b0c36\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqsqj" Sep 09 23:18:18.332613 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.332559 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdfpz\" (UniqueName: \"kubernetes.io/projected/158a1ed6-f6be-48ab-9ffe-3399a96fe8e5-kube-api-access-wdfpz\") pod \"kserve-controller-manager-d6f4b65b8-9b48k\" (UID: \"158a1ed6-f6be-48ab-9ffe-3399a96fe8e5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b48k" Sep 09 23:18:18.439908 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.439860 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:18.785702 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.785657 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:18.807563 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.807530 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/158a1ed6-f6be-48ab-9ffe-3399a96fe8e5-cert\") pod \"kserve-controller-manager-d6f4b65b8-9b48k\" (UID: \"158a1ed6-f6be-48ab-9ffe-3399a96fe8e5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b48k" Sep 09 23:18:18.807740 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.807610 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dbd9432-d2b6-4e59-9eb7-08fa149b0c36-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kqsqj\" (UID: \"1dbd9432-d2b6-4e59-9eb7-08fa149b0c36\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqsqj" Sep 09 23:18:18.810402 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.810369 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1dbd9432-d2b6-4e59-9eb7-08fa149b0c36-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kqsqj\" (UID: \"1dbd9432-d2b6-4e59-9eb7-08fa149b0c36\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqsqj" Sep 09 23:18:18.810525 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.810503 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/158a1ed6-f6be-48ab-9ffe-3399a96fe8e5-cert\") pod \"kserve-controller-manager-d6f4b65b8-9b48k\" (UID: \"158a1ed6-f6be-48ab-9ffe-3399a96fe8e5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b48k" Sep 09 23:18:18.970261 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.970233 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ssjfn_2bcce2b0-0bd1-493e-b472-53b50f753f72/console-operator/2.log" Sep 09 23:18:18.970651 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:18.970627 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ssjfn_2bcce2b0-0bd1-493e-b472-53b50f753f72/console-operator/2.log" Sep 09 23:18:19.001230 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:19.001205 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b48k" Sep 09 23:18:19.026317 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:19.026293 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqsqj" Sep 09 23:18:19.286712 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:19.286685 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9b48k"] Sep 09 23:18:19.290161 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:18:19.290133 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158a1ed6_f6be_48ab_9ffe_3399a96fe8e5.slice/crio-69aeee90d22d54fcdca6d29e9d5e2df6595ccd4394e7d6e1520279bc51231322 WatchSource:0}: Error finding container 69aeee90d22d54fcdca6d29e9d5e2df6595ccd4394e7d6e1520279bc51231322: Status 404 returned error can't find the container with id 69aeee90d22d54fcdca6d29e9d5e2df6595ccd4394e7d6e1520279bc51231322 Sep 09 23:18:19.313478 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:19.313350 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:19.315087 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:19.315069 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kqsqj"] Sep 09 23:18:19.315823 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:18:19.315797 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1dbd9432_d2b6_4e59_9eb7_08fa149b0c36.slice/crio-b2dfe7a7044e9a1291b8f87ca555ab26f767b8468100115dd6e7357a540f03a4 WatchSource:0}: Error finding container b2dfe7a7044e9a1291b8f87ca555ab26f767b8468100115dd6e7357a540f03a4: Status 404 returned error can't find the container with id b2dfe7a7044e9a1291b8f87ca555ab26f767b8468100115dd6e7357a540f03a4 Sep 09 23:18:19.327815 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:19.327784 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b48k" event={"ID":"158a1ed6-f6be-48ab-9ffe-3399a96fe8e5","Type":"ContainerStarted","Data":"69aeee90d22d54fcdca6d29e9d5e2df6595ccd4394e7d6e1520279bc51231322"} Sep 09 23:18:19.329387 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:19.329361 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" event={"ID":"bc117c48-8cc2-4e58-8a92-f14e703a271b","Type":"ContainerStarted","Data":"9db45524478a4c7d091e447d15a176f579ed5e95d4cd011b1df51def43f4c472"} Sep 09 23:18:19.329512 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:19.329495 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" Sep 09 23:18:19.330716 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:19.330696 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqsqj" event={"ID":"1dbd9432-d2b6-4e59-9eb7-08fa149b0c36","Type":"ContainerStarted","Data":"b2dfe7a7044e9a1291b8f87ca555ab26f767b8468100115dd6e7357a540f03a4"} Sep 09 23:18:19.361658 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:19.361612 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" podStartSLOduration=1.608689075 podStartE2EDuration="4.36157756s" totalImagesPullingTime="2.752888485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:19.359522367 +0000 UTC m=+601.659529885" watchObservedRunningTime="2026-09-09 23:18:19.36157756 +0000 UTC m=+601.661585078" Sep 09 23:18:19.458442 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:19.458412 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:19.574367 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:19.574260 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:23.364154 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:23.364107 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqsqj" event={"ID":"1dbd9432-d2b6-4e59-9eb7-08fa149b0c36","Type":"ContainerStarted","Data":"5e6aa89880c2f51a50f0bedeb1e7fe7cde8dbcfe4605fbb18f73eee4159d1e2c"} Sep 09 23:18:23.364650 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:23.364289 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqsqj" Sep 09 23:18:23.365653 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:23.365630 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b48k" event={"ID":"158a1ed6-f6be-48ab-9ffe-3399a96fe8e5","Type":"ContainerStarted","Data":"50b2b8c1cfa7bc0d42644dcae885c083af985c26f0f26f4f5d99c32a43ad6672"} Sep 09 23:18:23.365772 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:23.365680 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b48k" Sep 09 23:18:23.381023 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:23.380864 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqsqj" podStartSLOduration=2.010327839 podStartE2EDuration="5.380848656s" totalImagesPullingTime="3.370520817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:23.380180665 +0000 UTC m=+605.680188183" watchObservedRunningTime="2026-09-09 23:18:23.380848656 +0000 UTC m=+605.680856188" Sep 09 23:18:23.404966 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:23.404924 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b48k" podStartSLOduration=2.010224323 podStartE2EDuration="5.404910855s" totalImagesPullingTime="3.394686532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:23.403583047 +0000 UTC m=+605.703590565" watchObservedRunningTime="2026-09-09 23:18:23.404910855 +0000 UTC m=+605.704918373" Sep 09 23:18:26.871036 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:26.871000 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:26.971443 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:26.971402 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:27.072289 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:27.072247 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:30.348222 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:30.348189 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-slhdp" Sep 09 23:18:54.372387 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:54.372276 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kqsqj" Sep 09 23:18:54.375950 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:18:54.375929 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9b48k" Sep 09 23:19:09.304853 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:09.304816 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:09.403944 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:09.403913 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:18.138422 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:18.138387 2567 scope.go:117] "RemoveContainer" containerID="4a13d9b3b648f3987bc02b848ca0c7c2f66622ed4c91e351d233b8a612771cd5" Sep 09 23:19:24.018524 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:24.018476 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:26.047399 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:26.047363 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t8ppw"] Sep 09 23:19:26.050917 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:26.050900 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t8ppw" Sep 09 23:19:26.052958 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:26.052937 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 09 23:19:26.053095 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:26.053073 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 09 23:19:26.053095 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:26.053080 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-jtgng\"" Sep 09 23:19:26.053370 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:26.053351 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 09 23:19:26.060159 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:26.060140 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t8ppw"] Sep 09 23:19:26.090916 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:26.090888 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm8sf\" (UniqueName: \"kubernetes.io/projected/7f3d547e-4ccc-4f20-a9fa-1ccfc551c3a1-kube-api-access-hm8sf\") pod \"dns-operator-controller-manager-7b84cd7c9c-t8ppw\" (UID: \"7f3d547e-4ccc-4f20-a9fa-1ccfc551c3a1\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t8ppw" Sep 09 23:19:26.191731 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:26.191699 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm8sf\" (UniqueName: \"kubernetes.io/projected/7f3d547e-4ccc-4f20-a9fa-1ccfc551c3a1-kube-api-access-hm8sf\") pod \"dns-operator-controller-manager-7b84cd7c9c-t8ppw\" (UID: \"7f3d547e-4ccc-4f20-a9fa-1ccfc551c3a1\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t8ppw" Sep 09 23:19:26.206925 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:26.206894 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm8sf\" (UniqueName: \"kubernetes.io/projected/7f3d547e-4ccc-4f20-a9fa-1ccfc551c3a1-kube-api-access-hm8sf\") pod \"dns-operator-controller-manager-7b84cd7c9c-t8ppw\" (UID: \"7f3d547e-4ccc-4f20-a9fa-1ccfc551c3a1\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t8ppw" Sep 09 23:19:26.362110 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:26.362019 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t8ppw" Sep 09 23:19:26.604641 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:26.604577 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:26.643472 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:26.643398 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t8ppw"] Sep 09 23:19:26.646612 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:19:26.646571 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f3d547e_4ccc_4f20_a9fa_1ccfc551c3a1.slice/crio-b5832e06994007231ccf727b2213608c1e4280e3e0b851bc038c10d52867e026 WatchSource:0}: Error finding container b5832e06994007231ccf727b2213608c1e4280e3e0b851bc038c10d52867e026: Status 404 returned error can't find the container with id b5832e06994007231ccf727b2213608c1e4280e3e0b851bc038c10d52867e026 Sep 09 23:19:27.001166 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:27.001133 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:27.400222 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:27.400105 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:27.644719 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:27.644636 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t8ppw" event={"ID":"7f3d547e-4ccc-4f20-a9fa-1ccfc551c3a1","Type":"ContainerStarted","Data":"b5832e06994007231ccf727b2213608c1e4280e3e0b851bc038c10d52867e026"} Sep 09 23:19:27.879943 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:27.879846 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:27.977356 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:27.977245 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:28.641681 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:28.641643 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:29.656198 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:29.656106 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t8ppw" event={"ID":"7f3d547e-4ccc-4f20-a9fa-1ccfc551c3a1","Type":"ContainerStarted","Data":"6adb46b85a0e1a904942a1c9c0d7af7f338050109c6eb71c6776dcec9ebe9804"} Sep 09 23:19:29.656559 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:29.656219 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t8ppw" Sep 09 23:19:29.677867 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:29.677817 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t8ppw" podStartSLOduration=0.964235493 podStartE2EDuration="3.677801081s" totalImagesPullingTime="2.713565588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:19:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:19:29.676677788 +0000 UTC m=+671.976685307" watchObservedRunningTime="2026-09-09 23:19:29.677801081 +0000 UTC m=+671.977808598" Sep 09 23:19:29.831663 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:29.831630 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:29.931385 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:29.931303 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:30.343183 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:30.343147 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr"] Sep 09 23:19:30.345879 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:30.345858 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:30.347903 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:30.347885 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hp8pg\"" Sep 09 23:19:30.366496 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:30.366464 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr"] Sep 09 23:19:30.431430 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:30.431400 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/845850d3-1a61-496e-994c-d52b47587b80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-psrhr\" (UID: \"845850d3-1a61-496e-994c-d52b47587b80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:30.431581 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:30.431441 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2gfx\" (UniqueName: \"kubernetes.io/projected/845850d3-1a61-496e-994c-d52b47587b80-kube-api-access-w2gfx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-psrhr\" (UID: \"845850d3-1a61-496e-994c-d52b47587b80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:30.532008 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:30.531958 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/845850d3-1a61-496e-994c-d52b47587b80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-psrhr\" (UID: \"845850d3-1a61-496e-994c-d52b47587b80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:30.532186 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:30.532023 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2gfx\" (UniqueName: \"kubernetes.io/projected/845850d3-1a61-496e-994c-d52b47587b80-kube-api-access-w2gfx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-psrhr\" (UID: \"845850d3-1a61-496e-994c-d52b47587b80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:30.532384 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:30.532359 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/845850d3-1a61-496e-994c-d52b47587b80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-psrhr\" (UID: \"845850d3-1a61-496e-994c-d52b47587b80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:30.543515 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:30.543481 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2gfx\" (UniqueName: \"kubernetes.io/projected/845850d3-1a61-496e-994c-d52b47587b80-kube-api-access-w2gfx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-psrhr\" (UID: \"845850d3-1a61-496e-994c-d52b47587b80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:30.564350 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:30.564301 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:30.656188 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:30.656099 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:30.657397 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:30.657361 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:30.930284 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:30.930256 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr"] Sep 09 23:19:30.933261 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:19:30.933234 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod845850d3_1a61_496e_994c_d52b47587b80.slice/crio-b747da9afbf77e591bd30d68dd3fef9b41e24c6e3b2b126f01a0f0aab387fe22 WatchSource:0}: Error finding container b747da9afbf77e591bd30d68dd3fef9b41e24c6e3b2b126f01a0f0aab387fe22: Status 404 returned error can't find the container with id b747da9afbf77e591bd30d68dd3fef9b41e24c6e3b2b126f01a0f0aab387fe22 Sep 09 23:19:31.009037 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:31.009002 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:31.667764 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:31.667720 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" event={"ID":"845850d3-1a61-496e-994c-d52b47587b80","Type":"ContainerStarted","Data":"b747da9afbf77e591bd30d68dd3fef9b41e24c6e3b2b126f01a0f0aab387fe22"} Sep 09 23:19:32.052418 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:32.052365 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:33.604953 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:33.604914 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:33.871337 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:33.871236 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:34.685521 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:34.685479 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" event={"ID":"845850d3-1a61-496e-994c-d52b47587b80","Type":"ContainerStarted","Data":"287bcf49b6301769646fc0e01e8fe988168fe297bf3e858ee32746ecf4d51b1a"} Sep 09 23:19:34.685884 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:34.685626 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:34.704297 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:34.704255 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" podStartSLOduration=1.144987915 podStartE2EDuration="4.704240719s" totalImagesPullingTime="3.559252804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:19:34.702982409 +0000 UTC m=+677.002989926" watchObservedRunningTime="2026-09-09 23:19:34.704240719 +0000 UTC m=+677.004248236" Sep 09 23:19:35.252537 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:35.252498 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz"] Sep 09 23:19:35.255255 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:35.255237 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" Sep 09 23:19:35.257699 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:35.257675 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gvq54\"" Sep 09 23:19:35.269135 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:35.269111 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz"] Sep 09 23:19:35.376650 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:35.376604 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv9fz\" (UniqueName: \"kubernetes.io/projected/67746b95-fb1c-4f56-b8fb-9fbf8cf87185-kube-api-access-jv9fz\") pod \"limitador-operator-controller-manager-74495c69f8-wctbz\" (UID: \"67746b95-fb1c-4f56-b8fb-9fbf8cf87185\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" Sep 09 23:19:35.477670 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:35.477632 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv9fz\" (UniqueName: \"kubernetes.io/projected/67746b95-fb1c-4f56-b8fb-9fbf8cf87185-kube-api-access-jv9fz\") pod \"limitador-operator-controller-manager-74495c69f8-wctbz\" (UID: \"67746b95-fb1c-4f56-b8fb-9fbf8cf87185\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" Sep 09 23:19:35.486941 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:35.486916 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv9fz\" (UniqueName: \"kubernetes.io/projected/67746b95-fb1c-4f56-b8fb-9fbf8cf87185-kube-api-access-jv9fz\") pod \"limitador-operator-controller-manager-74495c69f8-wctbz\" (UID: \"67746b95-fb1c-4f56-b8fb-9fbf8cf87185\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" Sep 09 23:19:35.564971 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:35.564886 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" Sep 09 23:19:35.834290 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:35.834264 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz"] Sep 09 23:19:35.837158 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:19:35.837131 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67746b95_fb1c_4f56_b8fb_9fbf8cf87185.slice/crio-2960ff6463d9150377d3d11de5ef119838393af5e9defc94134f488f0136fcf0 WatchSource:0}: Error finding container 2960ff6463d9150377d3d11de5ef119838393af5e9defc94134f488f0136fcf0: Status 404 returned error can't find the container with id 2960ff6463d9150377d3d11de5ef119838393af5e9defc94134f488f0136fcf0 Sep 09 23:19:35.839414 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:35.839399 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:19:36.608794 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:36.608759 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:36.697895 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:36.697854 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" event={"ID":"67746b95-fb1c-4f56-b8fb-9fbf8cf87185","Type":"ContainerStarted","Data":"2960ff6463d9150377d3d11de5ef119838393af5e9defc94134f488f0136fcf0"} Sep 09 23:19:36.709268 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:36.709227 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:37.212386 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:37.212345 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:37.307044 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:37.307005 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:37.703997 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:37.703952 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" event={"ID":"67746b95-fb1c-4f56-b8fb-9fbf8cf87185","Type":"ContainerStarted","Data":"db5683763a265fd183fd23fba353d06effcdfb3ceb10369d5def68d08edeaa61"} Sep 09 23:19:37.704155 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:37.704125 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" Sep 09 23:19:37.719560 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:37.719513 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" podStartSLOduration=1.2119103390000001 podStartE2EDuration="2.719497848s" totalImagesPullingTime="1.507587509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:19:37.718173911 +0000 UTC m=+680.018181431" watchObservedRunningTime="2026-09-09 23:19:37.719497848 +0000 UTC m=+680.019505366" Sep 09 23:19:40.662347 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:40.662316 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-t8ppw" Sep 09 23:19:42.001567 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:42.001527 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:42.102094 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:42.102057 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:42.211717 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:42.211681 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:42.313470 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:42.313388 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:42.412981 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:42.412948 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:42.471169 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:42.471133 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:45.692774 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:45.692747 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:47.860305 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.860272 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr"] Sep 09 23:19:47.860672 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.860462 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" podUID="845850d3-1a61-496e-994c-d52b47587b80" containerName="manager" containerID="cri-o://287bcf49b6301769646fc0e01e8fe988168fe297bf3e858ee32746ecf4d51b1a" gracePeriod=2 Sep 09 23:19:47.869152 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:19:47.868884 2567 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"845850d3-1a61-496e-994c-d52b47587b80\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-psrhr\": pods \"kuadrant-operator-controller-manager-76f8f686bf-psrhr\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:47.869672 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.869634 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr"] Sep 09 23:19:47.884670 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.884641 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2"] Sep 09 23:19:47.885166 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.885150 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="845850d3-1a61-496e-994c-d52b47587b80" containerName="manager" Sep 09 23:19:47.885225 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.885169 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="845850d3-1a61-496e-994c-d52b47587b80" containerName="manager" Sep 09 23:19:47.885279 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.885268 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="845850d3-1a61-496e-994c-d52b47587b80" containerName="manager" Sep 09 23:19:47.887730 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.887709 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" Sep 09 23:19:47.889258 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:19:47.889232 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-psrhr\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="845850d3-1a61-496e-994c-d52b47587b80" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:47.908962 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.908939 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2"] Sep 09 23:19:47.915059 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.915033 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz"] Sep 09 23:19:47.915270 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.915228 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" podUID="67746b95-fb1c-4f56-b8fb-9fbf8cf87185" containerName="manager" containerID="cri-o://db5683763a265fd183fd23fba353d06effcdfb3ceb10369d5def68d08edeaa61" gracePeriod=2 Sep 09 23:19:47.917027 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.917003 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" Sep 09 23:19:47.930750 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:19:47.930716 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-psrhr\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="845850d3-1a61-496e-994c-d52b47587b80" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:47.932466 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:19:47.932418 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-wctbz\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="67746b95-fb1c-4f56-b8fb-9fbf8cf87185" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" Sep 09 23:19:47.932756 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.932729 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz"] Sep 09 23:19:47.946633 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.946604 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-dsxw8"] Sep 09 23:19:47.946935 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.946923 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67746b95-fb1c-4f56-b8fb-9fbf8cf87185" containerName="manager" Sep 09 23:19:47.946988 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.946936 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="67746b95-fb1c-4f56-b8fb-9fbf8cf87185" containerName="manager" Sep 09 23:19:47.947024 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.947005 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="67746b95-fb1c-4f56-b8fb-9fbf8cf87185" containerName="manager" Sep 09 23:19:47.949054 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.949038 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dsxw8" Sep 09 23:19:47.950568 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:19:47.950542 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-psrhr\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="845850d3-1a61-496e-994c-d52b47587b80" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:47.952026 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:19:47.952002 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-wctbz\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="67746b95-fb1c-4f56-b8fb-9fbf8cf87185" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" Sep 09 23:19:47.964327 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.964302 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-dsxw8"] Sep 09 23:19:47.985571 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.985546 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eeb817b3-391e-4dbc-8b88-1296e6a1e30e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k8bb2\" (UID: \"eeb817b3-391e-4dbc-8b88-1296e6a1e30e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" Sep 09 23:19:47.985684 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:47.985658 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khgd9\" (UniqueName: \"kubernetes.io/projected/eeb817b3-391e-4dbc-8b88-1296e6a1e30e-kube-api-access-khgd9\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k8bb2\" (UID: \"eeb817b3-391e-4dbc-8b88-1296e6a1e30e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" Sep 09 23:19:48.086129 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.086097 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eeb817b3-391e-4dbc-8b88-1296e6a1e30e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k8bb2\" (UID: \"eeb817b3-391e-4dbc-8b88-1296e6a1e30e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" Sep 09 23:19:48.086242 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.086164 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lprh\" (UniqueName: \"kubernetes.io/projected/0dafe2d3-2c1e-4681-902b-4fa1d94f6fa0-kube-api-access-2lprh\") pod \"limitador-operator-controller-manager-74495c69f8-dsxw8\" (UID: \"0dafe2d3-2c1e-4681-902b-4fa1d94f6fa0\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dsxw8" Sep 09 23:19:48.086307 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.086289 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khgd9\" (UniqueName: \"kubernetes.io/projected/eeb817b3-391e-4dbc-8b88-1296e6a1e30e-kube-api-access-khgd9\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k8bb2\" (UID: \"eeb817b3-391e-4dbc-8b88-1296e6a1e30e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" Sep 09 23:19:48.086491 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.086469 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eeb817b3-391e-4dbc-8b88-1296e6a1e30e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k8bb2\" (UID: \"eeb817b3-391e-4dbc-8b88-1296e6a1e30e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" Sep 09 23:19:48.096640 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.096463 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khgd9\" (UniqueName: \"kubernetes.io/projected/eeb817b3-391e-4dbc-8b88-1296e6a1e30e-kube-api-access-khgd9\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k8bb2\" (UID: \"eeb817b3-391e-4dbc-8b88-1296e6a1e30e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" Sep 09 23:19:48.152932 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.152911 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:48.154666 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:19:48.154636 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-psrhr\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="845850d3-1a61-496e-994c-d52b47587b80" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:48.155870 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.155854 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" Sep 09 23:19:48.156038 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:19:48.156020 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-wctbz\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="67746b95-fb1c-4f56-b8fb-9fbf8cf87185" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" Sep 09 23:19:48.157374 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:19:48.157355 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-psrhr\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="845850d3-1a61-496e-994c-d52b47587b80" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:48.158729 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:19:48.158711 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-wctbz\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="67746b95-fb1c-4f56-b8fb-9fbf8cf87185" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" Sep 09 23:19:48.187123 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.187100 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lprh\" (UniqueName: \"kubernetes.io/projected/0dafe2d3-2c1e-4681-902b-4fa1d94f6fa0-kube-api-access-2lprh\") pod \"limitador-operator-controller-manager-74495c69f8-dsxw8\" (UID: \"0dafe2d3-2c1e-4681-902b-4fa1d94f6fa0\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dsxw8" Sep 09 23:19:48.191128 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:19:48.191106 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-psrhr\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="845850d3-1a61-496e-994c-d52b47587b80" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:48.192377 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:19:48.192354 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-wctbz\" is forbidden: User \"system:node:ip-10-0-143-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-228.ec2.internal' and this object" podUID="67746b95-fb1c-4f56-b8fb-9fbf8cf87185" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" Sep 09 23:19:48.194339 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.194316 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lprh\" (UniqueName: \"kubernetes.io/projected/0dafe2d3-2c1e-4681-902b-4fa1d94f6fa0-kube-api-access-2lprh\") pod \"limitador-operator-controller-manager-74495c69f8-dsxw8\" (UID: \"0dafe2d3-2c1e-4681-902b-4fa1d94f6fa0\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dsxw8" Sep 09 23:19:48.288017 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.287995 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv9fz\" (UniqueName: \"kubernetes.io/projected/67746b95-fb1c-4f56-b8fb-9fbf8cf87185-kube-api-access-jv9fz\") pod \"67746b95-fb1c-4f56-b8fb-9fbf8cf87185\" (UID: \"67746b95-fb1c-4f56-b8fb-9fbf8cf87185\") " Sep 09 23:19:48.288128 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.288068 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2gfx\" (UniqueName: \"kubernetes.io/projected/845850d3-1a61-496e-994c-d52b47587b80-kube-api-access-w2gfx\") pod \"845850d3-1a61-496e-994c-d52b47587b80\" (UID: \"845850d3-1a61-496e-994c-d52b47587b80\") " Sep 09 23:19:48.288181 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.288126 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/845850d3-1a61-496e-994c-d52b47587b80-extensions-socket-volume\") pod \"845850d3-1a61-496e-994c-d52b47587b80\" (UID: \"845850d3-1a61-496e-994c-d52b47587b80\") " Sep 09 23:19:48.288663 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.288637 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/845850d3-1a61-496e-994c-d52b47587b80-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "845850d3-1a61-496e-994c-d52b47587b80" (UID: "845850d3-1a61-496e-994c-d52b47587b80"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:19:48.290072 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.290052 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/845850d3-1a61-496e-994c-d52b47587b80-kube-api-access-w2gfx" (OuterVolumeSpecName: "kube-api-access-w2gfx") pod "845850d3-1a61-496e-994c-d52b47587b80" (UID: "845850d3-1a61-496e-994c-d52b47587b80"). InnerVolumeSpecName "kube-api-access-w2gfx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:19:48.290072 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.290063 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67746b95-fb1c-4f56-b8fb-9fbf8cf87185-kube-api-access-jv9fz" (OuterVolumeSpecName: "kube-api-access-jv9fz") pod "67746b95-fb1c-4f56-b8fb-9fbf8cf87185" (UID: "67746b95-fb1c-4f56-b8fb-9fbf8cf87185"). InnerVolumeSpecName "kube-api-access-jv9fz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:19:48.292264 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.292248 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" Sep 09 23:19:48.297381 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.297361 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dsxw8" Sep 09 23:19:48.389209 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.389134 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv9fz\" (UniqueName: \"kubernetes.io/projected/67746b95-fb1c-4f56-b8fb-9fbf8cf87185-kube-api-access-jv9fz\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:19:48.389209 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.389160 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2gfx\" (UniqueName: \"kubernetes.io/projected/845850d3-1a61-496e-994c-d52b47587b80-kube-api-access-w2gfx\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:19:48.389209 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.389170 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/845850d3-1a61-496e-994c-d52b47587b80-extensions-socket-volume\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:19:48.574909 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.574877 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-dsxw8"] Sep 09 23:19:48.576949 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:19:48.576700 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dafe2d3_2c1e_4681_902b_4fa1d94f6fa0.slice/crio-80d5da01126eb023e42622067081732cd6bab64464e4471bb37c41ffd768ebdf WatchSource:0}: Error finding container 80d5da01126eb023e42622067081732cd6bab64464e4471bb37c41ffd768ebdf: Status 404 returned error can't find the container with id 80d5da01126eb023e42622067081732cd6bab64464e4471bb37c41ffd768ebdf Sep 09 23:19:48.578355 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.578287 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2"] Sep 09 23:19:48.580317 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:19:48.580277 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb817b3_391e_4dbc_8b88_1296e6a1e30e.slice/crio-d713caec33d5675a5a87c74d046ec3d053ea8019121b125ed81bb45401bb0386 WatchSource:0}: Error finding container d713caec33d5675a5a87c74d046ec3d053ea8019121b125ed81bb45401bb0386: Status 404 returned error can't find the container with id d713caec33d5675a5a87c74d046ec3d053ea8019121b125ed81bb45401bb0386 Sep 09 23:19:48.759718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.759684 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" event={"ID":"eeb817b3-391e-4dbc-8b88-1296e6a1e30e","Type":"ContainerStarted","Data":"3a90ed40b243a9ab574b5c4fd2589ee4e0a48d2e013f407caef4a02871e68a8d"} Sep 09 23:19:48.759881 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.759734 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" event={"ID":"eeb817b3-391e-4dbc-8b88-1296e6a1e30e","Type":"ContainerStarted","Data":"d713caec33d5675a5a87c74d046ec3d053ea8019121b125ed81bb45401bb0386"} Sep 09 23:19:48.759881 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.759772 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" Sep 09 23:19:48.761222 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.761198 2567 generic.go:356] "Generic (PLEG): container finished" podID="67746b95-fb1c-4f56-b8fb-9fbf8cf87185" containerID="db5683763a265fd183fd23fba353d06effcdfb3ceb10369d5def68d08edeaa61" exitCode=0 Sep 09 23:19:48.761349 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.761239 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-wctbz" Sep 09 23:19:48.761349 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.761273 2567 scope.go:117] "RemoveContainer" containerID="db5683763a265fd183fd23fba353d06effcdfb3ceb10369d5def68d08edeaa61" Sep 09 23:19:48.763340 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.763313 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dsxw8" event={"ID":"0dafe2d3-2c1e-4681-902b-4fa1d94f6fa0","Type":"ContainerStarted","Data":"2bb2e49769b155e6351e869e449e7f0831d9dfd00801bf829774949a111bb13c"} Sep 09 23:19:48.763452 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.763364 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dsxw8" event={"ID":"0dafe2d3-2c1e-4681-902b-4fa1d94f6fa0","Type":"ContainerStarted","Data":"80d5da01126eb023e42622067081732cd6bab64464e4471bb37c41ffd768ebdf"} Sep 09 23:19:48.763452 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.763393 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dsxw8" Sep 09 23:19:48.764946 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.764923 2567 generic.go:356] "Generic (PLEG): container finished" podID="845850d3-1a61-496e-994c-d52b47587b80" containerID="287bcf49b6301769646fc0e01e8fe988168fe297bf3e858ee32746ecf4d51b1a" exitCode=0 Sep 09 23:19:48.764946 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.764938 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-psrhr" Sep 09 23:19:48.771573 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.771555 2567 scope.go:117] "RemoveContainer" containerID="db5683763a265fd183fd23fba353d06effcdfb3ceb10369d5def68d08edeaa61" Sep 09 23:19:48.772065 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:19:48.772041 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db5683763a265fd183fd23fba353d06effcdfb3ceb10369d5def68d08edeaa61\": container with ID starting with db5683763a265fd183fd23fba353d06effcdfb3ceb10369d5def68d08edeaa61 not found: ID does not exist" containerID="db5683763a265fd183fd23fba353d06effcdfb3ceb10369d5def68d08edeaa61" Sep 09 23:19:48.772158 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.772071 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db5683763a265fd183fd23fba353d06effcdfb3ceb10369d5def68d08edeaa61"} err="failed to get container status \"db5683763a265fd183fd23fba353d06effcdfb3ceb10369d5def68d08edeaa61\": rpc error: code = NotFound desc = could not find container \"db5683763a265fd183fd23fba353d06effcdfb3ceb10369d5def68d08edeaa61\": container with ID starting with db5683763a265fd183fd23fba353d06effcdfb3ceb10369d5def68d08edeaa61 not found: ID does not exist" Sep 09 23:19:48.772158 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.772091 2567 scope.go:117] "RemoveContainer" containerID="287bcf49b6301769646fc0e01e8fe988168fe297bf3e858ee32746ecf4d51b1a" Sep 09 23:19:48.781121 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.781105 2567 scope.go:117] "RemoveContainer" containerID="287bcf49b6301769646fc0e01e8fe988168fe297bf3e858ee32746ecf4d51b1a" Sep 09 23:19:48.781367 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:19:48.781349 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"287bcf49b6301769646fc0e01e8fe988168fe297bf3e858ee32746ecf4d51b1a\": container with ID starting with 287bcf49b6301769646fc0e01e8fe988168fe297bf3e858ee32746ecf4d51b1a not found: ID does not exist" containerID="287bcf49b6301769646fc0e01e8fe988168fe297bf3e858ee32746ecf4d51b1a" Sep 09 23:19:48.781435 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.781373 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"287bcf49b6301769646fc0e01e8fe988168fe297bf3e858ee32746ecf4d51b1a"} err="failed to get container status \"287bcf49b6301769646fc0e01e8fe988168fe297bf3e858ee32746ecf4d51b1a\": rpc error: code = NotFound desc = could not find container \"287bcf49b6301769646fc0e01e8fe988168fe297bf3e858ee32746ecf4d51b1a\": container with ID starting with 287bcf49b6301769646fc0e01e8fe988168fe297bf3e858ee32746ecf4d51b1a not found: ID does not exist" Sep 09 23:19:48.789535 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.789444 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" podStartSLOduration=1.789430866 podStartE2EDuration="1.789430866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:19:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:19:48.787224679 +0000 UTC m=+691.087232197" watchObservedRunningTime="2026-09-09 23:19:48.789430866 +0000 UTC m=+691.089438384" Sep 09 23:19:48.809717 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:48.809679 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dsxw8" podStartSLOduration=1.8096664040000001 podStartE2EDuration="1.809666404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:19:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:19:48.807980543 +0000 UTC m=+691.107988061" watchObservedRunningTime="2026-09-09 23:19:48.809666404 +0000 UTC m=+691.109673922" Sep 09 23:19:50.035284 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:50.035228 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:50.135481 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:50.135448 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:50.193803 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:50.193767 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67746b95-fb1c-4f56-b8fb-9fbf8cf87185" path="/var/lib/kubelet/pods/67746b95-fb1c-4f56-b8fb-9fbf8cf87185/volumes" Sep 09 23:19:50.194196 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:50.194176 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="845850d3-1a61-496e-994c-d52b47587b80" path="/var/lib/kubelet/pods/845850d3-1a61-496e-994c-d52b47587b80/volumes" Sep 09 23:19:53.060082 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:53.060043 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:53.162114 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:53.162075 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:55.622760 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:55.622721 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:55.724804 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:55.724769 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:59.774039 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:59.774004 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" Sep 09 23:19:59.774615 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:19:59.774076 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dsxw8" Sep 09 23:20:01.009957 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:01.009928 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:01.163363 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:01.163323 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:01.431328 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:01.431244 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:01.497465 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:01.497429 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:01.815532 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:01.815496 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:01.871075 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:01.871001 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:05.179026 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.178987 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2"] Sep 09 23:20:05.179464 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.179170 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" podUID="eeb817b3-391e-4dbc-8b88-1296e6a1e30e" containerName="manager" containerID="cri-o://3a90ed40b243a9ab574b5c4fd2589ee4e0a48d2e013f407caef4a02871e68a8d" gracePeriod=10 Sep 09 23:20:05.436115 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.436055 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bkx25"] Sep 09 23:20:05.456062 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.456036 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" Sep 09 23:20:05.461774 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.461749 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bkx25"] Sep 09 23:20:05.461881 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.461831 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bkx25" Sep 09 23:20:05.630253 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.630218 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eeb817b3-391e-4dbc-8b88-1296e6a1e30e-extensions-socket-volume\") pod \"eeb817b3-391e-4dbc-8b88-1296e6a1e30e\" (UID: \"eeb817b3-391e-4dbc-8b88-1296e6a1e30e\") " Sep 09 23:20:05.630418 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.630317 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khgd9\" (UniqueName: \"kubernetes.io/projected/eeb817b3-391e-4dbc-8b88-1296e6a1e30e-kube-api-access-khgd9\") pod \"eeb817b3-391e-4dbc-8b88-1296e6a1e30e\" (UID: \"eeb817b3-391e-4dbc-8b88-1296e6a1e30e\") " Sep 09 23:20:05.630472 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.630441 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-995pp\" (UniqueName: \"kubernetes.io/projected/530e850b-3ebb-47bb-a568-09b5aa04a7ce-kube-api-access-995pp\") pod \"kuadrant-operator-controller-manager-5769f99d9f-bkx25\" (UID: \"530e850b-3ebb-47bb-a568-09b5aa04a7ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bkx25" Sep 09 23:20:05.630524 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.630473 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/530e850b-3ebb-47bb-a568-09b5aa04a7ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-bkx25\" (UID: \"530e850b-3ebb-47bb-a568-09b5aa04a7ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bkx25" Sep 09 23:20:05.630615 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.630572 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb817b3-391e-4dbc-8b88-1296e6a1e30e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "eeb817b3-391e-4dbc-8b88-1296e6a1e30e" (UID: "eeb817b3-391e-4dbc-8b88-1296e6a1e30e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:20:05.632315 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.632288 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb817b3-391e-4dbc-8b88-1296e6a1e30e-kube-api-access-khgd9" (OuterVolumeSpecName: "kube-api-access-khgd9") pod "eeb817b3-391e-4dbc-8b88-1296e6a1e30e" (UID: "eeb817b3-391e-4dbc-8b88-1296e6a1e30e"). InnerVolumeSpecName "kube-api-access-khgd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:20:05.731872 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.731839 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-995pp\" (UniqueName: \"kubernetes.io/projected/530e850b-3ebb-47bb-a568-09b5aa04a7ce-kube-api-access-995pp\") pod \"kuadrant-operator-controller-manager-5769f99d9f-bkx25\" (UID: \"530e850b-3ebb-47bb-a568-09b5aa04a7ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bkx25" Sep 09 23:20:05.732011 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.731889 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/530e850b-3ebb-47bb-a568-09b5aa04a7ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-bkx25\" (UID: \"530e850b-3ebb-47bb-a568-09b5aa04a7ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bkx25" Sep 09 23:20:05.732011 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.731942 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khgd9\" (UniqueName: \"kubernetes.io/projected/eeb817b3-391e-4dbc-8b88-1296e6a1e30e-kube-api-access-khgd9\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:20:05.732011 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.731954 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eeb817b3-391e-4dbc-8b88-1296e6a1e30e-extensions-socket-volume\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:20:05.732248 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.732232 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/530e850b-3ebb-47bb-a568-09b5aa04a7ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-bkx25\" (UID: \"530e850b-3ebb-47bb-a568-09b5aa04a7ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bkx25" Sep 09 23:20:05.743412 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.743384 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-995pp\" (UniqueName: \"kubernetes.io/projected/530e850b-3ebb-47bb-a568-09b5aa04a7ce-kube-api-access-995pp\") pod \"kuadrant-operator-controller-manager-5769f99d9f-bkx25\" (UID: \"530e850b-3ebb-47bb-a568-09b5aa04a7ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bkx25" Sep 09 23:20:05.772913 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.772887 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bkx25" Sep 09 23:20:05.850634 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.850573 2567 generic.go:356] "Generic (PLEG): container finished" podID="eeb817b3-391e-4dbc-8b88-1296e6a1e30e" containerID="3a90ed40b243a9ab574b5c4fd2589ee4e0a48d2e013f407caef4a02871e68a8d" exitCode=0 Sep 09 23:20:05.850634 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.850632 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" Sep 09 23:20:05.850834 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.850633 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" event={"ID":"eeb817b3-391e-4dbc-8b88-1296e6a1e30e","Type":"ContainerDied","Data":"3a90ed40b243a9ab574b5c4fd2589ee4e0a48d2e013f407caef4a02871e68a8d"} Sep 09 23:20:05.850834 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.850723 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2" event={"ID":"eeb817b3-391e-4dbc-8b88-1296e6a1e30e","Type":"ContainerDied","Data":"d713caec33d5675a5a87c74d046ec3d053ea8019121b125ed81bb45401bb0386"} Sep 09 23:20:05.850834 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.850763 2567 scope.go:117] "RemoveContainer" containerID="3a90ed40b243a9ab574b5c4fd2589ee4e0a48d2e013f407caef4a02871e68a8d" Sep 09 23:20:05.861844 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.861823 2567 scope.go:117] "RemoveContainer" containerID="3a90ed40b243a9ab574b5c4fd2589ee4e0a48d2e013f407caef4a02871e68a8d" Sep 09 23:20:05.862141 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:20:05.862120 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a90ed40b243a9ab574b5c4fd2589ee4e0a48d2e013f407caef4a02871e68a8d\": container with ID starting with 3a90ed40b243a9ab574b5c4fd2589ee4e0a48d2e013f407caef4a02871e68a8d not found: ID does not exist" containerID="3a90ed40b243a9ab574b5c4fd2589ee4e0a48d2e013f407caef4a02871e68a8d" Sep 09 23:20:05.862213 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.862147 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a90ed40b243a9ab574b5c4fd2589ee4e0a48d2e013f407caef4a02871e68a8d"} err="failed to get container status \"3a90ed40b243a9ab574b5c4fd2589ee4e0a48d2e013f407caef4a02871e68a8d\": rpc error: code = NotFound desc = could not find container \"3a90ed40b243a9ab574b5c4fd2589ee4e0a48d2e013f407caef4a02871e68a8d\": container with ID starting with 3a90ed40b243a9ab574b5c4fd2589ee4e0a48d2e013f407caef4a02871e68a8d not found: ID does not exist" Sep 09 23:20:05.876959 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.876936 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2"] Sep 09 23:20:05.890240 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:05.890218 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k8bb2"] Sep 09 23:20:06.064688 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:06.064662 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bkx25"] Sep 09 23:20:06.066804 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:20:06.066780 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod530e850b_3ebb_47bb_a568_09b5aa04a7ce.slice/crio-97d935159e81b756c9cbd66929a347cff08274508dc73ece179986447725dcfa WatchSource:0}: Error finding container 97d935159e81b756c9cbd66929a347cff08274508dc73ece179986447725dcfa: Status 404 returned error can't find the container with id 97d935159e81b756c9cbd66929a347cff08274508dc73ece179986447725dcfa Sep 09 23:20:06.194243 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:06.194202 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeb817b3-391e-4dbc-8b88-1296e6a1e30e" path="/var/lib/kubelet/pods/eeb817b3-391e-4dbc-8b88-1296e6a1e30e/volumes" Sep 09 23:20:06.857862 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:06.857811 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bkx25" event={"ID":"530e850b-3ebb-47bb-a568-09b5aa04a7ce","Type":"ContainerStarted","Data":"320ca514685b14e15a090da3ac41487eda23f333732de414c89a837ea24d734d"} Sep 09 23:20:06.858083 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:06.857911 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bkx25" event={"ID":"530e850b-3ebb-47bb-a568-09b5aa04a7ce","Type":"ContainerStarted","Data":"97d935159e81b756c9cbd66929a347cff08274508dc73ece179986447725dcfa"} Sep 09 23:20:06.858083 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:06.857945 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bkx25" Sep 09 23:20:06.878281 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:06.878234 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bkx25" podStartSLOduration=1.878218379 podStartE2EDuration="1.878218379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:20:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:20:06.875947797 +0000 UTC m=+709.175955320" watchObservedRunningTime="2026-09-09 23:20:06.878218379 +0000 UTC m=+709.178225897" Sep 09 23:20:08.924378 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:08.924342 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:09.025258 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:09.025231 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:09.838774 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:09.838739 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:09.939083 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:09.939051 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:12.812804 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:12.812729 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:12.910537 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:12.910503 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:17.866476 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:17.866446 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bkx25" Sep 09 23:20:21.506465 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:21.506424 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:21.722845 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:21.722814 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:36.319195 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:36.319159 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:36.424505 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:36.424469 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:36.480313 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:36.480279 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:37.247302 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:37.247267 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:37.350135 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:37.350095 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:37.354686 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:37.354665 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-zwxfd"] Sep 09 23:20:37.355006 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:37.354996 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb817b3-391e-4dbc-8b88-1296e6a1e30e" containerName="manager" Sep 09 23:20:37.355052 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:37.355008 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb817b3-391e-4dbc-8b88-1296e6a1e30e" containerName="manager" Sep 09 23:20:37.355085 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:37.355073 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb817b3-391e-4dbc-8b88-1296e6a1e30e" containerName="manager" Sep 09 23:20:37.359370 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:37.359353 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-zwxfd" Sep 09 23:20:37.362909 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:37.362889 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5smj5\"" Sep 09 23:20:37.365223 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:37.365200 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-zwxfd"] Sep 09 23:20:37.499759 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:37.499684 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nvkm\" (UniqueName: \"kubernetes.io/projected/4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c-kube-api-access-4nvkm\") pod \"authorino-59c974bd48-zwxfd\" (UID: \"4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c\") " pod="kuadrant-system/authorino-59c974bd48-zwxfd" Sep 09 23:20:37.601069 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:37.601032 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nvkm\" (UniqueName: \"kubernetes.io/projected/4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c-kube-api-access-4nvkm\") pod \"authorino-59c974bd48-zwxfd\" (UID: \"4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c\") " pod="kuadrant-system/authorino-59c974bd48-zwxfd" Sep 09 23:20:37.612298 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:37.612268 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nvkm\" (UniqueName: \"kubernetes.io/projected/4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c-kube-api-access-4nvkm\") pod \"authorino-59c974bd48-zwxfd\" (UID: \"4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c\") " pod="kuadrant-system/authorino-59c974bd48-zwxfd" Sep 09 23:20:37.668807 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:37.668779 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-zwxfd" Sep 09 23:20:37.935386 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:37.935358 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-zwxfd"] Sep 09 23:20:37.937482 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:20:37.937456 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fcbb83a_a7c3_4115_8f0b_ec66d2fca91c.slice/crio-6ee049fafe7df00bbbb2e8df1169414a56ca8819bae96e6dca7a778e9c4760da WatchSource:0}: Error finding container 6ee049fafe7df00bbbb2e8df1169414a56ca8819bae96e6dca7a778e9c4760da: Status 404 returned error can't find the container with id 6ee049fafe7df00bbbb2e8df1169414a56ca8819bae96e6dca7a778e9c4760da Sep 09 23:20:38.002854 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:38.002822 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-zwxfd" event={"ID":"4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c","Type":"ContainerStarted","Data":"6ee049fafe7df00bbbb2e8df1169414a56ca8819bae96e6dca7a778e9c4760da"} Sep 09 23:20:40.013789 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:40.013750 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-zwxfd" event={"ID":"4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c","Type":"ContainerStarted","Data":"b35d18da0795766da77fa0f596e47293172d76b2a9e94c25573910a52266eaef"} Sep 09 23:20:40.027070 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:40.027021 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-zwxfd" podStartSLOduration=1.410667817 podStartE2EDuration="3.027001796s" totalImagesPullingTime="1.616333979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:20:40.026272728 +0000 UTC m=+742.326280245" watchObservedRunningTime="2026-09-09 23:20:40.027001796 +0000 UTC m=+742.327009329" Sep 09 23:20:54.773909 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:54.773866 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:54.867900 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:54.867861 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:55.208004 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:20:55.207917 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:07.773320 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:07.773274 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:08.006834 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:08.006787 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:08.276989 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:08.276952 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c8db477f6-n82tt"] Sep 09 23:21:08.280407 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:08.280384 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c8db477f6-n82tt" Sep 09 23:21:08.282152 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:08.282132 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 09 23:21:08.288875 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:08.288854 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c8db477f6-n82tt"] Sep 09 23:21:08.358759 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:08.358717 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4629n\" (UniqueName: \"kubernetes.io/projected/4025f39a-ea69-4ab3-a67a-bb012b0a7283-kube-api-access-4629n\") pod \"authorino-5c8db477f6-n82tt\" (UID: \"4025f39a-ea69-4ab3-a67a-bb012b0a7283\") " pod="kuadrant-system/authorino-5c8db477f6-n82tt" Sep 09 23:21:08.358955 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:08.358770 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4025f39a-ea69-4ab3-a67a-bb012b0a7283-tls-cert\") pod \"authorino-5c8db477f6-n82tt\" (UID: \"4025f39a-ea69-4ab3-a67a-bb012b0a7283\") " pod="kuadrant-system/authorino-5c8db477f6-n82tt" Sep 09 23:21:08.459368 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:08.459337 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4629n\" (UniqueName: \"kubernetes.io/projected/4025f39a-ea69-4ab3-a67a-bb012b0a7283-kube-api-access-4629n\") pod \"authorino-5c8db477f6-n82tt\" (UID: \"4025f39a-ea69-4ab3-a67a-bb012b0a7283\") " pod="kuadrant-system/authorino-5c8db477f6-n82tt" Sep 09 23:21:08.459510 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:08.459392 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4025f39a-ea69-4ab3-a67a-bb012b0a7283-tls-cert\") pod \"authorino-5c8db477f6-n82tt\" (UID: \"4025f39a-ea69-4ab3-a67a-bb012b0a7283\") " pod="kuadrant-system/authorino-5c8db477f6-n82tt" Sep 09 23:21:08.461829 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:08.461801 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4025f39a-ea69-4ab3-a67a-bb012b0a7283-tls-cert\") pod \"authorino-5c8db477f6-n82tt\" (UID: \"4025f39a-ea69-4ab3-a67a-bb012b0a7283\") " pod="kuadrant-system/authorino-5c8db477f6-n82tt" Sep 09 23:21:08.466705 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:08.466682 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4629n\" (UniqueName: \"kubernetes.io/projected/4025f39a-ea69-4ab3-a67a-bb012b0a7283-kube-api-access-4629n\") pod \"authorino-5c8db477f6-n82tt\" (UID: \"4025f39a-ea69-4ab3-a67a-bb012b0a7283\") " pod="kuadrant-system/authorino-5c8db477f6-n82tt" Sep 09 23:21:08.590169 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:08.590088 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c8db477f6-n82tt" Sep 09 23:21:08.860985 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:08.860936 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c8db477f6-n82tt"] Sep 09 23:21:08.863637 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:21:08.863581 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4025f39a_ea69_4ab3_a67a_bb012b0a7283.slice/crio-224b5de876ba6bc822414abbc894d44d5cf9c1b6ef21d8b87bd803cbf95c6255 WatchSource:0}: Error finding container 224b5de876ba6bc822414abbc894d44d5cf9c1b6ef21d8b87bd803cbf95c6255: Status 404 returned error can't find the container with id 224b5de876ba6bc822414abbc894d44d5cf9c1b6ef21d8b87bd803cbf95c6255 Sep 09 23:21:09.146873 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:09.146795 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c8db477f6-n82tt" event={"ID":"4025f39a-ea69-4ab3-a67a-bb012b0a7283","Type":"ContainerStarted","Data":"224b5de876ba6bc822414abbc894d44d5cf9c1b6ef21d8b87bd803cbf95c6255"} Sep 09 23:21:10.152792 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:10.152756 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c8db477f6-n82tt" event={"ID":"4025f39a-ea69-4ab3-a67a-bb012b0a7283","Type":"ContainerStarted","Data":"19fe4ee5a9d34b74c99ee13ac15532daa504f7eded25d9fc7482b3d6e6028c0b"} Sep 09 23:21:10.167113 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:10.167068 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c8db477f6-n82tt" podStartSLOduration=1.445394779 podStartE2EDuration="2.167052898s" totalImagesPullingTime="721.658119ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:21:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:21:10.166233632 +0000 UTC m=+772.466241151" watchObservedRunningTime="2026-09-09 23:21:10.167052898 +0000 UTC m=+772.467060415" Sep 09 23:21:10.196577 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:10.196539 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-zwxfd"] Sep 09 23:21:10.196804 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:10.196756 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-zwxfd" podUID="4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c" containerName="authorino" containerID="cri-o://b35d18da0795766da77fa0f596e47293172d76b2a9e94c25573910a52266eaef" gracePeriod=30 Sep 09 23:21:10.434431 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:10.434408 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-zwxfd" Sep 09 23:21:10.471704 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:10.471666 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nvkm\" (UniqueName: \"kubernetes.io/projected/4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c-kube-api-access-4nvkm\") pod \"4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c\" (UID: \"4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c\") " Sep 09 23:21:10.473651 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:10.473627 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c-kube-api-access-4nvkm" (OuterVolumeSpecName: "kube-api-access-4nvkm") pod "4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c" (UID: "4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c"). InnerVolumeSpecName "kube-api-access-4nvkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:21:10.572311 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:10.572285 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nvkm\" (UniqueName: \"kubernetes.io/projected/4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c-kube-api-access-4nvkm\") on node \"ip-10-0-143-228.ec2.internal\" DevicePath \"\"" Sep 09 23:21:11.158847 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:11.158815 2567 generic.go:356] "Generic (PLEG): container finished" podID="4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c" containerID="b35d18da0795766da77fa0f596e47293172d76b2a9e94c25573910a52266eaef" exitCode=0 Sep 09 23:21:11.159301 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:11.158862 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-zwxfd" Sep 09 23:21:11.159301 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:11.158906 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-zwxfd" event={"ID":"4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c","Type":"ContainerDied","Data":"b35d18da0795766da77fa0f596e47293172d76b2a9e94c25573910a52266eaef"} Sep 09 23:21:11.159301 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:11.158943 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-zwxfd" event={"ID":"4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c","Type":"ContainerDied","Data":"6ee049fafe7df00bbbb2e8df1169414a56ca8819bae96e6dca7a778e9c4760da"} Sep 09 23:21:11.159301 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:11.158963 2567 scope.go:117] "RemoveContainer" containerID="b35d18da0795766da77fa0f596e47293172d76b2a9e94c25573910a52266eaef" Sep 09 23:21:11.168010 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:11.167995 2567 scope.go:117] "RemoveContainer" containerID="b35d18da0795766da77fa0f596e47293172d76b2a9e94c25573910a52266eaef" Sep 09 23:21:11.168254 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:21:11.168233 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b35d18da0795766da77fa0f596e47293172d76b2a9e94c25573910a52266eaef\": container with ID starting with b35d18da0795766da77fa0f596e47293172d76b2a9e94c25573910a52266eaef not found: ID does not exist" containerID="b35d18da0795766da77fa0f596e47293172d76b2a9e94c25573910a52266eaef" Sep 09 23:21:11.168312 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:11.168262 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b35d18da0795766da77fa0f596e47293172d76b2a9e94c25573910a52266eaef"} err="failed to get container status \"b35d18da0795766da77fa0f596e47293172d76b2a9e94c25573910a52266eaef\": rpc error: code = NotFound desc = could not find container \"b35d18da0795766da77fa0f596e47293172d76b2a9e94c25573910a52266eaef\": container with ID starting with b35d18da0795766da77fa0f596e47293172d76b2a9e94c25573910a52266eaef not found: ID does not exist" Sep 09 23:21:11.179718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:11.179696 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-zwxfd"] Sep 09 23:21:11.181222 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:11.181201 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-zwxfd"] Sep 09 23:21:12.193308 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:12.193273 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c" path="/var/lib/kubelet/pods/4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c/volumes" Sep 09 23:21:14.898391 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:14.898347 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:14.976205 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:14.976173 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:15.045336 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:15.045300 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:15.419815 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:15.419783 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:15.655557 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:15.655508 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:19.141443 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:19.141396 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:19.245402 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:19.245347 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:27.775286 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:27.775236 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:50.843005 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:50.842918 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:50.941845 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:50.941808 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:52.400140 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:52.400103 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:52.501831 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:52.501793 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:52.590391 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:52.590360 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:52.689293 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:52.689210 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:53.009506 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.009476 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:53.109395 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.109362 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:53.123247 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.123214 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-vdglc"] Sep 09 23:21:53.123730 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.123699 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c" containerName="authorino" Sep 09 23:21:53.123730 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.123721 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c" containerName="authorino" Sep 09 23:21:53.124000 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.123796 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fcbb83a-a7c3-4115-8f0b-ec66d2fca91c" containerName="authorino" Sep 09 23:21:53.127007 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.126986 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vdglc" Sep 09 23:21:53.128949 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.128924 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 09 23:21:53.129103 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.128963 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 09 23:21:53.129483 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.129465 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pfb7k\"" Sep 09 23:21:53.129624 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.129559 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 09 23:21:53.138078 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.137916 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-vdglc"] Sep 09 23:21:53.155443 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.155410 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-xbnmx"] Sep 09 23:21:53.158959 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.158937 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-xbnmx" Sep 09 23:21:53.168553 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.168523 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-xbnmx"] Sep 09 23:21:53.216711 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.216682 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v96r2\" (UniqueName: \"kubernetes.io/projected/d5f24362-716e-4844-99e4-3c69f7498d09-kube-api-access-v96r2\") pod \"payload-pre-processing-59fbc47bf8-vdglc\" (UID: \"d5f24362-716e-4844-99e4-3c69f7498d09\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vdglc" Sep 09 23:21:53.216865 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.216721 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5f24362-716e-4844-99e4-3c69f7498d09-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-vdglc\" (UID: \"d5f24362-716e-4844-99e4-3c69f7498d09\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vdglc" Sep 09 23:21:53.216865 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.216750 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3a8ea64-34ac-458a-b9f2-e1374aa1922c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-xbnmx\" (UID: \"b3a8ea64-34ac-458a-b9f2-e1374aa1922c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xbnmx" Sep 09 23:21:53.216865 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.216771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4798n\" (UniqueName: \"kubernetes.io/projected/b3a8ea64-34ac-458a-b9f2-e1374aa1922c-kube-api-access-4798n\") pod \"payload-processing-5b54b7fbb7-xbnmx\" (UID: \"b3a8ea64-34ac-458a-b9f2-e1374aa1922c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xbnmx" Sep 09 23:21:53.317710 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.317625 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3a8ea64-34ac-458a-b9f2-e1374aa1922c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-xbnmx\" (UID: \"b3a8ea64-34ac-458a-b9f2-e1374aa1922c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xbnmx" Sep 09 23:21:53.317710 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.317666 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4798n\" (UniqueName: \"kubernetes.io/projected/b3a8ea64-34ac-458a-b9f2-e1374aa1922c-kube-api-access-4798n\") pod \"payload-processing-5b54b7fbb7-xbnmx\" (UID: \"b3a8ea64-34ac-458a-b9f2-e1374aa1922c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xbnmx" Sep 09 23:21:53.317928 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.317762 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v96r2\" (UniqueName: \"kubernetes.io/projected/d5f24362-716e-4844-99e4-3c69f7498d09-kube-api-access-v96r2\") pod \"payload-pre-processing-59fbc47bf8-vdglc\" (UID: \"d5f24362-716e-4844-99e4-3c69f7498d09\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vdglc" Sep 09 23:21:53.317928 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.317803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5f24362-716e-4844-99e4-3c69f7498d09-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-vdglc\" (UID: \"d5f24362-716e-4844-99e4-3c69f7498d09\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vdglc" Sep 09 23:21:53.318573 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.318549 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3a8ea64-34ac-458a-b9f2-e1374aa1922c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-xbnmx\" (UID: \"b3a8ea64-34ac-458a-b9f2-e1374aa1922c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xbnmx" Sep 09 23:21:53.318655 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.318559 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5f24362-716e-4844-99e4-3c69f7498d09-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-vdglc\" (UID: \"d5f24362-716e-4844-99e4-3c69f7498d09\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vdglc" Sep 09 23:21:53.325629 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.325582 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4798n\" (UniqueName: \"kubernetes.io/projected/b3a8ea64-34ac-458a-b9f2-e1374aa1922c-kube-api-access-4798n\") pod \"payload-processing-5b54b7fbb7-xbnmx\" (UID: \"b3a8ea64-34ac-458a-b9f2-e1374aa1922c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-xbnmx" Sep 09 23:21:53.325974 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.325950 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v96r2\" (UniqueName: \"kubernetes.io/projected/d5f24362-716e-4844-99e4-3c69f7498d09-kube-api-access-v96r2\") pod \"payload-pre-processing-59fbc47bf8-vdglc\" (UID: \"d5f24362-716e-4844-99e4-3c69f7498d09\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vdglc" Sep 09 23:21:53.439916 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.439871 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vdglc" Sep 09 23:21:53.473482 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.473443 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-xbnmx" Sep 09 23:21:53.718951 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.718924 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-vdglc"] Sep 09 23:21:53.721624 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:21:53.721577 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f24362_716e_4844_99e4_3c69f7498d09.slice/crio-9cdc08cf5605de3ca8ed3722c0e48309c840d5914d695f2d52232881418a0541 WatchSource:0}: Error finding container 9cdc08cf5605de3ca8ed3722c0e48309c840d5914d695f2d52232881418a0541: Status 404 returned error can't find the container with id 9cdc08cf5605de3ca8ed3722c0e48309c840d5914d695f2d52232881418a0541 Sep 09 23:21:53.764998 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:53.764976 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-xbnmx"] Sep 09 23:21:53.766662 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:21:53.766630 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a8ea64_34ac_458a_b9f2_e1374aa1922c.slice/crio-3b1176f177ea956b5ea38a4e7e3ecbc43808e5bac523f74e8a5f7d5de7cd94bf WatchSource:0}: Error finding container 3b1176f177ea956b5ea38a4e7e3ecbc43808e5bac523f74e8a5f7d5de7cd94bf: Status 404 returned error can't find the container with id 3b1176f177ea956b5ea38a4e7e3ecbc43808e5bac523f74e8a5f7d5de7cd94bf Sep 09 23:21:54.367875 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:54.367783 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vdglc" event={"ID":"d5f24362-716e-4844-99e4-3c69f7498d09","Type":"ContainerStarted","Data":"9cdc08cf5605de3ca8ed3722c0e48309c840d5914d695f2d52232881418a0541"} Sep 09 23:21:54.369735 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:54.369702 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-xbnmx" event={"ID":"b3a8ea64-34ac-458a-b9f2-e1374aa1922c","Type":"ContainerStarted","Data":"3b1176f177ea956b5ea38a4e7e3ecbc43808e5bac523f74e8a5f7d5de7cd94bf"} Sep 09 23:21:56.382150 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:56.382109 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vdglc" event={"ID":"d5f24362-716e-4844-99e4-3c69f7498d09","Type":"ContainerStarted","Data":"d6aafbb2cf86c7aa61d1b7b7ecb065328c1a92951407f6d93b077f9ec4239e14"} Sep 09 23:21:56.382733 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:56.382201 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vdglc" Sep 09 23:21:56.383775 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:56.383750 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-xbnmx" event={"ID":"b3a8ea64-34ac-458a-b9f2-e1374aa1922c","Type":"ContainerStarted","Data":"99a4545a78e19389b2d1f024d9b71277ae880bd094f6c180585fc6bb6e7a4c70"} Sep 09 23:21:56.383868 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:56.383848 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-xbnmx" Sep 09 23:21:56.397965 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:56.397919 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vdglc" podStartSLOduration=1.470483474 podStartE2EDuration="3.397905181s" totalImagesPullingTime="1.927421707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:21:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:21:56.395974968 +0000 UTC m=+818.695982486" watchObservedRunningTime="2026-09-09 23:21:56.397905181 +0000 UTC m=+818.697912699" Sep 09 23:21:56.413408 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:21:56.413365 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-xbnmx" podStartSLOduration=1.524990278 podStartE2EDuration="3.413351793s" totalImagesPullingTime="1.888361515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:21:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:21:56.411880622 +0000 UTC m=+818.711888140" watchObservedRunningTime="2026-09-09 23:21:56.413351793 +0000 UTC m=+818.713359311" Sep 09 23:22:02.699674 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:02.699632 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:02.805718 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:02.805685 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:07.391122 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:07.391091 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-xbnmx" Sep 09 23:22:07.391520 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:07.391158 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vdglc" Sep 09 23:22:18.107882 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.107854 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8"] Sep 09 23:22:18.110995 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.110975 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.113350 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.113326 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n6sp2\"" Sep 09 23:22:18.113459 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.113330 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 09 23:22:18.113459 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.113371 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 09 23:22:18.113459 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.113385 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 09 23:22:18.120868 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.120846 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8"] Sep 09 23:22:18.216410 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.216378 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:18.223477 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.223453 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288e2c0f-422c-4487-935c-f9e992c57cc2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.223579 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.223490 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/288e2c0f-422c-4487-935c-f9e992c57cc2-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.223641 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.223583 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/288e2c0f-422c-4487-935c-f9e992c57cc2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.223677 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.223640 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/288e2c0f-422c-4487-935c-f9e992c57cc2-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.223739 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.223723 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/288e2c0f-422c-4487-935c-f9e992c57cc2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.223779 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.223752 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbn5h\" (UniqueName: \"kubernetes.io/projected/288e2c0f-422c-4487-935c-f9e992c57cc2-kube-api-access-vbn5h\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.324306 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.324274 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/288e2c0f-422c-4487-935c-f9e992c57cc2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.324306 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.324310 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/288e2c0f-422c-4487-935c-f9e992c57cc2-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.324525 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.324346 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/288e2c0f-422c-4487-935c-f9e992c57cc2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.324525 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.324378 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbn5h\" (UniqueName: \"kubernetes.io/projected/288e2c0f-422c-4487-935c-f9e992c57cc2-kube-api-access-vbn5h\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.324525 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.324433 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288e2c0f-422c-4487-935c-f9e992c57cc2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.324525 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.324508 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/288e2c0f-422c-4487-935c-f9e992c57cc2-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.324770 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.324728 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/288e2c0f-422c-4487-935c-f9e992c57cc2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.324965 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.324945 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/288e2c0f-422c-4487-935c-f9e992c57cc2-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.325068 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.325032 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/288e2c0f-422c-4487-935c-f9e992c57cc2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.326628 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.326578 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/288e2c0f-422c-4487-935c-f9e992c57cc2-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.326955 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.326939 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/288e2c0f-422c-4487-935c-f9e992c57cc2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.333149 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.333124 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbn5h\" (UniqueName: \"kubernetes.io/projected/288e2c0f-422c-4487-935c-f9e992c57cc2-kube-api-access-vbn5h\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jpdl8\" (UID: \"288e2c0f-422c-4487-935c-f9e992c57cc2\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.421862 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.421786 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:18.693320 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:18.693245 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8"] Sep 09 23:22:18.696089 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:22:18.696043 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod288e2c0f_422c_4487_935c_f9e992c57cc2.slice/crio-6e98d35c5f2018321b25e2838bdadb5a05aac516617b69963cc2356067068b69 WatchSource:0}: Error finding container 6e98d35c5f2018321b25e2838bdadb5a05aac516617b69963cc2356067068b69: Status 404 returned error can't find the container with id 6e98d35c5f2018321b25e2838bdadb5a05aac516617b69963cc2356067068b69 Sep 09 23:22:19.505733 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:19.505667 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" event={"ID":"288e2c0f-422c-4487-935c-f9e992c57cc2","Type":"ContainerStarted","Data":"6e98d35c5f2018321b25e2838bdadb5a05aac516617b69963cc2356067068b69"} Sep 09 23:22:20.512536 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:20.512501 2567 generic.go:356] "Generic (PLEG): container finished" podID="288e2c0f-422c-4487-935c-f9e992c57cc2" containerID="7091140de202e20822a039748831aad3d089ed1fccbb073ff6fa2a30d30cfe74" exitCode=0 Sep 09 23:22:20.512913 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:20.512544 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" event={"ID":"288e2c0f-422c-4487-935c-f9e992c57cc2","Type":"ContainerDied","Data":"7091140de202e20822a039748831aad3d089ed1fccbb073ff6fa2a30d30cfe74"} Sep 09 23:22:20.512913 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:20.512823 2567 scope.go:117] "RemoveContainer" containerID="7091140de202e20822a039748831aad3d089ed1fccbb073ff6fa2a30d30cfe74" Sep 09 23:22:21.519562 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:21.519528 2567 generic.go:356] "Generic (PLEG): container finished" podID="288e2c0f-422c-4487-935c-f9e992c57cc2" containerID="20048bd9083564a1cf446185e26efd911763fa5d2f3010798141393158e366cf" exitCode=0 Sep 09 23:22:21.520035 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:21.519609 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" event={"ID":"288e2c0f-422c-4487-935c-f9e992c57cc2","Type":"ContainerDied","Data":"20048bd9083564a1cf446185e26efd911763fa5d2f3010798141393158e366cf"} Sep 09 23:22:21.520035 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:21.519668 2567 scope.go:117] "RemoveContainer" containerID="7091140de202e20822a039748831aad3d089ed1fccbb073ff6fa2a30d30cfe74" Sep 09 23:22:21.520035 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:21.519915 2567 scope.go:117] "RemoveContainer" containerID="20048bd9083564a1cf446185e26efd911763fa5d2f3010798141393158e366cf" Sep 09 23:22:21.520198 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:22:21.520099 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:22:22.526361 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:22.526332 2567 scope.go:117] "RemoveContainer" containerID="20048bd9083564a1cf446185e26efd911763fa5d2f3010798141393158e366cf" Sep 09 23:22:22.526733 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:22:22.526507 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:22:27.418917 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:27.418884 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:28.422067 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:28.422032 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:28.422475 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:28.422101 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:28.422475 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:28.422127 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:28.422475 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:28.422149 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:28.422662 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:28.422642 2567 scope.go:117] "RemoveContainer" containerID="20048bd9083564a1cf446185e26efd911763fa5d2f3010798141393158e366cf" Sep 09 23:22:28.422945 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:22:28.422914 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:22:41.188182 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:41.188133 2567 scope.go:117] "RemoveContainer" containerID="20048bd9083564a1cf446185e26efd911763fa5d2f3010798141393158e366cf" Sep 09 23:22:41.624411 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:41.624380 2567 generic.go:356] "Generic (PLEG): container finished" podID="288e2c0f-422c-4487-935c-f9e992c57cc2" containerID="dd69285be390fba626e443affc0ab83af47828ff4eea8561bbb165e9b494178f" exitCode=0 Sep 09 23:22:41.624584 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:41.624458 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" event={"ID":"288e2c0f-422c-4487-935c-f9e992c57cc2","Type":"ContainerDied","Data":"dd69285be390fba626e443affc0ab83af47828ff4eea8561bbb165e9b494178f"} Sep 09 23:22:41.624584 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:41.624531 2567 scope.go:117] "RemoveContainer" containerID="20048bd9083564a1cf446185e26efd911763fa5d2f3010798141393158e366cf" Sep 09 23:22:41.624953 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:41.624931 2567 scope.go:117] "RemoveContainer" containerID="dd69285be390fba626e443affc0ab83af47828ff4eea8561bbb165e9b494178f" Sep 09 23:22:41.625148 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:22:41.625127 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:22:48.187527 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:48.187482 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:48.422523 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:48.422487 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:48.422721 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:48.422551 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:48.422721 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:48.422572 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:48.422721 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:48.422611 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:22:48.423069 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:48.423047 2567 scope.go:117] "RemoveContainer" containerID="dd69285be390fba626e443affc0ab83af47828ff4eea8561bbb165e9b494178f" Sep 09 23:22:48.423257 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:22:48.423238 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:22:48.658575 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:48.658550 2567 scope.go:117] "RemoveContainer" containerID="dd69285be390fba626e443affc0ab83af47828ff4eea8561bbb165e9b494178f" Sep 09 23:22:48.658756 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:22:48.658738 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:22:54.752307 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:54.752273 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:59.188989 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:22:59.188956 2567 scope.go:117] "RemoveContainer" containerID="dd69285be390fba626e443affc0ab83af47828ff4eea8561bbb165e9b494178f" Sep 09 23:22:59.189426 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:22:59.189125 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:23:08.304691 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.304654 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g"] Sep 09 23:23:08.310715 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.310690 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.313466 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.313446 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 09 23:23:08.320204 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.320159 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g"] Sep 09 23:23:08.355893 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.355851 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:08.443396 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.443364 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a6fd4d4-53d6-4801-b1f6-69739aa97545-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.443502 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.443403 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a6fd4d4-53d6-4801-b1f6-69739aa97545-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.443502 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.443459 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a6fd4d4-53d6-4801-b1f6-69739aa97545-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.443576 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.443509 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a6fd4d4-53d6-4801-b1f6-69739aa97545-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.443576 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.443532 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rmdf\" (UniqueName: \"kubernetes.io/projected/8a6fd4d4-53d6-4801-b1f6-69739aa97545-kube-api-access-8rmdf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.443684 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.443632 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a6fd4d4-53d6-4801-b1f6-69739aa97545-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.544813 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.544778 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a6fd4d4-53d6-4801-b1f6-69739aa97545-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.544990 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.544833 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a6fd4d4-53d6-4801-b1f6-69739aa97545-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.544990 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.544871 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a6fd4d4-53d6-4801-b1f6-69739aa97545-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.544990 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.544901 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rmdf\" (UniqueName: \"kubernetes.io/projected/8a6fd4d4-53d6-4801-b1f6-69739aa97545-kube-api-access-8rmdf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.544990 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.544943 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a6fd4d4-53d6-4801-b1f6-69739aa97545-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.545192 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.545006 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a6fd4d4-53d6-4801-b1f6-69739aa97545-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.545249 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.545195 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a6fd4d4-53d6-4801-b1f6-69739aa97545-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.545306 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.545261 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a6fd4d4-53d6-4801-b1f6-69739aa97545-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.545434 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.545414 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a6fd4d4-53d6-4801-b1f6-69739aa97545-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.547122 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.547093 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a6fd4d4-53d6-4801-b1f6-69739aa97545-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.547361 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.547342 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a6fd4d4-53d6-4801-b1f6-69739aa97545-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.552693 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.552663 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rmdf\" (UniqueName: \"kubernetes.io/projected/8a6fd4d4-53d6-4801-b1f6-69739aa97545-kube-api-access-8rmdf\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gnx6g\" (UID: \"8a6fd4d4-53d6-4801-b1f6-69739aa97545\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.644211 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.644147 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:08.913792 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:08.913699 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g"] Sep 09 23:23:08.915953 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:23:08.915925 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a6fd4d4_53d6_4801_b1f6_69739aa97545.slice/crio-85c59176e720dff00cbe1bc5d719ebe8e365fbf2bd7faaa03f220f84ed12954f WatchSource:0}: Error finding container 85c59176e720dff00cbe1bc5d719ebe8e365fbf2bd7faaa03f220f84ed12954f: Status 404 returned error can't find the container with id 85c59176e720dff00cbe1bc5d719ebe8e365fbf2bd7faaa03f220f84ed12954f Sep 09 23:23:09.766376 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:09.766335 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" event={"ID":"8a6fd4d4-53d6-4801-b1f6-69739aa97545","Type":"ContainerStarted","Data":"834af73080b398f7f1c1eb33a1f50676b9752d8f1dc14b3e06e55e70d03e8ddd"} Sep 09 23:23:09.766880 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:09.766399 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" event={"ID":"8a6fd4d4-53d6-4801-b1f6-69739aa97545","Type":"ContainerStarted","Data":"85c59176e720dff00cbe1bc5d719ebe8e365fbf2bd7faaa03f220f84ed12954f"} Sep 09 23:23:09.785760 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:09.785696 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" podStartSLOduration=1.6070504570000002 podStartE2EDuration="1.785675691s" totalImagesPullingTime="178.625234ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:09.784641292 +0000 UTC m=+892.084648823" watchObservedRunningTime="2026-09-09 23:23:09.785675691 +0000 UTC m=+892.085683213" Sep 09 23:23:13.188479 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.188393 2567 scope.go:117] "RemoveContainer" containerID="dd69285be390fba626e443affc0ab83af47828ff4eea8561bbb165e9b494178f" Sep 09 23:23:13.788581 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.788550 2567 generic.go:356] "Generic (PLEG): container finished" podID="288e2c0f-422c-4487-935c-f9e992c57cc2" containerID="5e6cb3e859022c9d8f2203c5365c50f9c6ce3daf546e90a46e39d38a91c7b865" exitCode=0 Sep 09 23:23:13.788770 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.788637 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" event={"ID":"288e2c0f-422c-4487-935c-f9e992c57cc2","Type":"ContainerDied","Data":"5e6cb3e859022c9d8f2203c5365c50f9c6ce3daf546e90a46e39d38a91c7b865"} Sep 09 23:23:13.788770 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.788698 2567 scope.go:117] "RemoveContainer" containerID="dd69285be390fba626e443affc0ab83af47828ff4eea8561bbb165e9b494178f" Sep 09 23:23:13.789051 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.789030 2567 scope.go:117] "RemoveContainer" containerID="5e6cb3e859022c9d8f2203c5365c50f9c6ce3daf546e90a46e39d38a91c7b865" Sep 09 23:23:13.789244 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:23:13.789221 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:23:13.806011 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.805983 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q"] Sep 09 23:23:13.810760 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.810736 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.812616 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.812578 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 09 23:23:13.818347 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.818328 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q"] Sep 09 23:23:13.887635 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.887601 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d903cd18-1128-45a8-9867-105d9b8bafbe-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.887824 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.887685 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d903cd18-1128-45a8-9867-105d9b8bafbe-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.887824 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.887719 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d903cd18-1128-45a8-9867-105d9b8bafbe-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.887824 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.887767 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d903cd18-1128-45a8-9867-105d9b8bafbe-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.887995 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.887862 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpf5c\" (UniqueName: \"kubernetes.io/projected/d903cd18-1128-45a8-9867-105d9b8bafbe-kube-api-access-zpf5c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.887995 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.887962 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d903cd18-1128-45a8-9867-105d9b8bafbe-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.906393 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.906365 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:13.988981 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.988953 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpf5c\" (UniqueName: \"kubernetes.io/projected/d903cd18-1128-45a8-9867-105d9b8bafbe-kube-api-access-zpf5c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.989143 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.988986 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d903cd18-1128-45a8-9867-105d9b8bafbe-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.989143 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.989033 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d903cd18-1128-45a8-9867-105d9b8bafbe-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.989143 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.989052 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d903cd18-1128-45a8-9867-105d9b8bafbe-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.989143 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.989071 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d903cd18-1128-45a8-9867-105d9b8bafbe-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.989143 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.989099 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d903cd18-1128-45a8-9867-105d9b8bafbe-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.989465 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.989442 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d903cd18-1128-45a8-9867-105d9b8bafbe-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.989528 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.989476 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d903cd18-1128-45a8-9867-105d9b8bafbe-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.989528 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.989510 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d903cd18-1128-45a8-9867-105d9b8bafbe-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.991295 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.991274 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d903cd18-1128-45a8-9867-105d9b8bafbe-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.991638 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.991621 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d903cd18-1128-45a8-9867-105d9b8bafbe-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:13.996443 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:13.996422 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpf5c\" (UniqueName: \"kubernetes.io/projected/d903cd18-1128-45a8-9867-105d9b8bafbe-kube-api-access-zpf5c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q\" (UID: \"d903cd18-1128-45a8-9867-105d9b8bafbe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:14.122091 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:14.122016 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:14.397168 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:14.397133 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q"] Sep 09 23:23:14.398903 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:23:14.398878 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd903cd18_1128_45a8_9867_105d9b8bafbe.slice/crio-0a4204786171316660971cd94e8420926a0d9ab232eda51d2a579e7dcfdc6a2c WatchSource:0}: Error finding container 0a4204786171316660971cd94e8420926a0d9ab232eda51d2a579e7dcfdc6a2c: Status 404 returned error can't find the container with id 0a4204786171316660971cd94e8420926a0d9ab232eda51d2a579e7dcfdc6a2c Sep 09 23:23:14.794621 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:14.794573 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" event={"ID":"d903cd18-1128-45a8-9867-105d9b8bafbe","Type":"ContainerStarted","Data":"f549bae52c03384c4102869f12f9c92014d3ae25f703a1791d1b04da3461d753"} Sep 09 23:23:14.794813 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:14.794647 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" event={"ID":"d903cd18-1128-45a8-9867-105d9b8bafbe","Type":"ContainerStarted","Data":"0a4204786171316660971cd94e8420926a0d9ab232eda51d2a579e7dcfdc6a2c"} Sep 09 23:23:14.811055 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:14.811002 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" podStartSLOduration=1.643196359 podStartE2EDuration="1.810989129s" totalImagesPullingTime="167.79277ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:14.809615273 +0000 UTC m=+897.109622788" watchObservedRunningTime="2026-09-09 23:23:14.810989129 +0000 UTC m=+897.110996647" Sep 09 23:23:18.422710 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:18.422678 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:23:18.423069 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:18.422734 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:23:18.423069 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:18.422748 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:23:18.423069 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:18.422762 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:23:18.423192 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:18.423148 2567 scope.go:117] "RemoveContainer" containerID="5e6cb3e859022c9d8f2203c5365c50f9c6ce3daf546e90a46e39d38a91c7b865" Sep 09 23:23:18.423368 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:23:18.423348 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:23:18.645042 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:18.645011 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:18.645199 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:18.645075 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:18.658046 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:18.658019 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:18.829226 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:18.829196 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gnx6g" Sep 09 23:23:19.007782 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:19.007750 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ssjfn_2bcce2b0-0bd1-493e-b472-53b50f753f72/console-operator/2.log" Sep 09 23:23:19.009671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:19.009648 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ssjfn_2bcce2b0-0bd1-493e-b472-53b50f753f72/console-operator/2.log" Sep 09 23:23:24.122930 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:24.122895 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:24.123770 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:24.122959 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:24.135881 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:24.135851 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:24.862937 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:24.862904 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q" Sep 09 23:23:25.143117 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:25.143043 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:32.946954 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:32.946915 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:34.188122 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:34.188092 2567 scope.go:117] "RemoveContainer" containerID="5e6cb3e859022c9d8f2203c5365c50f9c6ce3daf546e90a46e39d38a91c7b865" Sep 09 23:23:34.188626 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:23:34.188250 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:23:49.188860 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:23:49.188829 2567 scope.go:117] "RemoveContainer" containerID="5e6cb3e859022c9d8f2203c5365c50f9c6ce3daf546e90a46e39d38a91c7b865" Sep 09 23:23:49.189338 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:23:49.189052 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:24:00.187966 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:00.187937 2567 scope.go:117] "RemoveContainer" containerID="5e6cb3e859022c9d8f2203c5365c50f9c6ce3daf546e90a46e39d38a91c7b865" Sep 09 23:24:01.042961 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:01.042927 2567 generic.go:356] "Generic (PLEG): container finished" podID="288e2c0f-422c-4487-935c-f9e992c57cc2" containerID="0d18c1c0bf84b0c9d6a655be30029b13a3fc8efe4eb7c8251d71d1524fda84bf" exitCode=0 Sep 09 23:24:01.042961 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:01.042965 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" event={"ID":"288e2c0f-422c-4487-935c-f9e992c57cc2","Type":"ContainerDied","Data":"0d18c1c0bf84b0c9d6a655be30029b13a3fc8efe4eb7c8251d71d1524fda84bf"} Sep 09 23:24:01.043223 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:01.043011 2567 scope.go:117] "RemoveContainer" containerID="5e6cb3e859022c9d8f2203c5365c50f9c6ce3daf546e90a46e39d38a91c7b865" Sep 09 23:24:01.043386 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:01.043366 2567 scope.go:117] "RemoveContainer" containerID="0d18c1c0bf84b0c9d6a655be30029b13a3fc8efe4eb7c8251d71d1524fda84bf" Sep 09 23:24:01.043659 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:24:01.043628 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:24:05.766666 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:05.766629 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:05.823281 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:05.823251 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:08.422068 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:08.422039 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:24:08.422450 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:08.422100 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:24:08.422450 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:08.422120 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:24:08.422450 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:08.422132 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:24:08.422555 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:08.422459 2567 scope.go:117] "RemoveContainer" containerID="0d18c1c0bf84b0c9d6a655be30029b13a3fc8efe4eb7c8251d71d1524fda84bf" Sep 09 23:24:08.422668 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:24:08.422645 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:24:18.006006 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:18.005957 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:18.066351 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:18.066321 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:22.198055 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:22.198025 2567 scope.go:117] "RemoveContainer" containerID="0d18c1c0bf84b0c9d6a655be30029b13a3fc8efe4eb7c8251d71d1524fda84bf" Sep 09 23:24:22.198437 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:24:22.198217 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:24:32.856932 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:32.856896 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:37.188306 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:37.188274 2567 scope.go:117] "RemoveContainer" containerID="0d18c1c0bf84b0c9d6a655be30029b13a3fc8efe4eb7c8251d71d1524fda84bf" Sep 09 23:24:37.188808 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:24:37.188459 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:24:49.188580 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:24:49.188505 2567 scope.go:117] "RemoveContainer" containerID="0d18c1c0bf84b0c9d6a655be30029b13a3fc8efe4eb7c8251d71d1524fda84bf" Sep 09 23:24:49.188957 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:24:49.188727 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:25:00.188566 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:25:00.188528 2567 scope.go:117] "RemoveContainer" containerID="0d18c1c0bf84b0c9d6a655be30029b13a3fc8efe4eb7c8251d71d1524fda84bf" Sep 09 23:25:00.188963 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:25:00.188771 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:25:11.188323 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:25:11.188293 2567 scope.go:117] "RemoveContainer" containerID="0d18c1c0bf84b0c9d6a655be30029b13a3fc8efe4eb7c8251d71d1524fda84bf" Sep 09 23:25:11.188819 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:25:11.188480 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:25:25.188783 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:25:25.188751 2567 scope.go:117] "RemoveContainer" containerID="0d18c1c0bf84b0c9d6a655be30029b13a3fc8efe4eb7c8251d71d1524fda84bf" Sep 09 23:25:25.189158 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:25:25.189032 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:25:25.448722 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:25:25.448660 2567 generic.go:356] "Generic (PLEG): container finished" podID="288e2c0f-422c-4487-935c-f9e992c57cc2" containerID="623f87c2b130c6e73d248c1424101550e0b28c8c15f310c6abe079e667d77232" exitCode=0 Sep 09 23:25:25.448821 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:25:25.448733 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" event={"ID":"288e2c0f-422c-4487-935c-f9e992c57cc2","Type":"ContainerDied","Data":"623f87c2b130c6e73d248c1424101550e0b28c8c15f310c6abe079e667d77232"} Sep 09 23:25:25.448821 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:25:25.448793 2567 scope.go:117] "RemoveContainer" containerID="0d18c1c0bf84b0c9d6a655be30029b13a3fc8efe4eb7c8251d71d1524fda84bf" Sep 09 23:25:25.449181 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:25:25.449161 2567 scope.go:117] "RemoveContainer" containerID="623f87c2b130c6e73d248c1424101550e0b28c8c15f310c6abe079e667d77232" Sep 09 23:25:25.449400 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:25:25.449382 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:25:28.421932 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:25:28.421901 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:25:28.422413 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:25:28.421965 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:25:28.422413 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:25:28.421986 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:25:28.422413 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:25:28.422004 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" Sep 09 23:25:28.422585 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:25:28.422406 2567 scope.go:117] "RemoveContainer" containerID="623f87c2b130c6e73d248c1424101550e0b28c8c15f310c6abe079e667d77232" Sep 09 23:25:28.422703 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:25:28.422678 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:25:43.188697 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:25:43.188662 2567 scope.go:117] "RemoveContainer" containerID="623f87c2b130c6e73d248c1424101550e0b28c8c15f310c6abe079e667d77232" Sep 09 23:25:43.189174 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:25:43.188826 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:25:58.194283 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:25:58.194245 2567 scope.go:117] "RemoveContainer" containerID="623f87c2b130c6e73d248c1424101550e0b28c8c15f310c6abe079e667d77232" Sep 09 23:25:58.194764 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:25:58.194474 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:26:11.188342 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:26:11.188251 2567 scope.go:117] "RemoveContainer" containerID="623f87c2b130c6e73d248c1424101550e0b28c8c15f310c6abe079e667d77232" Sep 09 23:26:11.188777 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:26:11.188467 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:26:26.188262 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:26:26.188224 2567 scope.go:117] "RemoveContainer" containerID="623f87c2b130c6e73d248c1424101550e0b28c8c15f310c6abe079e667d77232" Sep 09 23:26:26.188835 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:26:26.188477 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:26:31.650533 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:26:31.650497 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:39.188321 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:26:39.188288 2567 scope.go:117] "RemoveContainer" containerID="623f87c2b130c6e73d248c1424101550e0b28c8c15f310c6abe079e667d77232" Sep 09 23:26:39.188724 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:26:39.188458 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:26:41.985068 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:26:41.985031 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:42.829929 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:26:42.829892 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:42.931277 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:26:42.931243 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:44.445431 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:26:44.445392 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:44.545768 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:26:44.545739 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:53.188966 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:26:53.188937 2567 scope.go:117] "RemoveContainer" containerID="623f87c2b130c6e73d248c1424101550e0b28c8c15f310c6abe079e667d77232" Sep 09 23:26:53.189328 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:26:53.189121 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:27:07.081683 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:07.081653 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c8db477f6-n82tt_4025f39a-ea69-4ab3-a67a-bb012b0a7283/authorino/0.log" Sep 09 23:27:08.190360 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:08.190320 2567 scope.go:117] "RemoveContainer" containerID="623f87c2b130c6e73d248c1424101550e0b28c8c15f310c6abe079e667d77232" Sep 09 23:27:08.190846 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:27:08.190493 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:27:12.364085 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:12.364051 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9b48k_158a1ed6-f6be-48ab-9ffe-3399a96fe8e5/manager/0.log" Sep 09 23:27:12.477183 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:12.477150 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kqsqj_1dbd9432-d2b6-4e59-9eb7-08fa149b0c36/manager/0.log" Sep 09 23:27:12.954758 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:12.954710 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fd95c47c-g8hsd_3b8903f2-8401-46e4-bfb0-de3a5c8d14f5/manager/0.log" Sep 09 23:27:12.961418 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:12.961392 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fd95c47c-g8hsd_3b8903f2-8401-46e4-bfb0-de3a5c8d14f5/copy-manifests/0.log" Sep 09 23:27:14.448463 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:14.448433 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c8db477f6-n82tt_4025f39a-ea69-4ab3-a67a-bb012b0a7283/authorino/0.log" Sep 09 23:27:14.671317 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:14.671287 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-t8ppw_7f3d547e-4ccc-4f20-a9fa-1ccfc551c3a1/manager/0.log" Sep 09 23:27:14.900581 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:14.900547 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-bkx25_530e850b-3ebb-47bb-a568-09b5aa04a7ce/manager/0.log" Sep 09 23:27:15.135779 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:15.135746 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-dsxw8_0dafe2d3-2c1e-4681-902b-4fa1d94f6fa0/manager/0.log" Sep 09 23:27:16.066110 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:16.066078 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-vdglc_d5f24362-716e-4844-99e4-3c69f7498d09/payload-pre-processing/0.log" Sep 09 23:27:16.182385 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:16.182355 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-xbnmx_b3a8ea64-34ac-458a-b9f2-e1374aa1922c/payload-processing/0.log" Sep 09 23:27:16.653618 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:16.653562 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-859856b874-jpdl8_288e2c0f-422c-4487-935c-f9e992c57cc2/main/5.log" Sep 09 23:27:17.021504 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:17.021471 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-gnx6g_8a6fd4d4-53d6-4801-b1f6-69739aa97545/main/0.log" Sep 09 23:27:17.136277 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:17.136246 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmzz8q_d903cd18-1128-45a8-9867-105d9b8bafbe/main/0.log" Sep 09 23:27:19.188764 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:19.188735 2567 scope.go:117] "RemoveContainer" containerID="623f87c2b130c6e73d248c1424101550e0b28c8c15f310c6abe079e667d77232" Sep 09 23:27:19.189129 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:27:19.188916 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:27:23.344051 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:23.344013 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:27:23.419496 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:23.419462 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" limit=1024 Sep 09 23:27:26.459573 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:26.459544 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-skd4w_f7f994f2-a498-4d06-8a5c-f14c842b48a9/global-pull-secret-syncer/0.log" Sep 09 23:27:26.500671 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:26.500646 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pt9ht_0195649c-31a5-4859-9643-26ae90ab325a/konnectivity-agent/0.log" Sep 09 23:27:26.616504 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:26.616477 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-228.ec2.internal_728b04a33548859b274bbec2cc5b3fee/haproxy/0.log" Sep 09 23:27:30.731792 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:30.731761 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c8db477f6-n82tt_4025f39a-ea69-4ab3-a67a-bb012b0a7283/authorino/0.log" Sep 09 23:27:30.810995 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:30.810966 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-t8ppw_7f3d547e-4ccc-4f20-a9fa-1ccfc551c3a1/manager/0.log" Sep 09 23:27:30.881658 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:30.881627 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-bkx25_530e850b-3ebb-47bb-a568-09b5aa04a7ce/manager/0.log" Sep 09 23:27:30.949289 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:30.949265 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-dsxw8_0dafe2d3-2c1e-4681-902b-4fa1d94f6fa0/manager/0.log" Sep 09 23:27:31.188575 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:31.188497 2567 scope.go:117] "RemoveContainer" containerID="623f87c2b130c6e73d248c1424101550e0b28c8c15f310c6abe079e667d77232" Sep 09 23:27:31.188740 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:27:31.188717 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:27:32.788835 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:32.788808 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-q9l5r_b698db08-6f86-4c21-ac42-70e7eefba846/cluster-monitoring-operator/0.log" Sep 09 23:27:32.862738 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:32.862709 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-wrgbq_6600f6ca-bb13-4b3d-b067-e34fa983f21b/kube-state-metrics/0.log" Sep 09 23:27:32.922404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:32.922362 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-wrgbq_6600f6ca-bb13-4b3d-b067-e34fa983f21b/kube-rbac-proxy-main/0.log" Sep 09 23:27:32.945545 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:32.945521 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-wrgbq_6600f6ca-bb13-4b3d-b067-e34fa983f21b/kube-rbac-proxy-self/0.log" Sep 09 23:27:33.123957 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:33.123856 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cj6xd_18d8a16c-8fef-4299-be92-ccc4447b5d72/node-exporter/0.log" Sep 09 23:27:33.147074 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:33.147040 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cj6xd_18d8a16c-8fef-4299-be92-ccc4447b5d72/kube-rbac-proxy/0.log" Sep 09 23:27:33.167929 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:33.167907 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cj6xd_18d8a16c-8fef-4299-be92-ccc4447b5d72/init-textfile/0.log" Sep 09 23:27:33.268748 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:33.268722 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-n69zm_f8a225a8-9ad1-4095-9289-e345b477aece/kube-rbac-proxy-main/0.log" Sep 09 23:27:33.290742 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:33.290718 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-n69zm_f8a225a8-9ad1-4095-9289-e345b477aece/kube-rbac-proxy-self/0.log" Sep 09 23:27:33.311108 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:33.311083 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-n69zm_f8a225a8-9ad1-4095-9289-e345b477aece/openshift-state-metrics/0.log" Sep 09 23:27:33.348857 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:33.348834 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6b4906a8-9df5-4af8-babe-1c9ab2301c88/prometheus/0.log" Sep 09 23:27:33.372978 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:33.372954 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6b4906a8-9df5-4af8-babe-1c9ab2301c88/config-reloader/0.log" Sep 09 23:27:33.393828 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:33.393773 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6b4906a8-9df5-4af8-babe-1c9ab2301c88/thanos-sidecar/0.log" Sep 09 23:27:33.416545 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:33.416526 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6b4906a8-9df5-4af8-babe-1c9ab2301c88/kube-rbac-proxy-web/0.log" Sep 09 23:27:33.436504 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:33.436484 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6b4906a8-9df5-4af8-babe-1c9ab2301c88/kube-rbac-proxy/0.log" Sep 09 23:27:33.455446 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:33.455428 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6b4906a8-9df5-4af8-babe-1c9ab2301c88/kube-rbac-proxy-thanos/0.log" Sep 09 23:27:33.474468 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:33.474450 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6b4906a8-9df5-4af8-babe-1c9ab2301c88/init-config-reloader/0.log" Sep 09 23:27:33.500448 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:33.500425 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-l958n_0058bb86-72c9-4276-9e06-aa1d7b7897c3/prometheus-operator/0.log" Sep 09 23:27:33.520074 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:33.520052 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-l958n_0058bb86-72c9-4276-9e06-aa1d7b7897c3/kube-rbac-proxy/0.log" Sep 09 23:27:33.555011 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:33.554985 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-s799d_a762f6a3-990f-4fcf-8fb4-e37ff174fb81/prometheus-operator-admission-webhook/0.log" Sep 09 23:27:35.837650 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:35.837611 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ssjfn_2bcce2b0-0bd1-493e-b472-53b50f753f72/console-operator/2.log" Sep 09 23:27:35.841705 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:35.841685 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ssjfn_2bcce2b0-0bd1-493e-b472-53b50f753f72/console-operator/3.log" Sep 09 23:27:36.319565 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.319526 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn"] Sep 09 23:27:36.323580 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.323555 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:36.325571 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.325551 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h2lnk\"/\"openshift-service-ca.crt\"" Sep 09 23:27:36.325571 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.325555 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h2lnk\"/\"kube-root-ca.crt\"" Sep 09 23:27:36.325711 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.325650 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h2lnk\"/\"default-dockercfg-2mqrr\"" Sep 09 23:27:36.331697 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.331673 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn"] Sep 09 23:27:36.436538 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.436503 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84628b1f-e995-4819-ad0b-4c42ecfc67ec-lib-modules\") pod \"perf-node-gather-daemonset-wjfrn\" (UID: \"84628b1f-e995-4819-ad0b-4c42ecfc67ec\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:36.436692 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.436639 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74sp4\" (UniqueName: \"kubernetes.io/projected/84628b1f-e995-4819-ad0b-4c42ecfc67ec-kube-api-access-74sp4\") pod \"perf-node-gather-daemonset-wjfrn\" (UID: \"84628b1f-e995-4819-ad0b-4c42ecfc67ec\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:36.436692 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.436668 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84628b1f-e995-4819-ad0b-4c42ecfc67ec-sys\") pod \"perf-node-gather-daemonset-wjfrn\" (UID: \"84628b1f-e995-4819-ad0b-4c42ecfc67ec\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:36.436791 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.436702 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84628b1f-e995-4819-ad0b-4c42ecfc67ec-podres\") pod \"perf-node-gather-daemonset-wjfrn\" (UID: \"84628b1f-e995-4819-ad0b-4c42ecfc67ec\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:36.436791 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.436752 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84628b1f-e995-4819-ad0b-4c42ecfc67ec-proc\") pod \"perf-node-gather-daemonset-wjfrn\" (UID: \"84628b1f-e995-4819-ad0b-4c42ecfc67ec\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:36.537868 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.537838 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84628b1f-e995-4819-ad0b-4c42ecfc67ec-proc\") pod \"perf-node-gather-daemonset-wjfrn\" (UID: \"84628b1f-e995-4819-ad0b-4c42ecfc67ec\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:36.537995 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.537892 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84628b1f-e995-4819-ad0b-4c42ecfc67ec-lib-modules\") pod \"perf-node-gather-daemonset-wjfrn\" (UID: \"84628b1f-e995-4819-ad0b-4c42ecfc67ec\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:36.537995 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.537944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74sp4\" (UniqueName: \"kubernetes.io/projected/84628b1f-e995-4819-ad0b-4c42ecfc67ec-kube-api-access-74sp4\") pod \"perf-node-gather-daemonset-wjfrn\" (UID: \"84628b1f-e995-4819-ad0b-4c42ecfc67ec\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:36.537995 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.537953 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84628b1f-e995-4819-ad0b-4c42ecfc67ec-proc\") pod \"perf-node-gather-daemonset-wjfrn\" (UID: \"84628b1f-e995-4819-ad0b-4c42ecfc67ec\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:36.537995 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.537963 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84628b1f-e995-4819-ad0b-4c42ecfc67ec-sys\") pod \"perf-node-gather-daemonset-wjfrn\" (UID: \"84628b1f-e995-4819-ad0b-4c42ecfc67ec\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:36.538226 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.538007 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84628b1f-e995-4819-ad0b-4c42ecfc67ec-sys\") pod \"perf-node-gather-daemonset-wjfrn\" (UID: \"84628b1f-e995-4819-ad0b-4c42ecfc67ec\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:36.538226 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.538013 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84628b1f-e995-4819-ad0b-4c42ecfc67ec-podres\") pod \"perf-node-gather-daemonset-wjfrn\" (UID: \"84628b1f-e995-4819-ad0b-4c42ecfc67ec\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:36.538226 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.538099 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84628b1f-e995-4819-ad0b-4c42ecfc67ec-lib-modules\") pod \"perf-node-gather-daemonset-wjfrn\" (UID: \"84628b1f-e995-4819-ad0b-4c42ecfc67ec\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:36.538226 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.538109 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84628b1f-e995-4819-ad0b-4c42ecfc67ec-podres\") pod \"perf-node-gather-daemonset-wjfrn\" (UID: \"84628b1f-e995-4819-ad0b-4c42ecfc67ec\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:36.544771 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.544754 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74sp4\" (UniqueName: \"kubernetes.io/projected/84628b1f-e995-4819-ad0b-4c42ecfc67ec-kube-api-access-74sp4\") pod \"perf-node-gather-daemonset-wjfrn\" (UID: \"84628b1f-e995-4819-ad0b-4c42ecfc67ec\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:36.634507 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.634443 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:36.904330 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:36.904304 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn"] Sep 09 23:27:36.906971 ip-10-0-143-228 kubenswrapper[2567]: W0909 23:27:36.906939 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod84628b1f_e995_4819_ad0b_4c42ecfc67ec.slice/crio-f960a97eedfa7598f063ac96772fef7b9af01772bf42cff3234f584e7855fe17 WatchSource:0}: Error finding container f960a97eedfa7598f063ac96772fef7b9af01772bf42cff3234f584e7855fe17: Status 404 returned error can't find the container with id f960a97eedfa7598f063ac96772fef7b9af01772bf42cff3234f584e7855fe17 Sep 09 23:27:37.097442 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:37.097407 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" event={"ID":"84628b1f-e995-4819-ad0b-4c42ecfc67ec","Type":"ContainerStarted","Data":"eec0f1ec7b1833c7b4b087a85009e014943c5bb302907fdb3fb16d3f87525bb7"} Sep 09 23:27:37.097642 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:37.097459 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" event={"ID":"84628b1f-e995-4819-ad0b-4c42ecfc67ec","Type":"ContainerStarted","Data":"f960a97eedfa7598f063ac96772fef7b9af01772bf42cff3234f584e7855fe17"} Sep 09 23:27:37.097642 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:37.097520 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:37.111162 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:37.111107 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" podStartSLOduration=1.111087841 podStartE2EDuration="1.111087841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:27:37.110573391 +0000 UTC m=+1159.410580911" watchObservedRunningTime="2026-09-09 23:27:37.111087841 +0000 UTC m=+1159.411095360" Sep 09 23:27:38.194047 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:38.194020 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rdtvn_ad961056-ef98-4a07-947a-f503dafaa568/dns/0.log" Sep 09 23:27:38.213142 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:38.213116 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rdtvn_ad961056-ef98-4a07-947a-f503dafaa568/kube-rbac-proxy/0.log" Sep 09 23:27:38.256983 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:38.256958 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9644c_8a832abe-6374-4c97-be59-eb9e1423903c/dns-node-resolver/0.log" Sep 09 23:27:38.830722 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:38.830692 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rx9nk_1668ae93-f22d-4b5d-b86d-0c120fd1ac49/node-ca/0.log" Sep 09 23:27:39.884941 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:39.884911 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-vdglc_d5f24362-716e-4844-99e4-3c69f7498d09/payload-pre-processing/0.log" Sep 09 23:27:39.908989 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:39.908963 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-xbnmx_b3a8ea64-34ac-458a-b9f2-e1374aa1922c/payload-processing/0.log" Sep 09 23:27:40.556398 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:40.556291 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z8p6x_6f0a8a36-41da-42f7-98ee-21b2fbf71348/serve-healthcheck-canary/0.log" Sep 09 23:27:41.056870 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:41.056844 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vjqdg_81b00fbc-7e56-4591-b2d7-7342d6c80a96/kube-rbac-proxy/0.log" Sep 09 23:27:41.077163 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:41.077134 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vjqdg_81b00fbc-7e56-4591-b2d7-7342d6c80a96/exporter/0.log" Sep 09 23:27:41.097778 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:41.097753 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vjqdg_81b00fbc-7e56-4591-b2d7-7342d6c80a96/extractor/0.log" Sep 09 23:27:43.112188 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:43.112163 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-wjfrn" Sep 09 23:27:43.180325 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:43.180297 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9b48k_158a1ed6-f6be-48ab-9ffe-3399a96fe8e5/manager/0.log" Sep 09 23:27:43.213270 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:43.213244 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kqsqj_1dbd9432-d2b6-4e59-9eb7-08fa149b0c36/manager/0.log" Sep 09 23:27:43.385232 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:43.385158 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fd95c47c-g8hsd_3b8903f2-8401-46e4-bfb0-de3a5c8d14f5/manager/0.log" Sep 09 23:27:43.401268 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:43.401246 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fd95c47c-g8hsd_3b8903f2-8401-46e4-bfb0-de3a5c8d14f5/copy-manifests/0.log" Sep 09 23:27:44.654140 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:44.654116 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66c6d9b8f-slhdp_bc117c48-8cc2-4e58-8a92-f14e703a271b/manager/0.log" Sep 09 23:27:45.188938 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:45.188910 2567 scope.go:117] "RemoveContainer" containerID="623f87c2b130c6e73d248c1424101550e0b28c8c15f310c6abe079e667d77232" Sep 09 23:27:45.189109 ip-10-0-143-228 kubenswrapper[2567]: E0909 23:27:45.189091 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jpdl8_llm(288e2c0f-422c-4487-935c-f9e992c57cc2)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jpdl8" podUID="288e2c0f-422c-4487-935c-f9e992c57cc2" Sep 09 23:27:46.497519 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:46.497492 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-vdglc_d5f24362-716e-4844-99e4-3c69f7498d09/payload-pre-processing/0.log" Sep 09 23:27:46.512370 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:46.512346 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-xbnmx_b3a8ea64-34ac-458a-b9f2-e1374aa1922c/payload-processing/0.log" Sep 09 23:27:47.892162 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:47.892082 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-vdglc_d5f24362-716e-4844-99e4-3c69f7498d09/payload-pre-processing/0.log" Sep 09 23:27:47.906150 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:47.906120 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-xbnmx_b3a8ea64-34ac-458a-b9f2-e1374aa1922c/payload-processing/0.log" Sep 09 23:27:49.877520 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:49.877490 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-ktr96_4d28512b-6ae7-421e-83ae-e1da3bab8bda/migrator/0.log" Sep 09 23:27:49.896372 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:49.896343 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-ktr96_4d28512b-6ae7-421e-83ae-e1da3bab8bda/graceful-termination/0.log" Sep 09 23:27:50.222019 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:50.221934 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-wm82m_7b4c2371-e07d-441d-8b9b-bf11e7336f7a/kube-storage-version-migrator-operator/1.log" Sep 09 23:27:50.222645 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:50.222620 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-wm82m_7b4c2371-e07d-441d-8b9b-bf11e7336f7a/kube-storage-version-migrator-operator/0.log" Sep 09 23:27:51.247489 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:51.247454 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l98pp_130a2012-14a3-4b9f-ae73-7a3a3fe7cf59/kube-multus-additional-cni-plugins/0.log" Sep 09 23:27:51.268150 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:51.268126 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l98pp_130a2012-14a3-4b9f-ae73-7a3a3fe7cf59/egress-router-binary-copy/0.log" Sep 09 23:27:51.292175 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:51.292148 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l98pp_130a2012-14a3-4b9f-ae73-7a3a3fe7cf59/cni-plugins/0.log" Sep 09 23:27:51.312763 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:51.312738 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l98pp_130a2012-14a3-4b9f-ae73-7a3a3fe7cf59/bond-cni-plugin/0.log" Sep 09 23:27:51.332940 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:51.332909 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l98pp_130a2012-14a3-4b9f-ae73-7a3a3fe7cf59/routeoverride-cni/0.log" Sep 09 23:27:51.352315 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:51.352275 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l98pp_130a2012-14a3-4b9f-ae73-7a3a3fe7cf59/whereabouts-cni-bincopy/0.log" Sep 09 23:27:51.371722 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:51.371703 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l98pp_130a2012-14a3-4b9f-ae73-7a3a3fe7cf59/whereabouts-cni/0.log" Sep 09 23:27:51.726645 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:51.726621 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fngv2_8c15c466-4329-4033-9a57-92b61c400874/kube-multus/0.log" Sep 09 23:27:51.795694 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:51.795664 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gmk7t_2e433ce1-5876-44c1-bafd-cf7237901a04/network-metrics-daemon/0.log" Sep 09 23:27:51.813668 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:51.813641 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gmk7t_2e433ce1-5876-44c1-bafd-cf7237901a04/kube-rbac-proxy/0.log" Sep 09 23:27:52.994465 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:52.994431 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh26_a23eb22f-765f-4d94-8315-623722d7e706/ovn-controller/0.log" Sep 09 23:27:53.022044 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:53.022018 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh26_a23eb22f-765f-4d94-8315-623722d7e706/ovn-acl-logging/0.log" Sep 09 23:27:53.058381 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:53.058358 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh26_a23eb22f-765f-4d94-8315-623722d7e706/kube-rbac-proxy-node/0.log" Sep 09 23:27:53.097404 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:53.097376 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh26_a23eb22f-765f-4d94-8315-623722d7e706/kube-rbac-proxy-ovn-metrics/0.log" Sep 09 23:27:53.135527 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:53.135495 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh26_a23eb22f-765f-4d94-8315-623722d7e706/northd/0.log" Sep 09 23:27:53.165235 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:53.165208 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh26_a23eb22f-765f-4d94-8315-623722d7e706/nbdb/0.log" Sep 09 23:27:53.204230 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:53.204210 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh26_a23eb22f-765f-4d94-8315-623722d7e706/sbdb/0.log" Sep 09 23:27:53.260044 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:53.259985 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh26_a23eb22f-765f-4d94-8315-623722d7e706/ovnkube-controller/0.log" Sep 09 23:27:54.737764 ip-10-0-143-228 kubenswrapper[2567]: I0909 23:27:54.737730 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-bngkg_9919def0-8417-43bd-b29e-af19906c55ca/network-check-target-container/0.log"