Sep 11 07:59:29.849086 ip-10-0-142-13 systemd[1]: Starting Kubernetes Kubelet... Sep 11 07:59:30.299518 ip-10-0-142-13 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 07:59:30.299518 ip-10-0-142-13 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 11 07:59:30.299518 ip-10-0-142-13 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 07:59:30.299518 ip-10-0-142-13 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 11 07:59:30.299518 ip-10-0-142-13 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 07:59:30.301684 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.301593 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 11 07:59:30.307899 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307874 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 07:59:30.307899 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307896 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 07:59:30.307899 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307902 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 07:59:30.307899 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307906 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307911 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307915 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307919 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307923 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307927 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307931 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307935 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307939 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307943 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307946 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307949 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307952 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307955 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307958 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307960 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307962 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307966 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307971 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 07:59:30.308081 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307974 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307976 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307979 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307982 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307984 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307987 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307990 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307992 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307995 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.307997 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308000 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308002 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308005 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308008 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308010 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308013 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308017 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308020 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308023 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 07:59:30.308515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308025 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308028 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308031 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308033 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308035 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308038 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308040 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308043 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308045 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308048 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308051 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308053 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308056 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308058 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308060 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308063 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308065 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308067 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308069 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308073 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 07:59:30.308984 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308076 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308079 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308082 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308085 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308088 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308091 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308095 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308098 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308102 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308105 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308107 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308110 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308112 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308114 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308117 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308120 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308122 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308124 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308127 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308129 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 07:59:30.309457 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308132 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308134 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308144 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308147 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308150 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308152 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308154 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308157 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308159 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308161 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308164 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308166 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308169 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308171 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308174 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308177 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308179 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308181 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308900 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308907 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 07:59:30.309980 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308912 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308914 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308917 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308919 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308922 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308924 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308927 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308929 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308932 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308934 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308937 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308939 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308942 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308944 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308947 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308950 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308952 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308955 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308958 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308960 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 07:59:30.310435 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308963 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308965 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308968 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308970 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308973 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308975 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308979 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308981 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308983 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308986 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308989 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308991 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308995 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.308998 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309000 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309003 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309005 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309008 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309010 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309013 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 07:59:30.311055 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309015 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309018 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309021 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309023 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309025 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309028 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309030 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309033 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309036 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309038 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309041 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309044 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309047 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309049 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309051 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309054 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309056 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309058 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309061 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309063 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 07:59:30.311521 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309065 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309068 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309070 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309072 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309075 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309078 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309080 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309082 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309085 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309087 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309090 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309093 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309097 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309100 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309103 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309105 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309108 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309114 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309116 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309119 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 07:59:30.312016 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309122 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309125 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309128 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309132 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309135 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309138 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309141 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309143 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309145 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309147 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309150 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309152 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309155 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309157 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309160 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309162 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309165 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309515 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309520 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 07:59:30.313298 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309523 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309525 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309528 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309531 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309533 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309536 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309538 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309541 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309543 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309546 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309549 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309552 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309555 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309557 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309560 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309563 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309565 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309568 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309572 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 07:59:30.313758 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309576 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309579 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309582 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309584 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309587 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309590 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309592 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309595 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309597 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309600 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309610 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309613 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309615 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309618 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309622 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309625 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309628 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309631 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309633 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 07:59:30.314255 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309635 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309638 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309640 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309643 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309645 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309648 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309651 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309653 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309656 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309659 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309661 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309663 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309666 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309668 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309670 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309673 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309675 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309677 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309680 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309682 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 11 07:59:30.314688 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309684 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309687 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309690 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309692 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309694 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309697 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309699 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309702 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309704 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309706 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309709 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309711 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309714 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309716 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309718 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309721 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309723 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309727 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309729 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309731 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 07:59:30.315192 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309734 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309736 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309739 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309742 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309744 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309746 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309749 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309751 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309753 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309756 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309758 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309762 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309765 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309767 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309770 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309772 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309775 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309777 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.309780 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309876 2566 flags.go:64] FLAG: --address="0.0.0.0" Sep 11 07:59:30.315694 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309920 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309929 2566 flags.go:64] FLAG: --anonymous-auth="true" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309933 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309937 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309940 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309944 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309948 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309951 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309954 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309957 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309960 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309963 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309966 2566 flags.go:64] FLAG: --cgroup-root="" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309969 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309971 2566 flags.go:64] FLAG: --client-ca-file="" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309975 2566 flags.go:64] FLAG: --cloud-provider="external" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309978 2566 flags.go:64] FLAG: --cluster-dns="[]" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309982 2566 flags.go:64] FLAG: --cluster-domain="" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309985 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309988 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309991 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309994 2566 flags.go:64] FLAG: --container-log-max-files="5" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.309998 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 11 07:59:30.316170 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310001 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310004 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310007 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310010 2566 flags.go:64] FLAG: --contention-profiling="false" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310013 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310015 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310018 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310021 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310025 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310027 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310030 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310033 2566 flags.go:64] FLAG: --enable-load-reader="false" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310036 2566 flags.go:64] FLAG: --enable-server="true" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310038 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310043 2566 flags.go:64] FLAG: --event-burst="100" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310045 2566 flags.go:64] FLAG: --event-qps="50" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310048 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310052 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310055 2566 flags.go:64] FLAG: --eviction-hard="" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310059 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310062 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310064 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310067 2566 flags.go:64] FLAG: --eviction-soft="" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310070 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310072 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 11 07:59:30.316707 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310075 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310078 2566 flags.go:64] FLAG: --experimental-mounter-path="" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310081 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310084 2566 flags.go:64] FLAG: --fail-swap-on="true" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310086 2566 flags.go:64] FLAG: --feature-gates="" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310090 2566 flags.go:64] FLAG: --file-check-frequency="20s" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310093 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310096 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310099 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310102 2566 flags.go:64] FLAG: --healthz-port="10248" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310105 2566 flags.go:64] FLAG: --help="false" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310107 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310111 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310114 2566 flags.go:64] FLAG: --http-check-frequency="20s" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310116 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310120 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310123 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310126 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310128 2566 flags.go:64] FLAG: --image-service-endpoint="" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310131 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310133 2566 flags.go:64] FLAG: --kube-api-burst="100" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310136 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310139 2566 flags.go:64] FLAG: --kube-api-qps="50" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310142 2566 flags.go:64] FLAG: --kube-reserved="" Sep 11 07:59:30.317318 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310146 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310148 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310151 2566 flags.go:64] FLAG: --kubelet-cgroups="" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310153 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310156 2566 flags.go:64] FLAG: --lock-file="" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310159 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310161 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310164 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310169 2566 flags.go:64] FLAG: --log-json-split-stream="false" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310172 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310175 2566 flags.go:64] FLAG: --log-text-split-stream="false" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310178 2566 flags.go:64] FLAG: --logging-format="text" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310180 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310183 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310186 2566 flags.go:64] FLAG: --manifest-url="" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310188 2566 flags.go:64] FLAG: --manifest-url-header="" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310192 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310195 2566 flags.go:64] FLAG: --max-open-files="1000000" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310198 2566 flags.go:64] FLAG: --max-pods="110" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310201 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310204 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310207 2566 flags.go:64] FLAG: --memory-manager-policy="None" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310209 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310212 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310215 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 11 07:59:30.317977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310217 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310230 2566 flags.go:64] FLAG: --node-status-max-images="50" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310232 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310235 2566 flags.go:64] FLAG: --oom-score-adj="-999" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310238 2566 flags.go:64] FLAG: --pod-cidr="" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310240 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310245 2566 flags.go:64] FLAG: --pod-manifest-path="" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310249 2566 flags.go:64] FLAG: --pod-max-pids="-1" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310252 2566 flags.go:64] FLAG: --pods-per-core="0" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310254 2566 flags.go:64] FLAG: --port="10250" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310257 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310260 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03b6d33db39f9d7f6" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310262 2566 flags.go:64] FLAG: --qos-reserved="" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310265 2566 flags.go:64] FLAG: --read-only-port="10255" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310268 2566 flags.go:64] FLAG: --register-node="true" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310271 2566 flags.go:64] FLAG: --register-with-taints="" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310274 2566 flags.go:64] FLAG: --registry-burst="10" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310278 2566 flags.go:64] FLAG: --registry-qps="5" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310280 2566 flags.go:64] FLAG: --reserved-cpus="" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310283 2566 flags.go:64] FLAG: --reserved-memory="" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310286 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310289 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310292 2566 flags.go:64] FLAG: --rotate-certificates="false" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310295 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310297 2566 flags.go:64] FLAG: --runonce="false" Sep 11 07:59:30.319026 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310300 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310303 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310306 2566 flags.go:64] FLAG: --seccomp-default="false" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310308 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310311 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310314 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310317 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310320 2566 flags.go:64] FLAG: --storage-driver-password="root" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310322 2566 flags.go:64] FLAG: --storage-driver-secure="false" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310325 2566 flags.go:64] FLAG: --storage-driver-table="stats" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310327 2566 flags.go:64] FLAG: --storage-driver-user="root" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310330 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310333 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310336 2566 flags.go:64] FLAG: --system-cgroups="" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310339 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310345 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310348 2566 flags.go:64] FLAG: --tls-cert-file="" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310351 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310354 2566 flags.go:64] FLAG: --tls-min-version="" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310357 2566 flags.go:64] FLAG: --tls-private-key-file="" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310360 2566 flags.go:64] FLAG: --topology-manager-policy="none" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310362 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310365 2566 flags.go:64] FLAG: --topology-manager-scope="container" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310368 2566 flags.go:64] FLAG: --v="2" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310371 2566 flags.go:64] FLAG: --version="false" Sep 11 07:59:30.320102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310376 2566 flags.go:64] FLAG: --vmodule="" Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310379 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.310382 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310491 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310495 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310500 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310503 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310506 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310509 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310512 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310514 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310517 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310521 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310524 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310528 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310530 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310533 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310536 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310538 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310541 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 07:59:30.321159 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310543 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310548 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310552 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310555 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310558 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310561 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310563 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310566 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310569 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310572 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310575 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310578 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310581 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310584 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310587 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310589 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310592 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310596 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310598 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 07:59:30.321921 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310601 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310604 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310606 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310609 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310612 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310614 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310617 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310620 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310622 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310625 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310627 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310630 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310632 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310634 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310638 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310640 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310643 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310645 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310648 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310650 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 07:59:30.322437 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310653 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310655 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310658 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310660 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310662 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310665 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310669 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310672 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310675 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310678 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310682 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310685 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310688 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310690 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310693 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310695 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310698 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310701 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310704 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 07:59:30.323250 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310706 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310709 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310712 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310714 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310717 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310720 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310722 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310726 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310728 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310730 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310733 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310736 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310738 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310741 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310743 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310746 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310757 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310760 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310762 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310765 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 07:59:30.323952 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310767 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 07:59:30.324452 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310770 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 07:59:30.324452 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310773 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 07:59:30.324452 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.310776 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 07:59:30.324452 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.311635 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 07:59:30.324452 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.320166 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 11 07:59:30.324452 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.320186 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 11 07:59:30.324452 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.320219 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 11 07:59:30.324452 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.320228 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 11 07:59:30.324452 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320313 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 07:59:30.324452 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320321 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 07:59:30.324452 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320327 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 07:59:30.324452 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320332 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 07:59:30.324452 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320337 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 07:59:30.324452 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320341 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 07:59:30.324452 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320346 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320350 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320355 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320359 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320363 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320367 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320371 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320375 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320379 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320383 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320387 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320392 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320396 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320400 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320404 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320408 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320413 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320417 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320421 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320425 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 07:59:30.324970 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320429 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320433 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320437 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320443 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320447 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320452 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320456 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320460 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320464 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320468 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320472 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320476 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320480 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320484 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320488 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320492 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320496 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320501 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320508 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320514 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 07:59:30.325430 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320519 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320523 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320528 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320532 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320536 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320541 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320546 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320550 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320554 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320560 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320567 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320571 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320575 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320579 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320583 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320608 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320615 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320620 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320625 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 07:59:30.325971 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320629 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320636 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320642 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320646 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320650 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320654 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320658 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320662 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320666 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320670 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320674 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320678 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320682 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320686 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320690 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320694 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320697 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320702 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320706 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 07:59:30.326464 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320709 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 07:59:30.326966 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320713 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 07:59:30.326966 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320717 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 07:59:30.326966 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320721 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 07:59:30.326966 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320725 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 07:59:30.326966 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320729 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 07:59:30.326966 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320733 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 07:59:30.326966 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320738 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 07:59:30.326966 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320741 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 07:59:30.326966 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320746 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 07:59:30.326966 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320750 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 07:59:30.326966 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320756 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 07:59:30.326966 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320760 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 07:59:30.326966 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320764 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 07:59:30.326966 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320768 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 07:59:30.326966 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.320775 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320973 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320980 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320985 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320989 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.320996 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321001 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321007 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321011 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321016 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321020 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321025 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321029 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321032 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321037 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321041 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321047 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321052 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321057 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 07:59:30.327363 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321061 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321065 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321069 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321073 2566 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321077 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321081 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321085 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321089 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321094 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321098 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321103 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321107 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321111 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321114 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321119 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321123 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321127 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321132 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321136 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321140 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 07:59:30.327816 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321144 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321148 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321152 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321155 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321159 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321163 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321167 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321171 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321175 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321179 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321183 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321187 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321192 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321196 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321200 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321204 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321208 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321212 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321216 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321220 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 07:59:30.328484 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321224 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321228 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321232 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321238 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321243 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321247 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321252 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321256 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321260 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321264 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321268 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321272 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321276 2566 feature_gate.go:328] unrecognized feature gate: Example Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321280 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321284 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321288 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321292 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321296 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321300 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321304 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 07:59:30.329274 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321308 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321312 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321316 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321320 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321324 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321328 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321332 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321336 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321340 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321344 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321348 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321352 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321355 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321359 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321363 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321367 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321372 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321375 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321381 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321387 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 07:59:30.330157 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:30.321392 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 07:59:30.330695 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.321399 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 07:59:30.330695 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.321559 2566 server.go:962] "Client rotation is on, will bootstrap in background" Sep 11 07:59:30.330695 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.324492 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 11 07:59:30.330695 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.325583 2566 server.go:1019] "Starting client certificate rotation" Sep 11 07:59:30.330695 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.325688 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 07:59:30.330695 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.325728 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 07:59:30.330695 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.328691 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 07:59:30.331229 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.331211 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 07:59:30.338109 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.338091 2566 log.go:25] "Validated CRI v1 runtime API" Sep 11 07:59:30.341334 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.341321 2566 log.go:25] "Validated CRI v1 image API" Sep 11 07:59:30.342156 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.342141 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 11 07:59:30.344821 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.344783 2566 fs.go:135] Filesystem UUIDs: map[749fcd48-b8ce-4a49-8bff-dc6e42044c86:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8748bf36-4946-42f6-ae64-056b6254d33b:/dev/nvme0n1p4] Sep 11 07:59:30.344902 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.344820 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 11 07:59:30.350924 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.350821 2566 manager.go:216] Machine: {Timestamp:2026-09-11 07:59:30.349489415 +0000 UTC m=+0.371996732 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200842 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec266dd83f02d83ca2dd817c4472adb9 SystemUUID:ec266dd8-3f02-d83c-a2dd-817c4472adb9 BootID:cd2d8bf2-c310-43c6-b388-af673bda1d0b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4a:d4:f0:da:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4a:d4:f0:da:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:0b:ae:80:4c:b6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 11 07:59:30.350924 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.350918 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 11 07:59:30.351070 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.350995 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 11 07:59:30.354664 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.354641 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 11 07:59:30.354817 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.354669 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-13.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 11 07:59:30.355586 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.355576 2566 topology_manager.go:138] "Creating topology manager with none policy" Sep 11 07:59:30.355624 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.355588 2566 container_manager_linux.go:309] "Creating device plugin manager" Sep 11 07:59:30.355624 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.355596 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 07:59:30.356285 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.356275 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 07:59:30.357553 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.357543 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 11 07:59:30.358504 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.358488 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 07:59:30.362101 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.362089 2566 state_mem.go:36] "Initialized new in-memory state store" Sep 11 07:59:30.362220 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.362210 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 11 07:59:30.362260 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.362242 2566 kubelet.go:486] "Attempting to sync node with API server" Sep 11 07:59:30.362287 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.362264 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 11 07:59:30.362287 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.362283 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 11 07:59:30.362337 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.362296 2566 kubelet.go:398] "Adding apiserver pod source" Sep 11 07:59:30.362337 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.362308 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 11 07:59:30.362722 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.362711 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 07:59:30.362793 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.362729 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 07:59:30.365068 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.365049 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 11 07:59:30.367346 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.367332 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 11 07:59:30.367409 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.367361 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 11 07:59:30.369100 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.369087 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 11 07:59:30.369164 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.369103 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 11 07:59:30.369164 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.369109 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 11 07:59:30.369164 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.369115 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 11 07:59:30.369164 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.369123 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 11 07:59:30.369164 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.369128 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 11 07:59:30.369164 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.369150 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 11 07:59:30.369164 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.369154 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 11 07:59:30.369164 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.369160 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 11 07:59:30.369164 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.369165 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 11 07:59:30.369505 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.369181 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 11 07:59:30.369505 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.369193 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 11 07:59:30.370078 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.370067 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 11 07:59:30.370078 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.370079 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 11 07:59:30.371389 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.371368 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-13.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 11 07:59:30.371389 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.371374 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 11 07:59:30.374125 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.374112 2566 server.go:1268] "Started kubelet" Sep 11 07:59:30.374226 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.374195 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 11 07:59:30.374280 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.374241 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 11 07:59:30.374321 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.374302 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 11 07:59:30.375000 ip-10-0-142-13 systemd[1]: Started Kubernetes Kubelet. Sep 11 07:59:30.378880 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.378861 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 11 07:59:30.380835 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.380816 2566 server.go:310] "Adding debug handlers to kubelet server" Sep 11 07:59:30.381460 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.381441 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 11 07:59:30.386630 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.386612 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 11 07:59:30.387256 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.387242 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 11 07:59:30.387354 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.387337 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-13.ec2.internal\" not found" Sep 11 07:59:30.387859 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.386323 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-13.ec2.internal.18d4355028fa49d9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-13.ec2.internal,UID:ip-10-0-142-13.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-13.ec2.internal,},FirstTimestamp:2026-09-11 07:59:30.374076889 +0000 UTC m=+0.396584206,LastTimestamp:2026-09-11 07:59:30.374076889 +0000 UTC m=+0.396584206,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-13.ec2.internal,}" Sep 11 07:59:30.387961 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.387929 2566 factory.go:55] Registering systemd factory Sep 11 07:59:30.388019 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.387977 2566 factory.go:223] Registration of the systemd container factory successfully Sep 11 07:59:30.388109 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.388090 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 11 07:59:30.388109 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.388090 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 11 07:59:30.388236 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.388116 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 11 07:59:30.388236 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.388173 2566 factory.go:153] Registering CRI-O factory Sep 11 07:59:30.388236 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.388181 2566 reconstruct.go:97] "Volume reconstruction finished" Sep 11 07:59:30.388236 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.388192 2566 reconciler.go:29] "Reconciler: start to sync state" Sep 11 07:59:30.388236 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.388184 2566 factory.go:223] Registration of the crio container factory successfully Sep 11 07:59:30.388456 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.388253 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 11 07:59:30.388456 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.388275 2566 factory.go:103] Registering Raw factory Sep 11 07:59:30.388456 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.388289 2566 manager.go:1196] Started watching for new ooms in manager Sep 11 07:59:30.390307 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.390291 2566 manager.go:349] Starting recovery of all containers Sep 11 07:59:30.393840 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.393696 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zl7zn" Sep 11 07:59:30.394402 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.394384 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-13.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 11 07:59:30.394497 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.394447 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-13.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 11 07:59:30.394580 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.394529 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 11 07:59:30.400701 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.400684 2566 manager.go:354] Recovery completed Sep 11 07:59:30.404791 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.404779 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 07:59:30.406548 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.406534 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasSufficientMemory" Sep 11 07:59:30.406607 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.406561 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 07:59:30.406607 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.406578 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasSufficientPID" Sep 11 07:59:30.407147 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.407129 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 11 07:59:30.407147 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.407145 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 11 07:59:30.407288 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.407132 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 07:59:30.407288 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.407159 2566 state_mem.go:36] "Initialized new in-memory state store" Sep 11 07:59:30.407843 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.407831 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasSufficientMemory" Sep 11 07:59:30.407902 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.407855 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 07:59:30.407902 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.407864 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasSufficientPID" Sep 11 07:59:30.408286 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.408275 2566 policy_none.go:49] "None policy: Start" Sep 11 07:59:30.408321 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.408290 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 11 07:59:30.408321 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.408300 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 11 07:59:30.409117 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.409046 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-13.ec2.internal.18d435502ae9c0ed default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-13.ec2.internal,UID:ip-10-0-142-13.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-13.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-13.ec2.internal,},FirstTimestamp:2026-09-11 07:59:30.406547693 +0000 UTC m=+0.429055009,LastTimestamp:2026-09-11 07:59:30.406547693 +0000 UTC m=+0.429055009,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-13.ec2.internal,}" Sep 11 07:59:30.409376 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.409361 2566 policy_none.go:47] "Start" Sep 11 07:59:30.412965 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.412949 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zl7zn" Sep 11 07:59:30.439358 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.439343 2566 manager.go:337] "Starting Device Plugin manager" Sep 11 07:59:30.454539 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.439378 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 11 07:59:30.454539 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.439389 2566 server.go:87] "Starting device plugin registration server" Sep 11 07:59:30.454539 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.439665 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 11 07:59:30.454539 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.439676 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 11 07:59:30.454539 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.439758 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 11 07:59:30.454539 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.439950 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 11 07:59:30.454539 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.439966 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 11 07:59:30.454539 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.440514 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 11 07:59:30.454539 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.440557 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-13.ec2.internal\" not found" Sep 11 07:59:30.454539 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.451104 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 11 07:59:30.454539 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.452287 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 11 07:59:30.454539 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.452339 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 11 07:59:30.454539 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.452366 2566 kubelet.go:2448] "Starting kubelet main sync loop" Sep 11 07:59:30.454539 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.452409 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 11 07:59:30.455079 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.454970 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 07:59:30.540758 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.540732 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 07:59:30.541791 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.541767 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasSufficientMemory" Sep 11 07:59:30.541908 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.541816 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 07:59:30.541908 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.541827 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasSufficientPID" Sep 11 07:59:30.541908 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.541853 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.552933 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.552869 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-13.ec2.internal"] Sep 11 07:59:30.552988 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.552964 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 07:59:30.553853 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.553840 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasSufficientMemory" Sep 11 07:59:30.553920 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.553862 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 07:59:30.553920 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.553873 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasSufficientPID" Sep 11 07:59:30.554228 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.554216 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.554262 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.554234 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-13.ec2.internal\": node \"ip-10-0-142-13.ec2.internal\" not found" Sep 11 07:59:30.555245 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.555234 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 07:59:30.555381 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.555363 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.555418 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.555398 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 07:59:30.555949 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.555933 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasSufficientMemory" Sep 11 07:59:30.556019 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.555960 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 07:59:30.556019 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.555979 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasSufficientPID" Sep 11 07:59:30.556019 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.555982 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasSufficientMemory" Sep 11 07:59:30.556019 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.555997 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 07:59:30.556019 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.556008 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasSufficientPID" Sep 11 07:59:30.557476 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.557461 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.557545 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.557486 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 07:59:30.558217 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.558205 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasSufficientMemory" Sep 11 07:59:30.558263 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.558228 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 07:59:30.558263 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.558236 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeHasSufficientPID" Sep 11 07:59:30.574747 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.574725 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-13.ec2.internal\" not found" Sep 11 07:59:30.580431 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.580415 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-13.ec2.internal\" not found" node="ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.584707 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.584693 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-13.ec2.internal\" not found" node="ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.675325 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.675298 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-13.ec2.internal\" not found" Sep 11 07:59:30.688914 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.688893 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98923d77a9ea199e1311f70240dd5a1e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal\" (UID: \"98923d77a9ea199e1311f70240dd5a1e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.688977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.688921 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98923d77a9ea199e1311f70240dd5a1e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal\" (UID: \"98923d77a9ea199e1311f70240dd5a1e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.688977 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.688944 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccad160e38c411773147acccf0c917ed-config\") pod \"kube-apiserver-proxy-ip-10-0-142-13.ec2.internal\" (UID: \"ccad160e38c411773147acccf0c917ed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.775998 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.775964 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-13.ec2.internal\" not found" Sep 11 07:59:30.789261 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.789238 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98923d77a9ea199e1311f70240dd5a1e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal\" (UID: \"98923d77a9ea199e1311f70240dd5a1e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.789301 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.789273 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98923d77a9ea199e1311f70240dd5a1e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal\" (UID: \"98923d77a9ea199e1311f70240dd5a1e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.789301 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.789289 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccad160e38c411773147acccf0c917ed-config\") pod \"kube-apiserver-proxy-ip-10-0-142-13.ec2.internal\" (UID: \"ccad160e38c411773147acccf0c917ed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.789372 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.789337 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98923d77a9ea199e1311f70240dd5a1e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal\" (UID: \"98923d77a9ea199e1311f70240dd5a1e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.789372 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.789344 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccad160e38c411773147acccf0c917ed-config\") pod \"kube-apiserver-proxy-ip-10-0-142-13.ec2.internal\" (UID: \"ccad160e38c411773147acccf0c917ed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.789432 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.789384 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98923d77a9ea199e1311f70240dd5a1e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal\" (UID: \"98923d77a9ea199e1311f70240dd5a1e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.876720 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.876649 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-13.ec2.internal\" not found" Sep 11 07:59:30.883821 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.883789 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.888942 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:30.888599 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-13.ec2.internal" Sep 11 07:59:30.977471 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:30.977281 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-13.ec2.internal\" not found" Sep 11 07:59:31.077831 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:31.077784 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-13.ec2.internal\" not found" Sep 11 07:59:31.178424 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:31.178346 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-13.ec2.internal\" not found" Sep 11 07:59:31.242362 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.242338 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 07:59:31.287793 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.287771 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal" Sep 11 07:59:31.302194 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.302172 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 07:59:31.304309 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.304290 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-13.ec2.internal" Sep 11 07:59:31.314956 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.314936 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 07:59:31.325055 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.325037 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 11 07:59:31.325182 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.325165 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 07:59:31.325219 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.325191 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 07:59:31.363348 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.363317 2566 apiserver.go:52] "Watching apiserver" Sep 11 07:59:31.376871 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.376851 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 11 07:59:31.378113 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.378093 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-pj77b","openshift-ovn-kubernetes/ovnkube-node-9ljvr","kube-system/global-pull-secret-syncer-bn9jv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq","openshift-cluster-node-tuning-operator/tuned-qv72v","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal","openshift-multus/multus-additional-cni-plugins-kpk9z","openshift-multus/multus-lg5vk","openshift-multus/network-metrics-daemon-t6dx2","openshift-network-diagnostics/network-check-target-w4bks","kube-system/konnectivity-agent-cwt9j","kube-system/kube-apiserver-proxy-ip-10-0-142-13.ec2.internal","openshift-dns/node-resolver-kxv89","openshift-image-registry/node-ca-5jmtt"] Sep 11 07:59:31.379469 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.379452 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:31.379553 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:31.379533 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4bks" podUID="be19ae80-8995-4581-a152-16243aba132d" Sep 11 07:59:31.380490 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.380470 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kxv89" Sep 11 07:59:31.381668 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.381644 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5jmtt" Sep 11 07:59:31.382965 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.382675 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 11 07:59:31.382965 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.382731 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-82rmv\"" Sep 11 07:59:31.382965 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.382766 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 11 07:59:31.383173 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.383153 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pj77b" Sep 11 07:59:31.383739 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.383720 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 11 07:59:31.383821 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.383755 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 11 07:59:31.384022 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.384004 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 11 07:59:31.384623 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.384331 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c9hzv\"" Sep 11 07:59:31.386378 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.384996 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.386378 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.385205 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 11 07:59:31.386378 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.385748 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 11 07:59:31.386378 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.386208 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 11 07:59:31.386737 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.386708 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 11 07:59:31.388215 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.387335 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 11 07:59:31.388215 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.387373 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 11 07:59:31.388215 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.387601 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6g2qj\"" Sep 11 07:59:31.388215 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.387624 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mdgkb\"" Sep 11 07:59:31.388215 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.387632 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 11 07:59:31.388215 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.387679 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 11 07:59:31.388215 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.387712 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 11 07:59:31.388215 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.387826 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.388648 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.388632 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:31.388714 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:31.388698 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6dx2" podUID="67dde785-fd0c-4213-81d9-bfb6374f6f13" Sep 11 07:59:31.389863 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.389851 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.390285 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.390264 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 11 07:59:31.390412 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.390275 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 11 07:59:31.390412 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.390301 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 11 07:59:31.390412 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.390333 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n8nvm\"" Sep 11 07:59:31.390654 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.390629 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 11 07:59:31.390712 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.390670 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 11 07:59:31.390712 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.390702 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 11 07:59:31.391118 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.391103 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.392008 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.391979 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3027cbb6-dcdd-4888-ad76-6f7304468c90-host\") pod \"node-ca-5jmtt\" (UID: \"3027cbb6-dcdd-4888-ad76-6f7304468c90\") " pod="openshift-image-registry/node-ca-5jmtt" Sep 11 07:59:31.392102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392027 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.392102 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392073 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-run-ovn-kubernetes\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.392198 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392099 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.392198 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392108 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 11 07:59:31.392198 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392125 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-ovnkube-script-lib\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.392198 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392150 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs\") pod \"network-metrics-daemon-t6dx2\" (UID: \"67dde785-fd0c-4213-81d9-bfb6374f6f13\") " pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:31.392198 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392175 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96mjl\" (UniqueName: \"kubernetes.io/projected/3027cbb6-dcdd-4888-ad76-6f7304468c90-kube-api-access-96mjl\") pod \"node-ca-5jmtt\" (UID: \"3027cbb6-dcdd-4888-ad76-6f7304468c90\") " pod="openshift-image-registry/node-ca-5jmtt" Sep 11 07:59:31.392198 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392197 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fef5351a-bbf7-427e-a915-33cabeeb7b84-iptables-alerter-script\") pod \"iptables-alerter-pj77b\" (UID: \"fef5351a-bbf7-427e-a915-33cabeeb7b84\") " pod="openshift-network-operator/iptables-alerter-pj77b" Sep 11 07:59:31.392462 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392218 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.392462 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392250 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lk9x\" (UniqueName: \"kubernetes.io/projected/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-kube-api-access-9lk9x\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.392462 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392307 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-ovnkube-config\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.392462 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392338 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 11 07:59:31.392462 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392386 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cwt9j" Sep 11 07:59:31.392462 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392393 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fef5351a-bbf7-427e-a915-33cabeeb7b84-host-slash\") pod \"iptables-alerter-pj77b\" (UID: \"fef5351a-bbf7-427e-a915-33cabeeb7b84\") " pod="openshift-network-operator/iptables-alerter-pj77b" Sep 11 07:59:31.392462 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls79w\" (UniqueName: \"kubernetes.io/projected/fef5351a-bbf7-427e-a915-33cabeeb7b84-kube-api-access-ls79w\") pod \"iptables-alerter-pj77b\" (UID: \"fef5351a-bbf7-427e-a915-33cabeeb7b84\") " pod="openshift-network-operator/iptables-alerter-pj77b" Sep 11 07:59:31.392776 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392493 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-run-netns\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.392776 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392534 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-var-lib-openvswitch\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.392776 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392561 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-run-openvswitch\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.392776 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392582 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-log-socket\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.392776 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392645 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6tn7\" (UniqueName: \"kubernetes.io/projected/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-kube-api-access-b6tn7\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.392776 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392681 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab5b4e73-cc00-407a-a103-9bdb0721cd6e-tmp-dir\") pod \"node-resolver-kxv89\" (UID: \"ab5b4e73-cc00-407a-a103-9bdb0721cd6e\") " pod="openshift-dns/node-resolver-kxv89" Sep 11 07:59:31.392776 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392736 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2tsm\" (UniqueName: \"kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm\") pod \"network-check-target-w4bks\" (UID: \"be19ae80-8995-4581-a152-16243aba132d\") " pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:31.392776 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392755 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-cnibin\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.393202 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392773 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-kubelet\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.393202 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392824 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-systemd-units\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.393202 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392844 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-slash\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.393202 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392857 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-etc-openvswitch\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.393202 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392870 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-node-log\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.393202 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392904 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-cni-bin\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.393202 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392924 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-cni-netd\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.393202 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392938 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3027cbb6-dcdd-4888-ad76-6f7304468c90-serviceca\") pod \"node-ca-5jmtt\" (UID: \"3027cbb6-dcdd-4888-ad76-6f7304468c90\") " pod="openshift-image-registry/node-ca-5jmtt" Sep 11 07:59:31.393202 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392952 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlk6q\" (UniqueName: \"kubernetes.io/projected/67dde785-fd0c-4213-81d9-bfb6374f6f13-kube-api-access-jlk6q\") pod \"network-metrics-daemon-t6dx2\" (UID: \"67dde785-fd0c-4213-81d9-bfb6374f6f13\") " pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:31.393202 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.392967 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-system-cni-dir\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.393202 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.393004 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-ovn-node-metrics-cert\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.393202 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.393023 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab5b4e73-cc00-407a-a103-9bdb0721cd6e-hosts-file\") pod \"node-resolver-kxv89\" (UID: \"ab5b4e73-cc00-407a-a103-9bdb0721cd6e\") " pod="openshift-dns/node-resolver-kxv89" Sep 11 07:59:31.393202 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.393035 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lhwh\" (UniqueName: \"kubernetes.io/projected/ab5b4e73-cc00-407a-a103-9bdb0721cd6e-kube-api-access-6lhwh\") pod \"node-resolver-kxv89\" (UID: \"ab5b4e73-cc00-407a-a103-9bdb0721cd6e\") " pod="openshift-dns/node-resolver-kxv89" Sep 11 07:59:31.393202 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.393049 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.393202 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.393074 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-run-systemd\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.393202 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.393122 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-run-ovn\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.393750 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.393159 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-env-overrides\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.393750 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.393185 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.393750 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.393643 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gnqld\"" Sep 11 07:59:31.393907 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.393758 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.394235 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.394215 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 11 07:59:31.394322 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.394240 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j29nr\"" Sep 11 07:59:31.394322 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.394247 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 11 07:59:31.394322 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.394261 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 11 07:59:31.394454 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.394388 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zjqfn\"" Sep 11 07:59:31.394893 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.394881 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 11 07:59:31.395006 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.394990 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:31.395090 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:31.395074 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn9jv" podUID="52fa5833-1275-4b8c-a8d7-74ad6fee8531" Sep 11 07:59:31.395147 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.395113 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 11 07:59:31.395873 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.395856 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nmt5k\"" Sep 11 07:59:31.395954 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.395880 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 11 07:59:31.402220 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.402202 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 07:59:31.417012 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.416964 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 07:54:31 +0000 UTC" deadline="2028-02-28 20:58:17.17664565 +0000 UTC" Sep 11 07:59:31.417109 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.417020 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12852h58m45.75963618s" Sep 11 07:59:31.437363 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.437345 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7vvh5" Sep 11 07:59:31.451882 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.451864 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7vvh5" Sep 11 07:59:31.486989 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:31.486938 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98923d77a9ea199e1311f70240dd5a1e.slice/crio-a25593fdc97748fc2577737e0452f237d22047e8a18b9e75d108597a51a1715d WatchSource:0}: Error finding container a25593fdc97748fc2577737e0452f237d22047e8a18b9e75d108597a51a1715d: Status 404 returned error can't find the container with id a25593fdc97748fc2577737e0452f237d22047e8a18b9e75d108597a51a1715d Sep 11 07:59:31.489012 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.488993 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 11 07:59:31.490144 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.490127 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 07:59:31.493684 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.493639 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-ovnkube-script-lib\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.493786 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.493694 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9n47\" (UniqueName: \"kubernetes.io/projected/b2c44f58-c837-4e3f-bf32-b3ec7f789118-kube-api-access-q9n47\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.493786 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.493715 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-kubernetes\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.493786 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.493740 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-sysctl-d\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.493786 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.493772 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de69987d-8ba1-4fe1-8fb8-68a8505373f3-tmp\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.494005 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.493788 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-cnibin\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.494005 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.493823 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2c44f58-c837-4e3f-bf32-b3ec7f789118-multus-daemon-config\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.494005 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.493850 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-lib-modules\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.494005 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.493863 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-tuned\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.494005 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.493877 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2c44f58-c837-4e3f-bf32-b3ec7f789118-cni-binary-copy\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.494005 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.493889 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-sys\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.494005 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.493903 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-var-lib-kubelet\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.494005 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.493954 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qqbg\" (UniqueName: \"kubernetes.io/projected/dcc4453b-813c-457a-89c3-7a17790176a2-kube-api-access-5qqbg\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.494377 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494037 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls79w\" (UniqueName: \"kubernetes.io/projected/fef5351a-bbf7-427e-a915-33cabeeb7b84-kube-api-access-ls79w\") pod \"iptables-alerter-pj77b\" (UID: \"fef5351a-bbf7-427e-a915-33cabeeb7b84\") " pod="openshift-network-operator/iptables-alerter-pj77b" Sep 11 07:59:31.494377 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494066 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-run-netns\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.494377 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494090 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-var-lib-openvswitch\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.494377 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494113 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-run-openvswitch\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.494377 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494132 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-run-netns\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.494377 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494138 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab5b4e73-cc00-407a-a103-9bdb0721cd6e-tmp-dir\") pod \"node-resolver-kxv89\" (UID: \"ab5b4e73-cc00-407a-a103-9bdb0721cd6e\") " pod="openshift-dns/node-resolver-kxv89" Sep 11 07:59:31.494377 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494197 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-run-k8s-cni-cncf-io\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.494377 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494226 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-registration-dir\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.494377 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494250 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-var-lib-cni-multus\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.494377 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494277 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-systemd-units\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.494377 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494303 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-etc-openvswitch\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.494377 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494326 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-cni-bin\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.494377 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494333 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-systemd-units\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.494377 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494348 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-cni-netd\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.494377 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494351 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-var-lib-openvswitch\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.494377 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494278 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-ovnkube-script-lib\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.494377 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494382 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-multus-cni-dir\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494409 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret\") pod \"global-pull-secret-syncer-bn9jv\" (UID: \"52fa5833-1275-4b8c-a8d7-74ad6fee8531\") " pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494416 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-cni-netd\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494438 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-run-openvswitch\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494449 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab5b4e73-cc00-407a-a103-9bdb0721cd6e-tmp-dir\") pod \"node-resolver-kxv89\" (UID: \"ab5b4e73-cc00-407a-a103-9bdb0721cd6e\") " pod="openshift-dns/node-resolver-kxv89" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494451 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-etc-openvswitch\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494481 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-cni-bin\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494486 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-host\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494512 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-hostroot\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494556 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-ovn-node-metrics-cert\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494650 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lhwh\" (UniqueName: \"kubernetes.io/projected/ab5b4e73-cc00-407a-a103-9bdb0721cd6e-kube-api-access-6lhwh\") pod \"node-resolver-kxv89\" (UID: \"ab5b4e73-cc00-407a-a103-9bdb0721cd6e\") " pod="openshift-dns/node-resolver-kxv89" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494677 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-socket-dir\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494702 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494728 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-run-systemd\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494759 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-run-ovn\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494783 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-env-overrides\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494835 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494867 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3027cbb6-dcdd-4888-ad76-6f7304468c90-host\") pod \"node-ca-5jmtt\" (UID: \"3027cbb6-dcdd-4888-ad76-6f7304468c90\") " pod="openshift-image-registry/node-ca-5jmtt" Sep 11 07:59:31.495289 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494872 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 11 07:59:31.495985 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494891 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.495985 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494916 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-sysctl-conf\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.495985 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494949 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-systemd\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.495985 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494959 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-run-ovn\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.495985 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.494979 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlgjt\" (UniqueName: \"kubernetes.io/projected/de69987d-8ba1-4fe1-8fb8-68a8505373f3-kube-api-access-nlgjt\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.495985 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495004 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.495985 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495054 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs\") pod \"network-metrics-daemon-t6dx2\" (UID: \"67dde785-fd0c-4213-81d9-bfb6374f6f13\") " pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:31.495985 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495078 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-system-cni-dir\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.495985 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495101 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-multus-socket-dir-parent\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.495985 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495124 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-run-multus-certs\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.495985 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495161 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-etc-kubernetes\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.495985 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495185 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96mjl\" (UniqueName: \"kubernetes.io/projected/3027cbb6-dcdd-4888-ad76-6f7304468c90-kube-api-access-96mjl\") pod \"node-ca-5jmtt\" (UID: \"3027cbb6-dcdd-4888-ad76-6f7304468c90\") " pod="openshift-image-registry/node-ca-5jmtt" Sep 11 07:59:31.495985 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495227 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fef5351a-bbf7-427e-a915-33cabeeb7b84-iptables-alerter-script\") pod \"iptables-alerter-pj77b\" (UID: \"fef5351a-bbf7-427e-a915-33cabeeb7b84\") " pod="openshift-network-operator/iptables-alerter-pj77b" Sep 11 07:59:31.495985 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495256 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.495985 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495282 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lk9x\" (UniqueName: \"kubernetes.io/projected/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-kube-api-access-9lk9x\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.495985 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495306 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-ovnkube-config\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.495985 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495328 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-run-netns\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.496878 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495350 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-modprobe-d\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.496878 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495375 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-run\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.496878 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495398 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fef5351a-bbf7-427e-a915-33cabeeb7b84-host-slash\") pod \"iptables-alerter-pj77b\" (UID: \"fef5351a-bbf7-427e-a915-33cabeeb7b84\") " pod="openshift-network-operator/iptables-alerter-pj77b" Sep 11 07:59:31.496878 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495424 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-log-socket\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.496878 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495439 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-env-overrides\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.496878 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495492 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.496878 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495514 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6tn7\" (UniqueName: \"kubernetes.io/projected/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-kube-api-access-b6tn7\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.496878 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495557 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-run-systemd\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.496878 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495587 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-var-lib-kubelet\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.496878 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495612 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52fa5833-1275-4b8c-a8d7-74ad6fee8531-dbus\") pod \"global-pull-secret-syncer-bn9jv\" (UID: \"52fa5833-1275-4b8c-a8d7-74ad6fee8531\") " pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:31.496878 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495636 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-sys-fs\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.496878 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495683 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2tsm\" (UniqueName: \"kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm\") pod \"network-check-target-w4bks\" (UID: \"be19ae80-8995-4581-a152-16243aba132d\") " pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:31.496878 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495724 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.496878 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495872 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.496878 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495876 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-cnibin\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.496878 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-kubelet\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.496878 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495945 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fef5351a-bbf7-427e-a915-33cabeeb7b84-host-slash\") pod \"iptables-alerter-pj77b\" (UID: \"fef5351a-bbf7-427e-a915-33cabeeb7b84\") " pod="openshift-network-operator/iptables-alerter-pj77b" Sep 11 07:59:31.497612 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495949 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-slash\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.497612 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495986 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-slash\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.497612 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.495989 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-node-log\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.497612 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496020 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab5b4e73-cc00-407a-a103-9bdb0721cd6e-hosts-file\") pod \"node-resolver-kxv89\" (UID: \"ab5b4e73-cc00-407a-a103-9bdb0721cd6e\") " pod="openshift-dns/node-resolver-kxv89" Sep 11 07:59:31.497612 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496026 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-node-log\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.497612 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496050 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-var-lib-cni-bin\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.497612 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496082 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-sysconfig\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.497612 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496093 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3027cbb6-dcdd-4888-ad76-6f7304468c90-host\") pod \"node-ca-5jmtt\" (UID: \"3027cbb6-dcdd-4888-ad76-6f7304468c90\") " pod="openshift-image-registry/node-ca-5jmtt" Sep 11 07:59:31.497612 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496080 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-log-socket\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.497612 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496116 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3027cbb6-dcdd-4888-ad76-6f7304468c90-serviceca\") pod \"node-ca-5jmtt\" (UID: \"3027cbb6-dcdd-4888-ad76-6f7304468c90\") " pod="openshift-image-registry/node-ca-5jmtt" Sep 11 07:59:31.497612 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496160 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-cnibin\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.497612 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:31.496232 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 07:59:31.497612 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496263 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.497612 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496278 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-ovnkube-config\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.497612 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:31.496295 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs podName:67dde785-fd0c-4213-81d9-bfb6374f6f13 nodeName:}" failed. No retries permitted until 2026-09-11 07:59:31.996276358 +0000 UTC m=+2.018783681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs") pod "network-metrics-daemon-t6dx2" (UID: "67dde785-fd0c-4213-81d9-bfb6374f6f13") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 07:59:31.497612 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496369 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlk6q\" (UniqueName: \"kubernetes.io/projected/67dde785-fd0c-4213-81d9-bfb6374f6f13-kube-api-access-jlk6q\") pod \"network-metrics-daemon-t6dx2\" (UID: \"67dde785-fd0c-4213-81d9-bfb6374f6f13\") " pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:31.497612 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496397 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-system-cni-dir\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.498367 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496423 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52fa5833-1275-4b8c-a8d7-74ad6fee8531-kubelet-config\") pod \"global-pull-secret-syncer-bn9jv\" (UID: \"52fa5833-1275-4b8c-a8d7-74ad6fee8531\") " pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:31.498367 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496471 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f5f8e54c-7423-45c3-ac35-955837d2b94f-agent-certs\") pod \"konnectivity-agent-cwt9j\" (UID: \"f5f8e54c-7423-45c3-ac35-955837d2b94f\") " pod="kube-system/konnectivity-agent-cwt9j" Sep 11 07:59:31.498367 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496497 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f5f8e54c-7423-45c3-ac35-955837d2b94f-konnectivity-ca\") pod \"konnectivity-agent-cwt9j\" (UID: \"f5f8e54c-7423-45c3-ac35-955837d2b94f\") " pod="kube-system/konnectivity-agent-cwt9j" Sep 11 07:59:31.498367 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496520 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-multus-conf-dir\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.498367 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-device-dir\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.498367 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496569 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-run-ovn-kubernetes\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.498367 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496595 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.498367 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496686 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ab5b4e73-cc00-407a-a103-9bdb0721cd6e-hosts-file\") pod \"node-resolver-kxv89\" (UID: \"ab5b4e73-cc00-407a-a103-9bdb0721cd6e\") " pod="openshift-dns/node-resolver-kxv89" Sep 11 07:59:31.498367 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496703 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3027cbb6-dcdd-4888-ad76-6f7304468c90-serviceca\") pod \"node-ca-5jmtt\" (UID: \"3027cbb6-dcdd-4888-ad76-6f7304468c90\") " pod="openshift-image-registry/node-ca-5jmtt" Sep 11 07:59:31.498367 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496728 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.498367 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496816 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-kubelet\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.498367 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496890 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-system-cni-dir\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.498367 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496939 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fef5351a-bbf7-427e-a915-33cabeeb7b84-iptables-alerter-script\") pod \"iptables-alerter-pj77b\" (UID: \"fef5351a-bbf7-427e-a915-33cabeeb7b84\") " pod="openshift-network-operator/iptables-alerter-pj77b" Sep 11 07:59:31.498367 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496951 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-run-ovn-kubernetes\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.498367 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.496942 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.498920 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.498896 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-ovn-node-metrics-cert\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.506582 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.506555 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls79w\" (UniqueName: \"kubernetes.io/projected/fef5351a-bbf7-427e-a915-33cabeeb7b84-kube-api-access-ls79w\") pod \"iptables-alerter-pj77b\" (UID: \"fef5351a-bbf7-427e-a915-33cabeeb7b84\") " pod="openshift-network-operator/iptables-alerter-pj77b" Sep 11 07:59:31.508333 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:31.508291 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 07:59:31.508333 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:31.508318 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 07:59:31.508493 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:31.508343 2566 projected.go:196] Error preparing data for projected volume kube-api-access-w2tsm for pod openshift-network-diagnostics/network-check-target-w4bks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 07:59:31.508493 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:31.508412 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm podName:be19ae80-8995-4581-a152-16243aba132d nodeName:}" failed. No retries permitted until 2026-09-11 07:59:32.008394586 +0000 UTC m=+2.030901897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w2tsm" (UniqueName: "kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm") pod "network-check-target-w4bks" (UID: "be19ae80-8995-4581-a152-16243aba132d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 07:59:31.510504 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.510478 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96mjl\" (UniqueName: \"kubernetes.io/projected/3027cbb6-dcdd-4888-ad76-6f7304468c90-kube-api-access-96mjl\") pod \"node-ca-5jmtt\" (UID: \"3027cbb6-dcdd-4888-ad76-6f7304468c90\") " pod="openshift-image-registry/node-ca-5jmtt" Sep 11 07:59:31.510781 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.510761 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlk6q\" (UniqueName: \"kubernetes.io/projected/67dde785-fd0c-4213-81d9-bfb6374f6f13-kube-api-access-jlk6q\") pod \"network-metrics-daemon-t6dx2\" (UID: \"67dde785-fd0c-4213-81d9-bfb6374f6f13\") " pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:31.510923 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.510904 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lk9x\" (UniqueName: \"kubernetes.io/projected/ce19aa94-ccc3-4aac-94b4-0c830c4d20c9-kube-api-access-9lk9x\") pod \"multus-additional-cni-plugins-kpk9z\" (UID: \"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9\") " pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.510923 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.510915 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lhwh\" (UniqueName: \"kubernetes.io/projected/ab5b4e73-cc00-407a-a103-9bdb0721cd6e-kube-api-access-6lhwh\") pod \"node-resolver-kxv89\" (UID: \"ab5b4e73-cc00-407a-a103-9bdb0721cd6e\") " pod="openshift-dns/node-resolver-kxv89" Sep 11 07:59:31.511271 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.511254 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6tn7\" (UniqueName: \"kubernetes.io/projected/ca7290a6-e3c2-46ca-a76f-15a2c63e8b97-kube-api-access-b6tn7\") pod \"ovnkube-node-9ljvr\" (UID: \"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97\") " pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.597714 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.597681 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f5f8e54c-7423-45c3-ac35-955837d2b94f-agent-certs\") pod \"konnectivity-agent-cwt9j\" (UID: \"f5f8e54c-7423-45c3-ac35-955837d2b94f\") " pod="kube-system/konnectivity-agent-cwt9j" Sep 11 07:59:31.597714 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.597709 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f5f8e54c-7423-45c3-ac35-955837d2b94f-konnectivity-ca\") pod \"konnectivity-agent-cwt9j\" (UID: \"f5f8e54c-7423-45c3-ac35-955837d2b94f\") " pod="kube-system/konnectivity-agent-cwt9j" Sep 11 07:59:31.597952 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.597724 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-multus-conf-dir\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.597952 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.597739 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-device-dir\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.597952 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.597827 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-multus-conf-dir\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.597952 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.597837 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-device-dir\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.597952 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.597927 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9n47\" (UniqueName: \"kubernetes.io/projected/b2c44f58-c837-4e3f-bf32-b3ec7f789118-kube-api-access-q9n47\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.598288 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598219 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-kubernetes\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.598345 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598313 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-sysctl-d\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.598394 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598344 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de69987d-8ba1-4fe1-8fb8-68a8505373f3-tmp\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.598394 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598375 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-cnibin\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.598483 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598398 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2c44f58-c837-4e3f-bf32-b3ec7f789118-multus-daemon-config\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.598483 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598428 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-lib-modules\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.598568 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598490 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-tuned\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.598568 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598530 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2c44f58-c837-4e3f-bf32-b3ec7f789118-cni-binary-copy\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.598568 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598556 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-sys\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.598696 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598584 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-var-lib-kubelet\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.598696 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598616 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qqbg\" (UniqueName: \"kubernetes.io/projected/dcc4453b-813c-457a-89c3-7a17790176a2-kube-api-access-5qqbg\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.598696 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598652 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-run-k8s-cni-cncf-io\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.598696 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598679 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-registration-dir\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.598918 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598709 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-var-lib-cni-multus\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.598918 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598746 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-multus-cni-dir\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.598918 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598792 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret\") pod \"global-pull-secret-syncer-bn9jv\" (UID: \"52fa5833-1275-4b8c-a8d7-74ad6fee8531\") " pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:31.598918 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598869 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-host\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.598918 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598892 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-hostroot\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.598918 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598923 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-socket-dir\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.599172 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598960 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-sysctl-conf\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.599172 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598989 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-systemd\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.599172 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599017 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlgjt\" (UniqueName: \"kubernetes.io/projected/de69987d-8ba1-4fe1-8fb8-68a8505373f3-kube-api-access-nlgjt\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.599172 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599044 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.599172 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599094 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-system-cni-dir\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.599172 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599121 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-multus-socket-dir-parent\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.599404 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599311 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-run-multus-certs\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.599404 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599348 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-etc-kubernetes\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.599404 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599389 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-run-netns\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.599528 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599421 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-modprobe-d\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.599528 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599449 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-run\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.599528 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599488 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-var-lib-kubelet\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.599650 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599522 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52fa5833-1275-4b8c-a8d7-74ad6fee8531-dbus\") pod \"global-pull-secret-syncer-bn9jv\" (UID: \"52fa5833-1275-4b8c-a8d7-74ad6fee8531\") " pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:31.599650 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599574 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-sys-fs\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.599650 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599625 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.599782 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599666 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-var-lib-cni-bin\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.599782 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599669 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-socket-dir\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.599782 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599733 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-var-lib-cni-bin\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.599782 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599776 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-sysconfig\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.599983 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599836 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52fa5833-1275-4b8c-a8d7-74ad6fee8531-kubelet-config\") pod \"global-pull-secret-syncer-bn9jv\" (UID: \"52fa5833-1275-4b8c-a8d7-74ad6fee8531\") " pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:31.599983 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.599953 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52fa5833-1275-4b8c-a8d7-74ad6fee8531-kubelet-config\") pod \"global-pull-secret-syncer-bn9jv\" (UID: \"52fa5833-1275-4b8c-a8d7-74ad6fee8531\") " pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600107 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-sysctl-conf\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600163 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2c44f58-c837-4e3f-bf32-b3ec7f789118-cni-binary-copy\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600197 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-systemd\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600239 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-sys\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600254 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600318 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-var-lib-kubelet\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600387 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-system-cni-dir\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600511 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-run-k8s-cni-cncf-io\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600520 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-multus-socket-dir-parent\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600573 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-registration-dir\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600664 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-modprobe-d\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:31.600671 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:31.600733 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret podName:52fa5833-1275-4b8c-a8d7-74ad6fee8531 nodeName:}" failed. No retries permitted until 2026-09-11 07:59:32.100715748 +0000 UTC m=+2.123223052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret") pod "global-pull-secret-syncer-bn9jv" (UID: "52fa5833-1275-4b8c-a8d7-74ad6fee8531") : object "kube-system"/"original-pull-secret" not registered Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600822 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-multus-cni-dir\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600878 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-var-lib-cni-multus\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600931 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-run\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.598741 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f5f8e54c-7423-45c3-ac35-955837d2b94f-konnectivity-ca\") pod \"konnectivity-agent-cwt9j\" (UID: \"f5f8e54c-7423-45c3-ac35-955837d2b94f\") " pod="kube-system/konnectivity-agent-cwt9j" Sep 11 07:59:31.601223 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600979 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-var-lib-kubelet\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.602064 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600999 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-hostroot\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.602064 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.601027 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-host\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.602064 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600609 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b2c44f58-c837-4e3f-bf32-b3ec7f789118-multus-daemon-config\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.602064 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.601049 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-run-multus-certs\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.602064 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.600576 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-etc-kubernetes\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.602064 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.601108 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-tuned\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.602064 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.601113 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-sys-fs\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.602064 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.601129 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-sysconfig\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.602064 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.601183 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52fa5833-1275-4b8c-a8d7-74ad6fee8531-dbus\") pod \"global-pull-secret-syncer-bn9jv\" (UID: \"52fa5833-1275-4b8c-a8d7-74ad6fee8531\") " pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:31.602064 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.601195 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-cnibin\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.602064 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.601209 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-lib-modules\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.602064 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.601263 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dcc4453b-813c-457a-89c3-7a17790176a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.602064 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.601338 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-sysctl-d\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.602064 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.601318 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de69987d-8ba1-4fe1-8fb8-68a8505373f3-tmp\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.602064 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.601386 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f5f8e54c-7423-45c3-ac35-955837d2b94f-agent-certs\") pod \"konnectivity-agent-cwt9j\" (UID: \"f5f8e54c-7423-45c3-ac35-955837d2b94f\") " pod="kube-system/konnectivity-agent-cwt9j" Sep 11 07:59:31.602662 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.602579 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2c44f58-c837-4e3f-bf32-b3ec7f789118-host-run-netns\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.602662 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.602650 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de69987d-8ba1-4fe1-8fb8-68a8505373f3-etc-kubernetes\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.623011 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.622981 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9n47\" (UniqueName: \"kubernetes.io/projected/b2c44f58-c837-4e3f-bf32-b3ec7f789118-kube-api-access-q9n47\") pod \"multus-lg5vk\" (UID: \"b2c44f58-c837-4e3f-bf32-b3ec7f789118\") " pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.625173 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.625150 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 07:59:31.625291 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.625179 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlgjt\" (UniqueName: \"kubernetes.io/projected/de69987d-8ba1-4fe1-8fb8-68a8505373f3-kube-api-access-nlgjt\") pod \"tuned-qv72v\" (UID: \"de69987d-8ba1-4fe1-8fb8-68a8505373f3\") " pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.625334 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.625323 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qqbg\" (UniqueName: \"kubernetes.io/projected/dcc4453b-813c-457a-89c3-7a17790176a2-kube-api-access-5qqbg\") pod \"aws-ebs-csi-driver-node-k9zxq\" (UID: \"dcc4453b-813c-457a-89c3-7a17790176a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.701405 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.701332 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kxv89" Sep 11 07:59:31.709959 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:31.709939 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab5b4e73_cc00_407a_a103_9bdb0721cd6e.slice/crio-6e9c5d8ede381b2491643f06289cb8ba0c4828994d1797ed278aaef7422c03a5 WatchSource:0}: Error finding container 6e9c5d8ede381b2491643f06289cb8ba0c4828994d1797ed278aaef7422c03a5: Status 404 returned error can't find the container with id 6e9c5d8ede381b2491643f06289cb8ba0c4828994d1797ed278aaef7422c03a5 Sep 11 07:59:31.716901 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.716885 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lg5vk" Sep 11 07:59:31.723433 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:31.723407 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c44f58_c837_4e3f_bf32_b3ec7f789118.slice/crio-f4ba3f8a87472bb66ed5a7b173b988f305787d02ce1f5e72e56b5d530ec36f31 WatchSource:0}: Error finding container f4ba3f8a87472bb66ed5a7b173b988f305787d02ce1f5e72e56b5d530ec36f31: Status 404 returned error can't find the container with id f4ba3f8a87472bb66ed5a7b173b988f305787d02ce1f5e72e56b5d530ec36f31 Sep 11 07:59:31.729353 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.729331 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5jmtt" Sep 11 07:59:31.734121 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.734101 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pj77b" Sep 11 07:59:31.739580 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:31.739561 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3027cbb6_dcdd_4888_ad76_6f7304468c90.slice/crio-b816cc10d56a2ca190f7b664a33e0bd82b0a38f941092f07d235d7d2da551897 WatchSource:0}: Error finding container b816cc10d56a2ca190f7b664a33e0bd82b0a38f941092f07d235d7d2da551897: Status 404 returned error can't find the container with id b816cc10d56a2ca190f7b664a33e0bd82b0a38f941092f07d235d7d2da551897 Sep 11 07:59:31.742321 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:31.742299 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef5351a_bbf7_427e_a915_33cabeeb7b84.slice/crio-60640eda915a9cb6ecf5fb4d54219b3cba936f92baa2ad842038ab6718d8b0f2 WatchSource:0}: Error finding container 60640eda915a9cb6ecf5fb4d54219b3cba936f92baa2ad842038ab6718d8b0f2: Status 404 returned error can't find the container with id 60640eda915a9cb6ecf5fb4d54219b3cba936f92baa2ad842038ab6718d8b0f2 Sep 11 07:59:31.754884 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.754863 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kpk9z" Sep 11 07:59:31.762053 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:31.762033 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce19aa94_ccc3_4aac_94b4_0c830c4d20c9.slice/crio-7f103f2bdb7b67807089452c36e0540f0392e5709759ac5de5d41088c56de243 WatchSource:0}: Error finding container 7f103f2bdb7b67807089452c36e0540f0392e5709759ac5de5d41088c56de243: Status 404 returned error can't find the container with id 7f103f2bdb7b67807089452c36e0540f0392e5709759ac5de5d41088c56de243 Sep 11 07:59:31.775562 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.775541 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:31.782315 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:31.782286 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca7290a6_e3c2_46ca_a76f_15a2c63e8b97.slice/crio-d433864e94beec297f04a7e4bbbf65272b83e2337526b195eedd90e82d6a7a87 WatchSource:0}: Error finding container d433864e94beec297f04a7e4bbbf65272b83e2337526b195eedd90e82d6a7a87: Status 404 returned error can't find the container with id d433864e94beec297f04a7e4bbbf65272b83e2337526b195eedd90e82d6a7a87 Sep 11 07:59:31.792193 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.792176 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qv72v" Sep 11 07:59:31.798028 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.798011 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" Sep 11 07:59:31.799088 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:31.799070 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde69987d_8ba1_4fe1_8fb8_68a8505373f3.slice/crio-8aa4c5185e0e344998450b102945f29790321c40e80d8b2c244050bc8ed12e45 WatchSource:0}: Error finding container 8aa4c5185e0e344998450b102945f29790321c40e80d8b2c244050bc8ed12e45: Status 404 returned error can't find the container with id 8aa4c5185e0e344998450b102945f29790321c40e80d8b2c244050bc8ed12e45 Sep 11 07:59:31.804169 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.804154 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cwt9j" Sep 11 07:59:31.805515 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:31.805494 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc4453b_813c_457a_89c3_7a17790176a2.slice/crio-6cb25bc7fbde634740b6231682c61429c49bdde6de07433a177c4eec415a7d60 WatchSource:0}: Error finding container 6cb25bc7fbde634740b6231682c61429c49bdde6de07433a177c4eec415a7d60: Status 404 returned error can't find the container with id 6cb25bc7fbde634740b6231682c61429c49bdde6de07433a177c4eec415a7d60 Sep 11 07:59:31.812017 ip-10-0-142-13 kubenswrapper[2566]: W0911 07:59:31.811987 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f8e54c_7423_45c3_ac35_955837d2b94f.slice/crio-31926771fa4344509ec369bd2f537db2520bb9dbc33e26aa45c6ddcb5671beba WatchSource:0}: Error finding container 31926771fa4344509ec369bd2f537db2520bb9dbc33e26aa45c6ddcb5671beba: Status 404 returned error can't find the container with id 31926771fa4344509ec369bd2f537db2520bb9dbc33e26aa45c6ddcb5671beba Sep 11 07:59:31.831698 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:31.831665 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 07:59:33.331182 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:33.331106 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs\") pod \"network-metrics-daemon-t6dx2\" (UID: \"67dde785-fd0c-4213-81d9-bfb6374f6f13\") " pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:33.331336 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:33.331274 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 07:59:33.331336 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:33.331334 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs podName:67dde785-fd0c-4213-81d9-bfb6374f6f13 nodeName:}" failed. No retries permitted until 2026-09-11 07:59:34.331318092 +0000 UTC m=+3.024683181 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs") pod "network-metrics-daemon-t6dx2" (UID: "67dde785-fd0c-4213-81d9-bfb6374f6f13") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 07:59:33.431952 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:33.431902 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret\") pod \"global-pull-secret-syncer-bn9jv\" (UID: \"52fa5833-1275-4b8c-a8d7-74ad6fee8531\") " pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:33.432124 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:33.431995 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2tsm\" (UniqueName: \"kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm\") pod \"network-check-target-w4bks\" (UID: \"be19ae80-8995-4581-a152-16243aba132d\") " pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:33.432124 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:33.432066 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 07:59:33.432227 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:33.432138 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret podName:52fa5833-1275-4b8c-a8d7-74ad6fee8531 nodeName:}" failed. No retries permitted until 2026-09-11 07:59:34.432119686 +0000 UTC m=+3.125484786 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret") pod "global-pull-secret-syncer-bn9jv" (UID: "52fa5833-1275-4b8c-a8d7-74ad6fee8531") : object "kube-system"/"original-pull-secret" not registered Sep 11 07:59:33.432227 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:33.432141 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 07:59:33.432227 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:33.432162 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 07:59:33.432227 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:33.432174 2566 projected.go:196] Error preparing data for projected volume kube-api-access-w2tsm for pod openshift-network-diagnostics/network-check-target-w4bks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 07:59:33.432227 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:33.432222 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm podName:be19ae80-8995-4581-a152-16243aba132d nodeName:}" failed. No retries permitted until 2026-09-11 07:59:34.432207145 +0000 UTC m=+3.125572244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2tsm" (UniqueName: "kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm") pod "network-check-target-w4bks" (UID: "be19ae80-8995-4581-a152-16243aba132d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 07:59:33.784493 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:33.784308 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 07:54:32 +0000 UTC" deadline="2028-02-24 06:31:02.548481604 +0000 UTC" Sep 11 07:59:33.784493 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:33.784366 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12742h31m28.764119625s" Sep 11 07:59:33.800682 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:33.800622 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" event={"ID":"dcc4453b-813c-457a-89c3-7a17790176a2","Type":"ContainerStarted","Data":"6cb25bc7fbde634740b6231682c61429c49bdde6de07433a177c4eec415a7d60"} Sep 11 07:59:33.811808 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:33.811771 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qv72v" event={"ID":"de69987d-8ba1-4fe1-8fb8-68a8505373f3","Type":"ContainerStarted","Data":"8aa4c5185e0e344998450b102945f29790321c40e80d8b2c244050bc8ed12e45"} Sep 11 07:59:33.828591 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:33.828552 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" event={"ID":"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97","Type":"ContainerStarted","Data":"d433864e94beec297f04a7e4bbbf65272b83e2337526b195eedd90e82d6a7a87"} Sep 11 07:59:33.844726 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:33.844672 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lg5vk" event={"ID":"b2c44f58-c837-4e3f-bf32-b3ec7f789118","Type":"ContainerStarted","Data":"f4ba3f8a87472bb66ed5a7b173b988f305787d02ce1f5e72e56b5d530ec36f31"} Sep 11 07:59:33.856478 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:33.856394 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kxv89" event={"ID":"ab5b4e73-cc00-407a-a103-9bdb0721cd6e","Type":"ContainerStarted","Data":"6e9c5d8ede381b2491643f06289cb8ba0c4828994d1797ed278aaef7422c03a5"} Sep 11 07:59:33.860666 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:33.860580 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal" event={"ID":"98923d77a9ea199e1311f70240dd5a1e","Type":"ContainerStarted","Data":"a25593fdc97748fc2577737e0452f237d22047e8a18b9e75d108597a51a1715d"} Sep 11 07:59:33.871844 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:33.871774 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-13.ec2.internal" event={"ID":"ccad160e38c411773147acccf0c917ed","Type":"ContainerStarted","Data":"cd7b4767e7500b4a044429982509180c5e2608ffcca752df9ceb903e60bf3a08"} Sep 11 07:59:33.895847 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:33.895756 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cwt9j" event={"ID":"f5f8e54c-7423-45c3-ac35-955837d2b94f","Type":"ContainerStarted","Data":"31926771fa4344509ec369bd2f537db2520bb9dbc33e26aa45c6ddcb5671beba"} Sep 11 07:59:33.911024 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:33.910978 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpk9z" event={"ID":"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9","Type":"ContainerStarted","Data":"7f103f2bdb7b67807089452c36e0540f0392e5709759ac5de5d41088c56de243"} Sep 11 07:59:33.916686 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:33.916658 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pj77b" event={"ID":"fef5351a-bbf7-427e-a915-33cabeeb7b84","Type":"ContainerStarted","Data":"60640eda915a9cb6ecf5fb4d54219b3cba936f92baa2ad842038ab6718d8b0f2"} Sep 11 07:59:33.920854 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:33.920745 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5jmtt" event={"ID":"3027cbb6-dcdd-4888-ad76-6f7304468c90","Type":"ContainerStarted","Data":"b816cc10d56a2ca190f7b664a33e0bd82b0a38f941092f07d235d7d2da551897"} Sep 11 07:59:34.032549 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:34.032518 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 07:59:34.339555 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:34.339511 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs\") pod \"network-metrics-daemon-t6dx2\" (UID: \"67dde785-fd0c-4213-81d9-bfb6374f6f13\") " pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:34.339728 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:34.339680 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 07:59:34.339803 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:34.339744 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs podName:67dde785-fd0c-4213-81d9-bfb6374f6f13 nodeName:}" failed. No retries permitted until 2026-09-11 07:59:36.33972604 +0000 UTC m=+5.033091137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs") pod "network-metrics-daemon-t6dx2" (UID: "67dde785-fd0c-4213-81d9-bfb6374f6f13") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 07:59:34.440202 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:34.440157 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2tsm\" (UniqueName: \"kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm\") pod \"network-check-target-w4bks\" (UID: \"be19ae80-8995-4581-a152-16243aba132d\") " pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:34.440380 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:34.440238 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret\") pod \"global-pull-secret-syncer-bn9jv\" (UID: \"52fa5833-1275-4b8c-a8d7-74ad6fee8531\") " pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:34.440380 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:34.440374 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 07:59:34.440490 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:34.440436 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret podName:52fa5833-1275-4b8c-a8d7-74ad6fee8531 nodeName:}" failed. No retries permitted until 2026-09-11 07:59:36.440419313 +0000 UTC m=+5.133784410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret") pod "global-pull-secret-syncer-bn9jv" (UID: "52fa5833-1275-4b8c-a8d7-74ad6fee8531") : object "kube-system"/"original-pull-secret" not registered Sep 11 07:59:34.440868 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:34.440850 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 07:59:34.441105 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:34.440873 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 07:59:34.441105 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:34.440885 2566 projected.go:196] Error preparing data for projected volume kube-api-access-w2tsm for pod openshift-network-diagnostics/network-check-target-w4bks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 07:59:34.441105 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:34.440930 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm podName:be19ae80-8995-4581-a152-16243aba132d nodeName:}" failed. No retries permitted until 2026-09-11 07:59:36.440915232 +0000 UTC m=+5.134280338 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2tsm" (UniqueName: "kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm") pod "network-check-target-w4bks" (UID: "be19ae80-8995-4581-a152-16243aba132d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 07:59:34.782260 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:34.782178 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:34.782433 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:34.782292 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn9jv" podUID="52fa5833-1275-4b8c-a8d7-74ad6fee8531" Sep 11 07:59:34.782600 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:34.782583 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:34.782665 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:34.782649 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4bks" podUID="be19ae80-8995-4581-a152-16243aba132d" Sep 11 07:59:34.782727 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:34.782697 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:34.782779 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:34.782760 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6dx2" podUID="67dde785-fd0c-4213-81d9-bfb6374f6f13" Sep 11 07:59:34.786306 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:34.786253 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 07:54:32 +0000 UTC" deadline="2028-02-28 22:51:06.653343873 +0000 UTC" Sep 11 07:59:34.786306 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:34.786304 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12854h51m31.867043092s" Sep 11 07:59:34.827993 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:34.827963 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 07:59:36.359006 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:36.358970 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs\") pod \"network-metrics-daemon-t6dx2\" (UID: \"67dde785-fd0c-4213-81d9-bfb6374f6f13\") " pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:36.359641 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:36.359141 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 07:59:36.359641 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:36.359204 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs podName:67dde785-fd0c-4213-81d9-bfb6374f6f13 nodeName:}" failed. No retries permitted until 2026-09-11 07:59:40.359185183 +0000 UTC m=+9.052550280 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs") pod "network-metrics-daemon-t6dx2" (UID: "67dde785-fd0c-4213-81d9-bfb6374f6f13") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 07:59:36.459490 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:36.459452 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret\") pod \"global-pull-secret-syncer-bn9jv\" (UID: \"52fa5833-1275-4b8c-a8d7-74ad6fee8531\") " pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:36.459656 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:36.459536 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2tsm\" (UniqueName: \"kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm\") pod \"network-check-target-w4bks\" (UID: \"be19ae80-8995-4581-a152-16243aba132d\") " pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:36.459732 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:36.459701 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 07:59:36.459732 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:36.459720 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 07:59:36.459732 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:36.459732 2566 projected.go:196] Error preparing data for projected volume kube-api-access-w2tsm for pod openshift-network-diagnostics/network-check-target-w4bks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 07:59:36.459872 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:36.459785 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm podName:be19ae80-8995-4581-a152-16243aba132d nodeName:}" failed. No retries permitted until 2026-09-11 07:59:40.459769412 +0000 UTC m=+9.153134515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2tsm" (UniqueName: "kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm") pod "network-check-target-w4bks" (UID: "be19ae80-8995-4581-a152-16243aba132d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 07:59:36.460100 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:36.460074 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 07:59:36.460238 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:36.460152 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret podName:52fa5833-1275-4b8c-a8d7-74ad6fee8531 nodeName:}" failed. No retries permitted until 2026-09-11 07:59:40.460134235 +0000 UTC m=+9.153499334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret") pod "global-pull-secret-syncer-bn9jv" (UID: "52fa5833-1275-4b8c-a8d7-74ad6fee8531") : object "kube-system"/"original-pull-secret" not registered Sep 11 07:59:36.782599 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:36.782493 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:36.782741 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:36.782635 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn9jv" podUID="52fa5833-1275-4b8c-a8d7-74ad6fee8531" Sep 11 07:59:36.783058 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:36.783037 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:36.783173 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:36.783129 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4bks" podUID="be19ae80-8995-4581-a152-16243aba132d" Sep 11 07:59:36.783230 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:36.783174 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:36.783284 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:36.783255 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6dx2" podUID="67dde785-fd0c-4213-81d9-bfb6374f6f13" Sep 11 07:59:38.782368 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:38.781986 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:38.782368 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:38.782026 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:38.782368 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:38.782027 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:38.782368 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:38.782187 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6dx2" podUID="67dde785-fd0c-4213-81d9-bfb6374f6f13" Sep 11 07:59:38.782368 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:38.782273 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4bks" podUID="be19ae80-8995-4581-a152-16243aba132d" Sep 11 07:59:38.782368 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:38.782338 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn9jv" podUID="52fa5833-1275-4b8c-a8d7-74ad6fee8531" Sep 11 07:59:40.390727 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:40.390154 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs\") pod \"network-metrics-daemon-t6dx2\" (UID: \"67dde785-fd0c-4213-81d9-bfb6374f6f13\") " pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:40.390727 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:40.390345 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 07:59:40.390727 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:40.390410 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs podName:67dde785-fd0c-4213-81d9-bfb6374f6f13 nodeName:}" failed. No retries permitted until 2026-09-11 07:59:48.390392223 +0000 UTC m=+17.083757312 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs") pod "network-metrics-daemon-t6dx2" (UID: "67dde785-fd0c-4213-81d9-bfb6374f6f13") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 07:59:40.491740 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:40.491004 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret\") pod \"global-pull-secret-syncer-bn9jv\" (UID: \"52fa5833-1275-4b8c-a8d7-74ad6fee8531\") " pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:40.491740 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:40.491087 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2tsm\" (UniqueName: \"kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm\") pod \"network-check-target-w4bks\" (UID: \"be19ae80-8995-4581-a152-16243aba132d\") " pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:40.491740 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:40.491239 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 07:59:40.491740 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:40.491257 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 07:59:40.491740 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:40.491266 2566 projected.go:196] Error preparing data for projected volume kube-api-access-w2tsm for pod openshift-network-diagnostics/network-check-target-w4bks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 07:59:40.491740 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:40.491314 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm podName:be19ae80-8995-4581-a152-16243aba132d nodeName:}" failed. No retries permitted until 2026-09-11 07:59:48.491297788 +0000 UTC m=+17.184662891 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2tsm" (UniqueName: "kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm") pod "network-check-target-w4bks" (UID: "be19ae80-8995-4581-a152-16243aba132d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 07:59:40.491740 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:40.491659 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 07:59:40.491740 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:40.491709 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret podName:52fa5833-1275-4b8c-a8d7-74ad6fee8531 nodeName:}" failed. No retries permitted until 2026-09-11 07:59:48.491693701 +0000 UTC m=+17.185058803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret") pod "global-pull-secret-syncer-bn9jv" (UID: "52fa5833-1275-4b8c-a8d7-74ad6fee8531") : object "kube-system"/"original-pull-secret" not registered Sep 11 07:59:40.782667 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:40.782282 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:40.782667 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:40.782320 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:40.782667 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:40.782282 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:40.782667 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:40.782404 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn9jv" podUID="52fa5833-1275-4b8c-a8d7-74ad6fee8531" Sep 11 07:59:40.782667 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:40.782548 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4bks" podUID="be19ae80-8995-4581-a152-16243aba132d" Sep 11 07:59:40.782667 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:40.782615 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6dx2" podUID="67dde785-fd0c-4213-81d9-bfb6374f6f13" Sep 11 07:59:42.782040 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:42.781995 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:42.782040 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:42.782044 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:42.782499 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:42.782009 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:42.782499 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:42.782152 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn9jv" podUID="52fa5833-1275-4b8c-a8d7-74ad6fee8531" Sep 11 07:59:42.782499 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:42.782216 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4bks" podUID="be19ae80-8995-4581-a152-16243aba132d" Sep 11 07:59:42.782499 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:42.782305 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6dx2" podUID="67dde785-fd0c-4213-81d9-bfb6374f6f13" Sep 11 07:59:44.782681 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:44.782645 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:44.783152 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:44.782776 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn9jv" podUID="52fa5833-1275-4b8c-a8d7-74ad6fee8531" Sep 11 07:59:44.783152 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:44.782792 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:44.783152 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:44.782823 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:44.783152 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:44.782909 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4bks" podUID="be19ae80-8995-4581-a152-16243aba132d" Sep 11 07:59:44.783152 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:44.783001 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6dx2" podUID="67dde785-fd0c-4213-81d9-bfb6374f6f13" Sep 11 07:59:46.781926 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:46.781891 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:46.781926 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:46.781911 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:46.781926 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:46.781891 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:46.782454 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:46.782038 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4bks" podUID="be19ae80-8995-4581-a152-16243aba132d" Sep 11 07:59:46.782454 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:46.782189 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6dx2" podUID="67dde785-fd0c-4213-81d9-bfb6374f6f13" Sep 11 07:59:46.782454 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:46.782274 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn9jv" podUID="52fa5833-1275-4b8c-a8d7-74ad6fee8531" Sep 11 07:59:48.449733 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:48.449700 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs\") pod \"network-metrics-daemon-t6dx2\" (UID: \"67dde785-fd0c-4213-81d9-bfb6374f6f13\") " pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:48.450187 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:48.449866 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 07:59:48.450187 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:48.449934 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs podName:67dde785-fd0c-4213-81d9-bfb6374f6f13 nodeName:}" failed. No retries permitted until 2026-09-11 08:00:04.449915546 +0000 UTC m=+33.143280649 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs") pod "network-metrics-daemon-t6dx2" (UID: "67dde785-fd0c-4213-81d9-bfb6374f6f13") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 07:59:48.550074 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:48.550036 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret\") pod \"global-pull-secret-syncer-bn9jv\" (UID: \"52fa5833-1275-4b8c-a8d7-74ad6fee8531\") " pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:48.550255 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:48.550095 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2tsm\" (UniqueName: \"kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm\") pod \"network-check-target-w4bks\" (UID: \"be19ae80-8995-4581-a152-16243aba132d\") " pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:48.550255 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:48.550215 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 07:59:48.550255 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:48.550236 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 07:59:48.550255 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:48.550248 2566 projected.go:196] Error preparing data for projected volume kube-api-access-w2tsm for pod openshift-network-diagnostics/network-check-target-w4bks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 07:59:48.550451 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:48.550346 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm podName:be19ae80-8995-4581-a152-16243aba132d nodeName:}" failed. No retries permitted until 2026-09-11 08:00:04.550283209 +0000 UTC m=+33.243648294 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2tsm" (UniqueName: "kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm") pod "network-check-target-w4bks" (UID: "be19ae80-8995-4581-a152-16243aba132d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 07:59:48.550451 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:48.550432 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 07:59:48.550551 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:48.550494 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret podName:52fa5833-1275-4b8c-a8d7-74ad6fee8531 nodeName:}" failed. No retries permitted until 2026-09-11 08:00:04.55047538 +0000 UTC m=+33.243840465 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret") pod "global-pull-secret-syncer-bn9jv" (UID: "52fa5833-1275-4b8c-a8d7-74ad6fee8531") : object "kube-system"/"original-pull-secret" not registered Sep 11 07:59:48.782328 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:48.782255 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:48.782484 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:48.782255 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:48.782484 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:48.782382 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6dx2" podUID="67dde785-fd0c-4213-81d9-bfb6374f6f13" Sep 11 07:59:48.782484 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:48.782440 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn9jv" podUID="52fa5833-1275-4b8c-a8d7-74ad6fee8531" Sep 11 07:59:48.782484 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:48.782255 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:48.782632 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:48.782516 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4bks" podUID="be19ae80-8995-4581-a152-16243aba132d" Sep 11 07:59:50.782614 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:50.782574 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:50.783099 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:50.782573 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:50.783099 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:50.782573 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:50.783350 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:50.783250 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6dx2" podUID="67dde785-fd0c-4213-81d9-bfb6374f6f13" Sep 11 07:59:50.783350 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:50.782687 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn9jv" podUID="52fa5833-1275-4b8c-a8d7-74ad6fee8531" Sep 11 07:59:50.783350 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:50.783108 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4bks" podUID="be19ae80-8995-4581-a152-16243aba132d" Sep 11 07:59:51.985866 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:51.985643 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qv72v" event={"ID":"de69987d-8ba1-4fe1-8fb8-68a8505373f3","Type":"ContainerStarted","Data":"925fc413886ce47f423e1e0bf0796a7c99d84dd117a3b70437de946a2b12c5bd"} Sep 11 07:59:51.987992 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:51.987971 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 07:59:51.988345 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:51.988324 2566 generic.go:356] "Generic (PLEG): container finished" podID="ca7290a6-e3c2-46ca-a76f-15a2c63e8b97" containerID="058eee1ac733b362c6091e3fb14f38401dc04ca22b0ad5e4bf94c1cb1ed0fe86" exitCode=1 Sep 11 07:59:51.988412 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:51.988394 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" event={"ID":"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97","Type":"ContainerStarted","Data":"290c4812d20b5fdac2da773e20e7911fbb391ce3939b50888172f654cb28f854"} Sep 11 07:59:51.988485 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:51.988471 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" event={"ID":"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97","Type":"ContainerStarted","Data":"06c0addcd42344025bdee51f129d2b74db6d7886e8b1cd368c86fe1d2a44201d"} Sep 11 07:59:51.988541 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:51.988529 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" event={"ID":"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97","Type":"ContainerDied","Data":"058eee1ac733b362c6091e3fb14f38401dc04ca22b0ad5e4bf94c1cb1ed0fe86"} Sep 11 07:59:51.988595 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:51.988582 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" event={"ID":"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97","Type":"ContainerStarted","Data":"8f0b49a10716bd052217cc224f98ad95a213f8ccbd82cff66a7f984d59b1b51e"} Sep 11 07:59:51.989911 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:51.989890 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-13.ec2.internal" event={"ID":"ccad160e38c411773147acccf0c917ed","Type":"ContainerStarted","Data":"fcf8ecae87e2e4627b12c3aa5628880f06bf981bfd9e1e4dcc280417d9764cc9"} Sep 11 07:59:52.025636 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:52.025578 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-13.ec2.internal" podStartSLOduration=20.025535748 podStartE2EDuration="20.025535748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 07:59:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 07:59:52.0255576 +0000 UTC m=+20.718922698" watchObservedRunningTime="2026-09-11 07:59:52.025535748 +0000 UTC m=+20.718900855" Sep 11 07:59:52.026106 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:52.026067 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qv72v" podStartSLOduration=1.84257865 podStartE2EDuration="20.026058845s" totalImagesPullingTime="18.183480195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 07:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 07:59:52.0088234 +0000 UTC m=+20.702188505" watchObservedRunningTime="2026-09-11 07:59:52.026058845 +0000 UTC m=+20.719423951" Sep 11 07:59:52.782310 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:52.782059 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:52.782476 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:52.782141 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:52.782476 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:52.782426 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6dx2" podUID="67dde785-fd0c-4213-81d9-bfb6374f6f13" Sep 11 07:59:52.782476 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:52.782452 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4bks" podUID="be19ae80-8995-4581-a152-16243aba132d" Sep 11 07:59:52.782476 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:52.782149 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:52.782681 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:52.782524 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn9jv" podUID="52fa5833-1275-4b8c-a8d7-74ad6fee8531" Sep 11 07:59:52.993793 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:52.993705 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cwt9j" event={"ID":"f5f8e54c-7423-45c3-ac35-955837d2b94f","Type":"ContainerStarted","Data":"c34380da8c7b746e6b6b82a4a01afc210e729816646db9bca035bcb1ee4d4133"} Sep 11 07:59:52.995490 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:52.995459 2566 generic.go:356] "Generic (PLEG): container finished" podID="ce19aa94-ccc3-4aac-94b4-0c830c4d20c9" containerID="e586d080b5d8786f85f5e71c39a318d15e1de20cda983e951825f6362740b0c5" exitCode=0 Sep 11 07:59:52.995690 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:52.995537 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpk9z" event={"ID":"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9","Type":"ContainerDied","Data":"e586d080b5d8786f85f5e71c39a318d15e1de20cda983e951825f6362740b0c5"} Sep 11 07:59:52.997743 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:52.997714 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pj77b" event={"ID":"fef5351a-bbf7-427e-a915-33cabeeb7b84","Type":"ContainerStarted","Data":"77f6e5f2201098c8ccedfcd1c57366b5bea8e22560a6c2810f5bc865f9feb2e8"} Sep 11 07:59:52.999400 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:52.999354 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5jmtt" event={"ID":"3027cbb6-dcdd-4888-ad76-6f7304468c90","Type":"ContainerStarted","Data":"4e394a320d322b55255ee784ab7a8ed0a7e44a9a4d40732f6aa9a4da9a838a04"} Sep 11 07:59:53.000914 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:53.000886 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" event={"ID":"dcc4453b-813c-457a-89c3-7a17790176a2","Type":"ContainerStarted","Data":"b1d78d7373715031e6f076ced2a65fa0331ff39fb9f9dfdccc9f2d464ec7f4bb"} Sep 11 07:59:53.004657 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:53.004638 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 07:59:53.005077 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:53.005055 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" event={"ID":"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97","Type":"ContainerStarted","Data":"9823336c98880e3af807a102254579dc2621f41567c389ac2a88a39ca1e61d54"} Sep 11 07:59:53.005146 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:53.005118 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" event={"ID":"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97","Type":"ContainerStarted","Data":"d1ac015d994f81dd41e0d224258de4fb12bbcdf2bd81c549f1ce838843740308"} Sep 11 07:59:53.008755 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:53.008725 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lg5vk" event={"ID":"b2c44f58-c837-4e3f-bf32-b3ec7f789118","Type":"ContainerStarted","Data":"7516e985e31a540a114b453e29684718171931fd368192a0c1a8c0074b5af0d4"} Sep 11 07:59:53.010572 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:53.010525 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cwt9j" podStartSLOduration=2.841909583 podStartE2EDuration="21.010509088s" totalImagesPullingTime="18.168599505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 07:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 07:59:53.010161172 +0000 UTC m=+21.703526281" watchObservedRunningTime="2026-09-11 07:59:53.010509088 +0000 UTC m=+21.703874194" Sep 11 07:59:53.010831 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:53.010800 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kxv89" event={"ID":"ab5b4e73-cc00-407a-a103-9bdb0721cd6e","Type":"ContainerStarted","Data":"e700978dcf875ac9bcc572c1c3a48ae4eeef8c0722357ab95e88c1ea7903f36f"} Sep 11 07:59:53.012664 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:53.012640 2566 generic.go:356] "Generic (PLEG): container finished" podID="98923d77a9ea199e1311f70240dd5a1e" containerID="e3f43564fe088217c2f8486327bfcb2bd7787e521c17b6a508f9c7b2bc8a367c" exitCode=0 Sep 11 07:59:53.012758 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:53.012689 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal" event={"ID":"98923d77a9ea199e1311f70240dd5a1e","Type":"ContainerDied","Data":"e3f43564fe088217c2f8486327bfcb2bd7787e521c17b6a508f9c7b2bc8a367c"} Sep 11 07:59:53.026330 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:53.026282 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5jmtt" podStartSLOduration=3.786129057 podStartE2EDuration="22.02626796s" totalImagesPullingTime="18.240138903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 07:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 07:59:53.025697884 +0000 UTC m=+21.719062990" watchObservedRunningTime="2026-09-11 07:59:53.02626796 +0000 UTC m=+21.719633096" Sep 11 07:59:53.065932 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:53.065874 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pj77b" podStartSLOduration=3.845745189 podStartE2EDuration="22.065853738s" totalImagesPullingTime="18.220108549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 07:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 07:59:53.041971804 +0000 UTC m=+21.735336914" watchObservedRunningTime="2026-09-11 07:59:53.065853738 +0000 UTC m=+21.759218847" Sep 11 07:59:53.091814 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:53.091603 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lg5vk" podStartSLOduration=2.094538331 podStartE2EDuration="21.091583022s" totalImagesPullingTime="18.997044691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 07:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 07:59:53.091374365 +0000 UTC m=+21.784739472" watchObservedRunningTime="2026-09-11 07:59:53.091583022 +0000 UTC m=+21.784948126" Sep 11 07:59:53.168782 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:53.168762 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 11 07:59:53.781450 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:53.781332 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T07:59:53.168778863Z","UUID":"fa36bcf9-5f65-49c3-a65b-5642206125cd","Handler":null,"Name":"","Endpoint":""} Sep 11 07:59:53.782955 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:53.782918 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 11 07:59:53.783088 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:53.782968 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 11 07:59:54.016822 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:54.016789 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal" event={"ID":"98923d77a9ea199e1311f70240dd5a1e","Type":"ContainerStarted","Data":"79da33afcee84426f88d5314cd0c4f6f22946180c23506112d6f7f60cdabe315"} Sep 11 07:59:54.019195 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:54.019155 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" event={"ID":"dcc4453b-813c-457a-89c3-7a17790176a2","Type":"ContainerStarted","Data":"d7c1199ffdee0bd41b37226fc22dcaed47291af9ce5c7cf0c70a53cc1f8bfa79"} Sep 11 07:59:54.036288 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:54.036195 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kxv89" podStartSLOduration=4.7661116660000005 podStartE2EDuration="23.036178536s" totalImagesPullingTime="18.27006687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 07:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 07:59:53.175777817 +0000 UTC m=+21.869142921" watchObservedRunningTime="2026-09-11 07:59:54.036178536 +0000 UTC m=+22.729543699" Sep 11 07:59:54.508807 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:54.508779 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cwt9j" Sep 11 07:59:54.509627 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:54.509606 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cwt9j" Sep 11 07:59:54.532210 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:54.532148 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-13.ec2.internal" podStartSLOduration=22.532124923 podStartE2EDuration="22.532124923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 07:59:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 07:59:54.035709699 +0000 UTC m=+22.729074806" watchObservedRunningTime="2026-09-11 07:59:54.532124923 +0000 UTC m=+23.225490029" Sep 11 07:59:54.782223 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:54.782137 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:54.782389 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:54.782137 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:54.782389 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:54.782266 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn9jv" podUID="52fa5833-1275-4b8c-a8d7-74ad6fee8531" Sep 11 07:59:54.782389 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:54.782145 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:54.782389 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:54.782367 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6dx2" podUID="67dde785-fd0c-4213-81d9-bfb6374f6f13" Sep 11 07:59:54.782545 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:54.782460 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4bks" podUID="be19ae80-8995-4581-a152-16243aba132d" Sep 11 07:59:55.023379 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:55.023344 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" event={"ID":"dcc4453b-813c-457a-89c3-7a17790176a2","Type":"ContainerStarted","Data":"4a541330591eb430dc2d0b21ea16b3129d4fb0063ce130d17c99ea721cfd1fba"} Sep 11 07:59:55.026419 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:55.026392 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 07:59:55.026807 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:55.026784 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" event={"ID":"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97","Type":"ContainerStarted","Data":"5d620a266a226ee4baa41262d639fb0e4d696055bd164445be6354db1bb33df8"} Sep 11 07:59:55.027109 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:55.027087 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cwt9j" Sep 11 07:59:55.027565 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:55.027549 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cwt9j" Sep 11 07:59:55.043782 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:55.043703 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k9zxq" podStartSLOduration=3.289769651 podStartE2EDuration="23.043687589s" totalImagesPullingTime="19.753917938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 07:59:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 07:59:55.04318621 +0000 UTC m=+23.736551322" watchObservedRunningTime="2026-09-11 07:59:55.043687589 +0000 UTC m=+23.737052749" Sep 11 07:59:56.782186 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:56.782153 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:56.782668 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:56.782153 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:56.782668 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:56.782282 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4bks" podUID="be19ae80-8995-4581-a152-16243aba132d" Sep 11 07:59:56.782668 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:56.782153 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:56.782668 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:56.782366 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn9jv" podUID="52fa5833-1275-4b8c-a8d7-74ad6fee8531" Sep 11 07:59:56.782668 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:56.782418 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6dx2" podUID="67dde785-fd0c-4213-81d9-bfb6374f6f13" Sep 11 07:59:58.036485 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:58.036302 2566 generic.go:356] "Generic (PLEG): container finished" podID="ce19aa94-ccc3-4aac-94b4-0c830c4d20c9" containerID="5fecc090d1f2bc5756d785fb488e95bc4958e4f74ca99278e195055b24507fe1" exitCode=0 Sep 11 07:59:58.037027 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:58.036387 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpk9z" event={"ID":"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9","Type":"ContainerDied","Data":"5fecc090d1f2bc5756d785fb488e95bc4958e4f74ca99278e195055b24507fe1"} Sep 11 07:59:58.040151 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:58.040129 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 07:59:58.040497 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:58.040478 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" event={"ID":"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97","Type":"ContainerStarted","Data":"bb6a4d8709cc78c791ff23113e1201175309754a182875778237b21ac234a7f5"} Sep 11 07:59:58.040675 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:58.040659 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:58.040745 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:58.040700 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:58.040892 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:58.040876 2566 scope.go:117] "RemoveContainer" containerID="058eee1ac733b362c6091e3fb14f38401dc04ca22b0ad5e4bf94c1cb1ed0fe86" Sep 11 07:59:58.056838 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:58.056818 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:58.782647 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:58.782607 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:58.782647 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:58.782635 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:58.782647 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:58.782644 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:58.782917 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:58.782733 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6dx2" podUID="67dde785-fd0c-4213-81d9-bfb6374f6f13" Sep 11 07:59:58.782917 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:58.782843 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4bks" podUID="be19ae80-8995-4581-a152-16243aba132d" Sep 11 07:59:58.782917 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:58.782909 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn9jv" podUID="52fa5833-1275-4b8c-a8d7-74ad6fee8531" Sep 11 07:59:59.047227 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:59.047159 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 07:59:59.048043 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:59.047562 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" event={"ID":"ca7290a6-e3c2-46ca-a76f-15a2c63e8b97","Type":"ContainerStarted","Data":"3925a67479338511808105588386517b83f62196c9ec630a6994a8dca9a0807a"} Sep 11 07:59:59.048043 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:59.047852 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:59.063508 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:59.063475 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 07:59:59.079920 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:59.079868 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" podStartSLOduration=9.661162373 podStartE2EDuration="28.079849307s" totalImagesPullingTime="18.418686934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 07:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 07:59:59.079401854 +0000 UTC m=+27.772766999" watchObservedRunningTime="2026-09-11 07:59:59.079849307 +0000 UTC m=+27.773214413" Sep 11 07:59:59.445510 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:59.445294 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bn9jv"] Sep 11 07:59:59.445662 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:59.445628 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 07:59:59.445763 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:59.445740 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn9jv" podUID="52fa5833-1275-4b8c-a8d7-74ad6fee8531" Sep 11 07:59:59.448373 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:59.448322 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t6dx2"] Sep 11 07:59:59.448530 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:59.448451 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 07:59:59.448591 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:59.448551 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6dx2" podUID="67dde785-fd0c-4213-81d9-bfb6374f6f13" Sep 11 07:59:59.448909 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:59.448877 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w4bks"] Sep 11 07:59:59.449166 ip-10-0-142-13 kubenswrapper[2566]: I0911 07:59:59.448985 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 07:59:59.449166 ip-10-0-142-13 kubenswrapper[2566]: E0911 07:59:59.449074 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4bks" podUID="be19ae80-8995-4581-a152-16243aba132d" Sep 11 08:00:00.052229 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:00.052200 2566 generic.go:356] "Generic (PLEG): container finished" podID="ce19aa94-ccc3-4aac-94b4-0c830c4d20c9" containerID="86c099cfb77e8006da54e8299db845d1a1430f4aa75c88a347904ae701c58900" exitCode=0 Sep 11 08:00:00.052647 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:00.052291 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpk9z" event={"ID":"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9","Type":"ContainerDied","Data":"86c099cfb77e8006da54e8299db845d1a1430f4aa75c88a347904ae701c58900"} Sep 11 08:00:00.781969 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:00.781927 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 08:00:00.782103 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:00.782044 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4bks" podUID="be19ae80-8995-4581-a152-16243aba132d" Sep 11 08:00:01.057514 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:01.057485 2566 generic.go:356] "Generic (PLEG): container finished" podID="ce19aa94-ccc3-4aac-94b4-0c830c4d20c9" containerID="49d9a5fc5e3be2f8302bbf8c5e6d81fb6cfc4dca9a7453408e924b3420de69d2" exitCode=0 Sep 11 08:00:01.057844 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:01.057567 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpk9z" event={"ID":"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9","Type":"ContainerDied","Data":"49d9a5fc5e3be2f8302bbf8c5e6d81fb6cfc4dca9a7453408e924b3420de69d2"} Sep 11 08:00:01.783134 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:01.783106 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 08:00:01.783268 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:01.783200 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6dx2" podUID="67dde785-fd0c-4213-81d9-bfb6374f6f13" Sep 11 08:00:01.783268 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:01.783250 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 08:00:01.783366 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:01.783347 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn9jv" podUID="52fa5833-1275-4b8c-a8d7-74ad6fee8531" Sep 11 08:00:02.782224 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:02.782148 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 08:00:02.782634 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:02.782260 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4bks" podUID="be19ae80-8995-4581-a152-16243aba132d" Sep 11 08:00:03.782153 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:03.782120 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 08:00:03.782339 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:03.782119 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 08:00:03.782339 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:03.782240 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn9jv" podUID="52fa5833-1275-4b8c-a8d7-74ad6fee8531" Sep 11 08:00:03.782722 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:03.782335 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t6dx2" podUID="67dde785-fd0c-4213-81d9-bfb6374f6f13" Sep 11 08:00:04.115364 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.115337 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-13.ec2.internal" event="NodeReady" Sep 11 08:00:04.115643 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.115487 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 11 08:00:04.178876 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.178845 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hcwhz"] Sep 11 08:00:04.224179 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.224142 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-996qn"] Sep 11 08:00:04.224326 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.224268 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:04.227373 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.227353 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 11 08:00:04.227373 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.227362 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 11 08:00:04.227507 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.227391 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g75rl\"" Sep 11 08:00:04.238151 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.238135 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hcwhz"] Sep 11 08:00:04.238243 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.238166 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-996qn"] Sep 11 08:00:04.238297 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.238281 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-996qn" Sep 11 08:00:04.241185 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.241163 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 11 08:00:04.241327 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.241313 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 11 08:00:04.241575 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.241557 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6jgk6\"" Sep 11 08:00:04.241656 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.241642 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 11 08:00:04.363317 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.363287 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:04.363456 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.363325 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f34985f-637a-4d5e-a0a9-67181090b361-tmp-dir\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:04.363456 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.363431 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1f34985f-637a-4d5e-a0a9-67181090b361-config-volume\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:04.363542 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.363478 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht75n\" (UniqueName: \"kubernetes.io/projected/1f34985f-637a-4d5e-a0a9-67181090b361-kube-api-access-ht75n\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:04.363542 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.363503 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w8h2\" (UniqueName: \"kubernetes.io/projected/829c494b-8597-4f21-b062-ddaf585c527c-kube-api-access-6w8h2\") pod \"ingress-canary-996qn\" (UID: \"829c494b-8597-4f21-b062-ddaf585c527c\") " pod="openshift-ingress-canary/ingress-canary-996qn" Sep 11 08:00:04.363644 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.363586 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/829c494b-8597-4f21-b062-ddaf585c527c-cert\") pod \"ingress-canary-996qn\" (UID: \"829c494b-8597-4f21-b062-ddaf585c527c\") " pod="openshift-ingress-canary/ingress-canary-996qn" Sep 11 08:00:04.464596 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.464558 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:04.464596 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.464600 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f34985f-637a-4d5e-a0a9-67181090b361-tmp-dir\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:04.464841 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.464643 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1f34985f-637a-4d5e-a0a9-67181090b361-config-volume\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:04.464841 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.464659 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht75n\" (UniqueName: \"kubernetes.io/projected/1f34985f-637a-4d5e-a0a9-67181090b361-kube-api-access-ht75n\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:04.464841 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.464676 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w8h2\" (UniqueName: \"kubernetes.io/projected/829c494b-8597-4f21-b062-ddaf585c527c-kube-api-access-6w8h2\") pod \"ingress-canary-996qn\" (UID: \"829c494b-8597-4f21-b062-ddaf585c527c\") " pod="openshift-ingress-canary/ingress-canary-996qn" Sep 11 08:00:04.464841 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.464704 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs\") pod \"network-metrics-daemon-t6dx2\" (UID: \"67dde785-fd0c-4213-81d9-bfb6374f6f13\") " pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 08:00:04.464841 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:04.464731 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 08:00:04.464841 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.464757 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/829c494b-8597-4f21-b062-ddaf585c527c-cert\") pod \"ingress-canary-996qn\" (UID: \"829c494b-8597-4f21-b062-ddaf585c527c\") " pod="openshift-ingress-canary/ingress-canary-996qn" Sep 11 08:00:04.464841 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:04.464812 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls podName:1f34985f-637a-4d5e-a0a9-67181090b361 nodeName:}" failed. No retries permitted until 2026-09-11 08:00:04.964793215 +0000 UTC m=+33.658158313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls") pod "dns-default-hcwhz" (UID: "1f34985f-637a-4d5e-a0a9-67181090b361") : secret "dns-default-metrics-tls" not found Sep 11 08:00:04.465204 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.465078 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f34985f-637a-4d5e-a0a9-67181090b361-tmp-dir\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:04.465204 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:04.465183 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 08:00:04.465299 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:04.465233 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs podName:67dde785-fd0c-4213-81d9-bfb6374f6f13 nodeName:}" failed. No retries permitted until 2026-09-11 08:00:36.465216515 +0000 UTC m=+65.158581628 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs") pod "network-metrics-daemon-t6dx2" (UID: "67dde785-fd0c-4213-81d9-bfb6374f6f13") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 08:00:04.465404 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.465359 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1f34985f-637a-4d5e-a0a9-67181090b361-config-volume\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:04.469406 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.469384 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/829c494b-8597-4f21-b062-ddaf585c527c-cert\") pod \"ingress-canary-996qn\" (UID: \"829c494b-8597-4f21-b062-ddaf585c527c\") " pod="openshift-ingress-canary/ingress-canary-996qn" Sep 11 08:00:04.477208 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.477182 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht75n\" (UniqueName: \"kubernetes.io/projected/1f34985f-637a-4d5e-a0a9-67181090b361-kube-api-access-ht75n\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:04.477426 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.477406 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w8h2\" (UniqueName: \"kubernetes.io/projected/829c494b-8597-4f21-b062-ddaf585c527c-kube-api-access-6w8h2\") pod \"ingress-canary-996qn\" (UID: \"829c494b-8597-4f21-b062-ddaf585c527c\") " pod="openshift-ingress-canary/ingress-canary-996qn" Sep 11 08:00:04.546672 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.546637 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-996qn" Sep 11 08:00:04.565971 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.565933 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret\") pod \"global-pull-secret-syncer-bn9jv\" (UID: \"52fa5833-1275-4b8c-a8d7-74ad6fee8531\") " pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 08:00:04.566146 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.565998 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2tsm\" (UniqueName: \"kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm\") pod \"network-check-target-w4bks\" (UID: \"be19ae80-8995-4581-a152-16243aba132d\") " pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 08:00:04.566146 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:04.566099 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 08:00:04.566146 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:04.566110 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 08:00:04.566146 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:04.566133 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 08:00:04.566146 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:04.566142 2566 projected.go:196] Error preparing data for projected volume kube-api-access-w2tsm for pod openshift-network-diagnostics/network-check-target-w4bks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 08:00:04.566306 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:04.566188 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret podName:52fa5833-1275-4b8c-a8d7-74ad6fee8531 nodeName:}" failed. No retries permitted until 2026-09-11 08:00:36.566166603 +0000 UTC m=+65.259531702 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret") pod "global-pull-secret-syncer-bn9jv" (UID: "52fa5833-1275-4b8c-a8d7-74ad6fee8531") : object "kube-system"/"original-pull-secret" not registered Sep 11 08:00:04.566306 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:04.566207 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm podName:be19ae80-8995-4581-a152-16243aba132d nodeName:}" failed. No retries permitted until 2026-09-11 08:00:36.566197071 +0000 UTC m=+65.259562162 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2tsm" (UniqueName: "kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm") pod "network-check-target-w4bks" (UID: "be19ae80-8995-4581-a152-16243aba132d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 08:00:04.782780 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.782691 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 08:00:04.785178 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.785151 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 08:00:04.785318 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.785222 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 08:00:04.785318 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.785296 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s4cpg\"" Sep 11 08:00:04.969562 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:04.969523 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:04.969746 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:04.969667 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 08:00:04.969746 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:04.969719 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls podName:1f34985f-637a-4d5e-a0a9-67181090b361 nodeName:}" failed. No retries permitted until 2026-09-11 08:00:05.969707839 +0000 UTC m=+34.663072923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls") pod "dns-default-hcwhz" (UID: "1f34985f-637a-4d5e-a0a9-67181090b361") : secret "dns-default-metrics-tls" not found Sep 11 08:00:05.782812 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:05.782640 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 08:00:05.783228 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:05.782730 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 08:00:05.785764 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:05.785546 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 08:00:05.785764 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:05.785606 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mdzhs\"" Sep 11 08:00:05.785764 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:05.785656 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 08:00:05.977601 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:05.977564 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:05.977780 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:05.977708 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 08:00:05.977780 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:05.977767 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls podName:1f34985f-637a-4d5e-a0a9-67181090b361 nodeName:}" failed. No retries permitted until 2026-09-11 08:00:07.977751138 +0000 UTC m=+36.671116222 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls") pod "dns-default-hcwhz" (UID: "1f34985f-637a-4d5e-a0a9-67181090b361") : secret "dns-default-metrics-tls" not found Sep 11 08:00:06.080278 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:06.079769 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-996qn"] Sep 11 08:00:06.084139 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:00:06.084117 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod829c494b_8597_4f21_b062_ddaf585c527c.slice/crio-bd5a6eea8031b8191d2927d0476ba60558f9523db55975802e327e16733c037b WatchSource:0}: Error finding container bd5a6eea8031b8191d2927d0476ba60558f9523db55975802e327e16733c037b: Status 404 returned error can't find the container with id bd5a6eea8031b8191d2927d0476ba60558f9523db55975802e327e16733c037b Sep 11 08:00:07.074886 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:07.074834 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-996qn" event={"ID":"829c494b-8597-4f21-b062-ddaf585c527c","Type":"ContainerStarted","Data":"bd5a6eea8031b8191d2927d0476ba60558f9523db55975802e327e16733c037b"} Sep 11 08:00:07.080550 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:07.080501 2566 generic.go:356] "Generic (PLEG): container finished" podID="ce19aa94-ccc3-4aac-94b4-0c830c4d20c9" containerID="1c530a0b63ec19012934ac194f8f6b7eb9547415697b84dd0c18914b2172d247" exitCode=0 Sep 11 08:00:07.080686 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:07.080556 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpk9z" event={"ID":"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9","Type":"ContainerDied","Data":"1c530a0b63ec19012934ac194f8f6b7eb9547415697b84dd0c18914b2172d247"} Sep 11 08:00:07.995297 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:07.995265 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:07.995473 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:07.995427 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 08:00:07.995515 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:07.995492 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls podName:1f34985f-637a-4d5e-a0a9-67181090b361 nodeName:}" failed. No retries permitted until 2026-09-11 08:00:11.995475542 +0000 UTC m=+40.688840629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls") pod "dns-default-hcwhz" (UID: "1f34985f-637a-4d5e-a0a9-67181090b361") : secret "dns-default-metrics-tls" not found Sep 11 08:00:08.086068 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:08.086037 2566 generic.go:356] "Generic (PLEG): container finished" podID="ce19aa94-ccc3-4aac-94b4-0c830c4d20c9" containerID="6d9a63a50bd3aaa27732ef1ecbfdc16f61c25f304d5824f1ce4eae817c38b02b" exitCode=0 Sep 11 08:00:08.086520 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:08.086099 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpk9z" event={"ID":"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9","Type":"ContainerDied","Data":"6d9a63a50bd3aaa27732ef1ecbfdc16f61c25f304d5824f1ce4eae817c38b02b"} Sep 11 08:00:09.092057 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:09.091797 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpk9z" event={"ID":"ce19aa94-ccc3-4aac-94b4-0c830c4d20c9","Type":"ContainerStarted","Data":"79d3ab48fce2ad5732c843b49a629846beb6caba501f4e862acd1367265a235a"} Sep 11 08:00:10.095763 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:10.095720 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-996qn" event={"ID":"829c494b-8597-4f21-b062-ddaf585c527c","Type":"ContainerStarted","Data":"b38622fe62ff14179fe8fb2df077854cdd14b1e6aa231a75019bce3819cb86a2"} Sep 11 08:00:10.113529 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:10.113458 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kpk9z" podStartSLOduration=10.064823146 podStartE2EDuration="39.113439033s" totalImagesPullingTime="29.048615887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 07:59:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:00:09.122252987 +0000 UTC m=+37.815618093" watchObservedRunningTime="2026-09-11 08:00:10.113439033 +0000 UTC m=+38.806804137" Sep 11 08:00:12.024342 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:12.024295 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:12.024722 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:12.024454 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 08:00:12.024722 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:12.024514 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls podName:1f34985f-637a-4d5e-a0a9-67181090b361 nodeName:}" failed. No retries permitted until 2026-09-11 08:00:20.024497134 +0000 UTC m=+48.717862242 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls") pod "dns-default-hcwhz" (UID: "1f34985f-637a-4d5e-a0a9-67181090b361") : secret "dns-default-metrics-tls" not found Sep 11 08:00:20.079304 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:20.079262 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:20.079680 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:20.079374 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 08:00:20.079680 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:20.079428 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls podName:1f34985f-637a-4d5e-a0a9-67181090b361 nodeName:}" failed. No retries permitted until 2026-09-11 08:00:36.079413161 +0000 UTC m=+64.772778245 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls") pod "dns-default-hcwhz" (UID: "1f34985f-637a-4d5e-a0a9-67181090b361") : secret "dns-default-metrics-tls" not found Sep 11 08:00:31.067988 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:31.067960 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9ljvr" Sep 11 08:00:31.097070 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:31.097013 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-996qn" podStartSLOduration=24.032716576 podStartE2EDuration="27.096992683s" totalImagesPullingTime="3.064276107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:00:10.113215391 +0000 UTC m=+38.806580496" watchObservedRunningTime="2026-09-11 08:00:31.096992683 +0000 UTC m=+59.790357786" Sep 11 08:00:35.235172 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.235139 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j"] Sep 11 08:00:35.239207 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.239191 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j" Sep 11 08:00:35.241810 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.241786 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 11 08:00:35.241810 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.241796 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 11 08:00:35.242010 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.241835 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 11 08:00:35.242254 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.242237 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 11 08:00:35.249147 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.249126 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-j5zzq\"" Sep 11 08:00:35.250067 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.250046 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd"] Sep 11 08:00:35.253151 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.253124 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-zhgrq"] Sep 11 08:00:35.253271 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.253253 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd" Sep 11 08:00:35.255541 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.255523 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 11 08:00:35.255913 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.255890 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j"] Sep 11 08:00:35.256027 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.255990 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-zhgrq" Sep 11 08:00:35.256364 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.256346 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 11 08:00:35.258349 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.258316 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 11 08:00:35.258451 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.258439 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 11 08:00:35.261130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.261091 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2hlnr\"" Sep 11 08:00:35.261269 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.261251 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rlg4c\"" Sep 11 08:00:35.261416 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.261368 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 11 08:00:35.261611 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.261589 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-zhgrq"] Sep 11 08:00:35.264652 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.264628 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd"] Sep 11 08:00:35.346924 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.346892 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9"] Sep 11 08:00:35.349646 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.349631 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9" Sep 11 08:00:35.353364 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.353340 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 11 08:00:35.353610 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.353595 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 11 08:00:35.353759 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.353737 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-dfbs4"] Sep 11 08:00:35.353759 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.353750 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 11 08:00:35.353873 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.353779 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 11 08:00:35.353873 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.353804 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zn8vk\"" Sep 11 08:00:35.356612 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.356594 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.358860 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.358838 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 11 08:00:35.359316 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.359299 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 11 08:00:35.359316 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.359307 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 11 08:00:35.359419 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.359307 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4b6s7\"" Sep 11 08:00:35.359567 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.359555 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 11 08:00:35.364486 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.364463 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 11 08:00:35.372779 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.372508 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9"] Sep 11 08:00:35.373225 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.373209 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-dfbs4"] Sep 11 08:00:35.382998 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.382973 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e443d50-9cf7-49d1-86ef-1263699df771-serving-cert\") pod \"service-ca-operator-cf7c776b7-bmc8j\" (UID: \"7e443d50-9cf7-49d1-86ef-1263699df771\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j" Sep 11 08:00:35.383110 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.383009 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e443d50-9cf7-49d1-86ef-1263699df771-config\") pod \"service-ca-operator-cf7c776b7-bmc8j\" (UID: \"7e443d50-9cf7-49d1-86ef-1263699df771\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j" Sep 11 08:00:35.383110 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.383026 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-5wpqd\" (UID: \"f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd" Sep 11 08:00:35.383195 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.383121 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtr4l\" (UniqueName: \"kubernetes.io/projected/61532458-6095-4fb3-bc2f-5a0a16902be6-kube-api-access-wtr4l\") pod \"volume-data-source-validator-86695b7cc7-zhgrq\" (UID: \"61532458-6095-4fb3-bc2f-5a0a16902be6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-zhgrq" Sep 11 08:00:35.383195 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.383159 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k4ht\" (UniqueName: \"kubernetes.io/projected/7e443d50-9cf7-49d1-86ef-1263699df771-kube-api-access-7k4ht\") pod \"service-ca-operator-cf7c776b7-bmc8j\" (UID: \"7e443d50-9cf7-49d1-86ef-1263699df771\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j" Sep 11 08:00:35.383292 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.383238 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxvph\" (UniqueName: \"kubernetes.io/projected/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-kube-api-access-fxvph\") pod \"cluster-samples-operator-86499c89c4-5wpqd\" (UID: \"f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd" Sep 11 08:00:35.484520 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.484477 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb46297f-c9c2-4169-8d9f-128b7af240b3-tmp\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.484520 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.484514 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb46297f-c9c2-4169-8d9f-128b7af240b3-serving-cert\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.484746 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.484536 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtr4l\" (UniqueName: \"kubernetes.io/projected/61532458-6095-4fb3-bc2f-5a0a16902be6-kube-api-access-wtr4l\") pod \"volume-data-source-validator-86695b7cc7-zhgrq\" (UID: \"61532458-6095-4fb3-bc2f-5a0a16902be6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-zhgrq" Sep 11 08:00:35.484746 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.484581 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k4ht\" (UniqueName: \"kubernetes.io/projected/7e443d50-9cf7-49d1-86ef-1263699df771-kube-api-access-7k4ht\") pod \"service-ca-operator-cf7c776b7-bmc8j\" (UID: \"7e443d50-9cf7-49d1-86ef-1263699df771\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j" Sep 11 08:00:35.484746 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.484608 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb46297f-c9c2-4169-8d9f-128b7af240b3-trusted-ca-bundle\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.484746 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.484641 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxvph\" (UniqueName: \"kubernetes.io/projected/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-kube-api-access-fxvph\") pod \"cluster-samples-operator-86499c89c4-5wpqd\" (UID: \"f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd" Sep 11 08:00:35.484746 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.484678 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fb46297f-c9c2-4169-8d9f-128b7af240b3-snapshots\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.484746 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.484706 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gbps\" (UniqueName: \"kubernetes.io/projected/fb46297f-c9c2-4169-8d9f-128b7af240b3-kube-api-access-9gbps\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.484746 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.484733 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb46297f-c9c2-4169-8d9f-128b7af240b3-service-ca-bundle\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.485008 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.484762 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qvfh\" (UniqueName: \"kubernetes.io/projected/355f2490-ff55-4f47-a7fc-c51d26eed56f-kube-api-access-6qvfh\") pod \"kube-storage-version-migrator-operator-6c8f84f897-l42k9\" (UID: \"355f2490-ff55-4f47-a7fc-c51d26eed56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9" Sep 11 08:00:35.485008 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.484789 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e443d50-9cf7-49d1-86ef-1263699df771-serving-cert\") pod \"service-ca-operator-cf7c776b7-bmc8j\" (UID: \"7e443d50-9cf7-49d1-86ef-1263699df771\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j" Sep 11 08:00:35.485008 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.484814 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/355f2490-ff55-4f47-a7fc-c51d26eed56f-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-l42k9\" (UID: \"355f2490-ff55-4f47-a7fc-c51d26eed56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9" Sep 11 08:00:35.485008 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.484847 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e443d50-9cf7-49d1-86ef-1263699df771-config\") pod \"service-ca-operator-cf7c776b7-bmc8j\" (UID: \"7e443d50-9cf7-49d1-86ef-1263699df771\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j" Sep 11 08:00:35.485008 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.484871 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-5wpqd\" (UID: \"f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd" Sep 11 08:00:35.485008 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.484891 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/355f2490-ff55-4f47-a7fc-c51d26eed56f-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-l42k9\" (UID: \"355f2490-ff55-4f47-a7fc-c51d26eed56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9" Sep 11 08:00:35.485008 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:35.484981 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 11 08:00:35.485262 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:35.485043 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls podName:f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca nodeName:}" failed. No retries permitted until 2026-09-11 08:00:35.985027726 +0000 UTC m=+64.678392811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-5wpqd" (UID: "f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca") : secret "samples-operator-tls" not found Sep 11 08:00:35.485392 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.485376 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e443d50-9cf7-49d1-86ef-1263699df771-config\") pod \"service-ca-operator-cf7c776b7-bmc8j\" (UID: \"7e443d50-9cf7-49d1-86ef-1263699df771\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j" Sep 11 08:00:35.488159 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.488143 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e443d50-9cf7-49d1-86ef-1263699df771-serving-cert\") pod \"service-ca-operator-cf7c776b7-bmc8j\" (UID: \"7e443d50-9cf7-49d1-86ef-1263699df771\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j" Sep 11 08:00:35.496049 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.496025 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtr4l\" (UniqueName: \"kubernetes.io/projected/61532458-6095-4fb3-bc2f-5a0a16902be6-kube-api-access-wtr4l\") pod \"volume-data-source-validator-86695b7cc7-zhgrq\" (UID: \"61532458-6095-4fb3-bc2f-5a0a16902be6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-zhgrq" Sep 11 08:00:35.496357 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.496336 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k4ht\" (UniqueName: \"kubernetes.io/projected/7e443d50-9cf7-49d1-86ef-1263699df771-kube-api-access-7k4ht\") pod \"service-ca-operator-cf7c776b7-bmc8j\" (UID: \"7e443d50-9cf7-49d1-86ef-1263699df771\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j" Sep 11 08:00:35.496421 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.496405 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxvph\" (UniqueName: \"kubernetes.io/projected/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-kube-api-access-fxvph\") pod \"cluster-samples-operator-86499c89c4-5wpqd\" (UID: \"f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd" Sep 11 08:00:35.547540 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.547507 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j" Sep 11 08:00:35.569557 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.569528 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-zhgrq" Sep 11 08:00:35.586378 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.586304 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb46297f-c9c2-4169-8d9f-128b7af240b3-tmp\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.586378 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.586353 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb46297f-c9c2-4169-8d9f-128b7af240b3-serving-cert\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.586644 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.586385 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb46297f-c9c2-4169-8d9f-128b7af240b3-trusted-ca-bundle\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.586929 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.586905 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fb46297f-c9c2-4169-8d9f-128b7af240b3-snapshots\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.587051 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.586963 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gbps\" (UniqueName: \"kubernetes.io/projected/fb46297f-c9c2-4169-8d9f-128b7af240b3-kube-api-access-9gbps\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.587051 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.586985 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb46297f-c9c2-4169-8d9f-128b7af240b3-tmp\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.587051 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.586997 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb46297f-c9c2-4169-8d9f-128b7af240b3-service-ca-bundle\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.587207 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.587052 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qvfh\" (UniqueName: \"kubernetes.io/projected/355f2490-ff55-4f47-a7fc-c51d26eed56f-kube-api-access-6qvfh\") pod \"kube-storage-version-migrator-operator-6c8f84f897-l42k9\" (UID: \"355f2490-ff55-4f47-a7fc-c51d26eed56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9" Sep 11 08:00:35.587207 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.587102 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/355f2490-ff55-4f47-a7fc-c51d26eed56f-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-l42k9\" (UID: \"355f2490-ff55-4f47-a7fc-c51d26eed56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9" Sep 11 08:00:35.587207 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.587157 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/355f2490-ff55-4f47-a7fc-c51d26eed56f-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-l42k9\" (UID: \"355f2490-ff55-4f47-a7fc-c51d26eed56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9" Sep 11 08:00:35.587606 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.587584 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb46297f-c9c2-4169-8d9f-128b7af240b3-service-ca-bundle\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.587747 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.587721 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/355f2490-ff55-4f47-a7fc-c51d26eed56f-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-l42k9\" (UID: \"355f2490-ff55-4f47-a7fc-c51d26eed56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9" Sep 11 08:00:35.587853 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.587768 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb46297f-c9c2-4169-8d9f-128b7af240b3-trusted-ca-bundle\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.587853 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.587832 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fb46297f-c9c2-4169-8d9f-128b7af240b3-snapshots\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.589381 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.589360 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb46297f-c9c2-4169-8d9f-128b7af240b3-serving-cert\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.589651 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.589631 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/355f2490-ff55-4f47-a7fc-c51d26eed56f-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-l42k9\" (UID: \"355f2490-ff55-4f47-a7fc-c51d26eed56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9" Sep 11 08:00:35.604533 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.604504 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qvfh\" (UniqueName: \"kubernetes.io/projected/355f2490-ff55-4f47-a7fc-c51d26eed56f-kube-api-access-6qvfh\") pod \"kube-storage-version-migrator-operator-6c8f84f897-l42k9\" (UID: \"355f2490-ff55-4f47-a7fc-c51d26eed56f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9" Sep 11 08:00:35.604665 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.604554 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gbps\" (UniqueName: \"kubernetes.io/projected/fb46297f-c9c2-4169-8d9f-128b7af240b3-kube-api-access-9gbps\") pod \"insights-operator-5844b856db-dfbs4\" (UID: \"fb46297f-c9c2-4169-8d9f-128b7af240b3\") " pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.658332 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.658308 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9" Sep 11 08:00:35.666389 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.666353 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-dfbs4" Sep 11 08:00:35.821985 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.821884 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j"] Sep 11 08:00:35.824546 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:00:35.824509 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e443d50_9cf7_49d1_86ef_1263699df771.slice/crio-b12303570bb0b7fe394f6f2c1e2723714f27d4c7a96b602d07a5c4b7321dea06 WatchSource:0}: Error finding container b12303570bb0b7fe394f6f2c1e2723714f27d4c7a96b602d07a5c4b7321dea06: Status 404 returned error can't find the container with id b12303570bb0b7fe394f6f2c1e2723714f27d4c7a96b602d07a5c4b7321dea06 Sep 11 08:00:35.856964 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.856927 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-zhgrq"] Sep 11 08:00:35.859196 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:00:35.859167 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61532458_6095_4fb3_bc2f_5a0a16902be6.slice/crio-a682012d5e0a01c4f9558d78bfcb8aa5367a6a8153b93effddebdba7194bcae8 WatchSource:0}: Error finding container a682012d5e0a01c4f9558d78bfcb8aa5367a6a8153b93effddebdba7194bcae8: Status 404 returned error can't find the container with id a682012d5e0a01c4f9558d78bfcb8aa5367a6a8153b93effddebdba7194bcae8 Sep 11 08:00:35.931949 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.931912 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9"] Sep 11 08:00:35.934207 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:00:35.934179 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod355f2490_ff55_4f47_a7fc_c51d26eed56f.slice/crio-846e3874f1d6fbe30ba81a8c91373321b1af979750949095e11e772d67eb6ad6 WatchSource:0}: Error finding container 846e3874f1d6fbe30ba81a8c91373321b1af979750949095e11e772d67eb6ad6: Status 404 returned error can't find the container with id 846e3874f1d6fbe30ba81a8c91373321b1af979750949095e11e772d67eb6ad6 Sep 11 08:00:35.951892 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.951799 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-dfbs4"] Sep 11 08:00:35.954073 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:00:35.954050 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb46297f_c9c2_4169_8d9f_128b7af240b3.slice/crio-b52888f5164ee8621f8876038d44bd5172760c9456eba39a8e058786dd40958e WatchSource:0}: Error finding container b52888f5164ee8621f8876038d44bd5172760c9456eba39a8e058786dd40958e: Status 404 returned error can't find the container with id b52888f5164ee8621f8876038d44bd5172760c9456eba39a8e058786dd40958e Sep 11 08:00:35.990508 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:35.990473 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-5wpqd\" (UID: \"f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd" Sep 11 08:00:35.990634 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:35.990610 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 11 08:00:35.990680 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:35.990670 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls podName:f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca nodeName:}" failed. No retries permitted until 2026-09-11 08:00:36.990655047 +0000 UTC m=+65.684020135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-5wpqd" (UID: "f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca") : secret "samples-operator-tls" not found Sep 11 08:00:36.091170 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.091082 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:00:36.091303 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:36.091201 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 08:00:36.091303 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:36.091252 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls podName:1f34985f-637a-4d5e-a0a9-67181090b361 nodeName:}" failed. No retries permitted until 2026-09-11 08:01:08.091237857 +0000 UTC m=+96.784602941 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls") pod "dns-default-hcwhz" (UID: "1f34985f-637a-4d5e-a0a9-67181090b361") : secret "dns-default-metrics-tls" not found Sep 11 08:00:36.160103 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.160071 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9" event={"ID":"355f2490-ff55-4f47-a7fc-c51d26eed56f","Type":"ContainerStarted","Data":"846e3874f1d6fbe30ba81a8c91373321b1af979750949095e11e772d67eb6ad6"} Sep 11 08:00:36.161265 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.161240 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j" event={"ID":"7e443d50-9cf7-49d1-86ef-1263699df771","Type":"ContainerStarted","Data":"b12303570bb0b7fe394f6f2c1e2723714f27d4c7a96b602d07a5c4b7321dea06"} Sep 11 08:00:36.162307 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.162283 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-dfbs4" event={"ID":"fb46297f-c9c2-4169-8d9f-128b7af240b3","Type":"ContainerStarted","Data":"b52888f5164ee8621f8876038d44bd5172760c9456eba39a8e058786dd40958e"} Sep 11 08:00:36.163249 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.163230 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-zhgrq" event={"ID":"61532458-6095-4fb3-bc2f-5a0a16902be6","Type":"ContainerStarted","Data":"a682012d5e0a01c4f9558d78bfcb8aa5367a6a8153b93effddebdba7194bcae8"} Sep 11 08:00:36.495401 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.495254 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs\") pod \"network-metrics-daemon-t6dx2\" (UID: \"67dde785-fd0c-4213-81d9-bfb6374f6f13\") " pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 08:00:36.497426 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.497397 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 08:00:36.506034 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:36.506010 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 11 08:00:36.506169 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:36.506089 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs podName:67dde785-fd0c-4213-81d9-bfb6374f6f13 nodeName:}" failed. No retries permitted until 2026-09-11 08:01:40.50606747 +0000 UTC m=+129.199432558 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs") pod "network-metrics-daemon-t6dx2" (UID: "67dde785-fd0c-4213-81d9-bfb6374f6f13") : secret "metrics-daemon-secret" not found Sep 11 08:00:36.596648 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.596608 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret\") pod \"global-pull-secret-syncer-bn9jv\" (UID: \"52fa5833-1275-4b8c-a8d7-74ad6fee8531\") " pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 08:00:36.596820 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.596699 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2tsm\" (UniqueName: \"kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm\") pod \"network-check-target-w4bks\" (UID: \"be19ae80-8995-4581-a152-16243aba132d\") " pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 08:00:36.599122 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.599090 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 08:00:36.606167 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.606136 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 08:00:36.611065 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.611040 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 08:00:36.611594 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.611573 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52fa5833-1275-4b8c-a8d7-74ad6fee8531-original-pull-secret\") pod \"global-pull-secret-syncer-bn9jv\" (UID: \"52fa5833-1275-4b8c-a8d7-74ad6fee8531\") " pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 08:00:36.626402 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.626339 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2tsm\" (UniqueName: \"kubernetes.io/projected/be19ae80-8995-4581-a152-16243aba132d-kube-api-access-w2tsm\") pod \"network-check-target-w4bks\" (UID: \"be19ae80-8995-4581-a152-16243aba132d\") " pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 08:00:36.700609 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.700574 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn9jv" Sep 11 08:00:36.895981 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.895931 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s4cpg\"" Sep 11 08:00:36.904215 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.904013 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 08:00:36.988486 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.988370 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bn9jv"] Sep 11 08:00:36.999920 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:36.999882 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-5wpqd\" (UID: \"f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd" Sep 11 08:00:37.000086 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:37.000067 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 11 08:00:37.000158 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:37.000139 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls podName:f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca nodeName:}" failed. No retries permitted until 2026-09-11 08:00:39.000119272 +0000 UTC m=+67.693484380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-5wpqd" (UID: "f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca") : secret "samples-operator-tls" not found Sep 11 08:00:37.229824 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:00:37.229788 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52fa5833_1275_4b8c_a8d7_74ad6fee8531.slice/crio-6929be910f96c82ebb93e9f5e0474fe949b1b6ce1531e8fa86d6301cfa5ded62 WatchSource:0}: Error finding container 6929be910f96c82ebb93e9f5e0474fe949b1b6ce1531e8fa86d6301cfa5ded62: Status 404 returned error can't find the container with id 6929be910f96c82ebb93e9f5e0474fe949b1b6ce1531e8fa86d6301cfa5ded62 Sep 11 08:00:37.520911 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:37.520828 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w4bks"] Sep 11 08:00:37.927499 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:00:37.927464 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe19ae80_8995_4581_a152_16243aba132d.slice/crio-5940423c01f9841c333be3fdf333fae45daa40f45c7e937fea629977648b33ed WatchSource:0}: Error finding container 5940423c01f9841c333be3fdf333fae45daa40f45c7e937fea629977648b33ed: Status 404 returned error can't find the container with id 5940423c01f9841c333be3fdf333fae45daa40f45c7e937fea629977648b33ed Sep 11 08:00:38.173077 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:38.173035 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w4bks" event={"ID":"be19ae80-8995-4581-a152-16243aba132d","Type":"ContainerStarted","Data":"5940423c01f9841c333be3fdf333fae45daa40f45c7e937fea629977648b33ed"} Sep 11 08:00:38.174567 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:38.174534 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bn9jv" event={"ID":"52fa5833-1275-4b8c-a8d7-74ad6fee8531","Type":"ContainerStarted","Data":"6929be910f96c82ebb93e9f5e0474fe949b1b6ce1531e8fa86d6301cfa5ded62"} Sep 11 08:00:38.176396 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:38.176347 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-zhgrq" event={"ID":"61532458-6095-4fb3-bc2f-5a0a16902be6","Type":"ContainerStarted","Data":"94f38e56a11014fb9690bcac2965d3653f2132768490981fdb06e03d1aa38df8"} Sep 11 08:00:39.018409 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:39.018326 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-5wpqd\" (UID: \"f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd" Sep 11 08:00:39.018886 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:39.018515 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 11 08:00:39.018886 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:39.018566 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls podName:f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca nodeName:}" failed. No retries permitted until 2026-09-11 08:00:43.018552119 +0000 UTC m=+71.711917205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-5wpqd" (UID: "f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca") : secret "samples-operator-tls" not found Sep 11 08:00:40.187286 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:40.186553 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9" event={"ID":"355f2490-ff55-4f47-a7fc-c51d26eed56f","Type":"ContainerStarted","Data":"65a16c8d7ec0a12ffe04d61723da2dccec8e83c5acabad8a52d9e5333468936d"} Sep 11 08:00:40.193216 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:40.193180 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j" event={"ID":"7e443d50-9cf7-49d1-86ef-1263699df771","Type":"ContainerStarted","Data":"af563a1c49c37a5955d2f5d766e05b492f5386d64eb370e98a3c0b6933aa5ab6"} Sep 11 08:00:40.200969 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:40.199193 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-dfbs4" event={"ID":"fb46297f-c9c2-4169-8d9f-128b7af240b3","Type":"ContainerStarted","Data":"855f9ae38ca54e47bf89f049e33c7c964e91590cb6a9f9f2a1b981e8407b1f94"} Sep 11 08:00:40.210325 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:40.210268 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-zhgrq" podStartSLOduration=3.787184987 podStartE2EDuration="5.210240463s" totalImagesPullingTime="1.423055476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:00:38.194377472 +0000 UTC m=+66.887742578" watchObservedRunningTime="2026-09-11 08:00:40.210240463 +0000 UTC m=+68.903605566" Sep 11 08:00:40.210875 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:40.210830 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9" podStartSLOduration=1.9115453869999999 podStartE2EDuration="5.210815271s" totalImagesPullingTime="3.299269884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:00:40.209240251 +0000 UTC m=+68.902605358" watchObservedRunningTime="2026-09-11 08:00:40.210815271 +0000 UTC m=+68.904180378" Sep 11 08:00:40.236509 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:40.236209 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j" podStartSLOduration=1.8235756589999998 podStartE2EDuration="5.236183987s" totalImagesPullingTime="3.412608328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:00:40.235659665 +0000 UTC m=+68.929024772" watchObservedRunningTime="2026-09-11 08:00:40.236183987 +0000 UTC m=+68.929549094" Sep 11 08:00:40.259344 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:40.258755 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-dfbs4" podStartSLOduration=1.972364442 podStartE2EDuration="5.258734409s" totalImagesPullingTime="3.286369967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:00:40.257716319 +0000 UTC m=+68.951081425" watchObservedRunningTime="2026-09-11 08:00:40.258734409 +0000 UTC m=+68.952099515" Sep 11 08:00:41.033795 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.033535 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ckf7k"] Sep 11 08:00:41.057569 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.057536 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ckf7k"] Sep 11 08:00:41.057749 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.057672 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:41.066674 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.066252 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4cbcr\"" Sep 11 08:00:41.066927 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.066861 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 11 08:00:41.067510 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.067475 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 11 08:00:41.244971 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.244925 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:41.245433 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.244978 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmgqz\" (UniqueName: \"kubernetes.io/projected/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-api-access-vmgqz\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:41.245433 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.245024 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7507a76c-ad19-44ab-a11d-2a026642a18f-crio-socket\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:41.245433 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.245052 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:41.245433 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.245119 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7507a76c-ad19-44ab-a11d-2a026642a18f-data-volume\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:41.346522 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.346422 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7507a76c-ad19-44ab-a11d-2a026642a18f-data-volume\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:41.346695 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.346584 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:41.346695 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.346612 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmgqz\" (UniqueName: \"kubernetes.io/projected/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-api-access-vmgqz\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:41.346826 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.346788 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7507a76c-ad19-44ab-a11d-2a026642a18f-crio-socket\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:41.346962 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.346842 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:41.347309 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.347224 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7507a76c-ad19-44ab-a11d-2a026642a18f-data-volume\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:41.347402 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:41.347326 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 08:00:41.347467 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:41.347413 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm podName:7507a76c-ad19-44ab-a11d-2a026642a18f nodeName:}" failed. No retries permitted until 2026-09-11 08:00:41.847391063 +0000 UTC m=+70.540756150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ckf7k" (UID: "7507a76c-ad19-44ab-a11d-2a026642a18f") : configmap "kube-rbac-proxy" not found Sep 11 08:00:41.347534 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.347464 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7507a76c-ad19-44ab-a11d-2a026642a18f-crio-socket\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:41.347645 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:41.347625 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 08:00:41.347742 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:41.347697 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls podName:7507a76c-ad19-44ab-a11d-2a026642a18f nodeName:}" failed. No retries permitted until 2026-09-11 08:00:41.847681265 +0000 UTC m=+70.541046355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ckf7k" (UID: "7507a76c-ad19-44ab-a11d-2a026642a18f") : secret "insights-runtime-extractor-tls" not found Sep 11 08:00:41.359303 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.359254 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmgqz\" (UniqueName: \"kubernetes.io/projected/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-api-access-vmgqz\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:41.851032 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.850997 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:41.851225 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:41.851079 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:41.851225 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:41.851125 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 08:00:41.851225 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:41.851206 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm podName:7507a76c-ad19-44ab-a11d-2a026642a18f nodeName:}" failed. No retries permitted until 2026-09-11 08:00:42.851187465 +0000 UTC m=+71.544552572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ckf7k" (UID: "7507a76c-ad19-44ab-a11d-2a026642a18f") : configmap "kube-rbac-proxy" not found Sep 11 08:00:41.851366 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:41.851250 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 08:00:41.851366 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:41.851340 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls podName:7507a76c-ad19-44ab-a11d-2a026642a18f nodeName:}" failed. No retries permitted until 2026-09-11 08:00:42.851321981 +0000 UTC m=+71.544687081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ckf7k" (UID: "7507a76c-ad19-44ab-a11d-2a026642a18f") : secret "insights-runtime-extractor-tls" not found Sep 11 08:00:42.859132 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:42.859085 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:42.859569 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:42.859168 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:42.859569 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:42.859238 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 08:00:42.859569 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:42.859291 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 08:00:42.859569 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:42.859313 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm podName:7507a76c-ad19-44ab-a11d-2a026642a18f nodeName:}" failed. No retries permitted until 2026-09-11 08:00:44.859292664 +0000 UTC m=+73.552657749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ckf7k" (UID: "7507a76c-ad19-44ab-a11d-2a026642a18f") : configmap "kube-rbac-proxy" not found Sep 11 08:00:42.859569 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:42.859330 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls podName:7507a76c-ad19-44ab-a11d-2a026642a18f nodeName:}" failed. No retries permitted until 2026-09-11 08:00:44.85932025 +0000 UTC m=+73.552685357 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ckf7k" (UID: "7507a76c-ad19-44ab-a11d-2a026642a18f") : secret "insights-runtime-extractor-tls" not found Sep 11 08:00:42.974991 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:42.974960 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kxv89_ab5b4e73-cc00-407a-a103-9bdb0721cd6e/dns-node-resolver/0.log" Sep 11 08:00:43.060777 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:43.060746 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-5wpqd\" (UID: \"f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd" Sep 11 08:00:43.060916 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:43.060889 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 11 08:00:43.060985 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:43.060970 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls podName:f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca nodeName:}" failed. No retries permitted until 2026-09-11 08:00:51.060951468 +0000 UTC m=+79.754316568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-5wpqd" (UID: "f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca") : secret "samples-operator-tls" not found Sep 11 08:00:43.215371 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:43.215328 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w4bks" event={"ID":"be19ae80-8995-4581-a152-16243aba132d","Type":"ContainerStarted","Data":"d95d1a19f0d6e6629a7417f1340a1bae965c8f4e6fc6de6f9bd08afa99ff1bed"} Sep 11 08:00:43.215564 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:43.215433 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 08:00:43.216933 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:43.216906 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bn9jv" event={"ID":"52fa5833-1275-4b8c-a8d7-74ad6fee8531","Type":"ContainerStarted","Data":"b39f1ba1cc3e93267c43b66c925e0af7d0ecfca3e7dc4be443dfe71f06f222c2"} Sep 11 08:00:43.252324 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:43.252266 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w4bks" podStartSLOduration=67.107296907 podStartE2EDuration="1m12.252250978s" totalImagesPullingTime="5.144954071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 07:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:00:43.234918391 +0000 UTC m=+71.928283498" watchObservedRunningTime="2026-09-11 08:00:43.252250978 +0000 UTC m=+71.945616078" Sep 11 08:00:43.573911 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:43.573884 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5jmtt_3027cbb6-dcdd-4888-ad76-6f7304468c90/node-ca/0.log" Sep 11 08:00:44.077810 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.077754 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bn9jv" podStartSLOduration=66.231583671 podStartE2EDuration="1m12.077727805s" totalImagesPullingTime="5.846144134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 07:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:00:43.251486576 +0000 UTC m=+71.944851684" watchObservedRunningTime="2026-09-11 08:00:44.077727805 +0000 UTC m=+72.771092910" Sep 11 08:00:44.078355 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.078339 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cf8c56449-95qgx"] Sep 11 08:00:44.080196 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.080180 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.082543 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.082511 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 11 08:00:44.082682 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.082573 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 11 08:00:44.082682 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.082641 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-47pmh\"" Sep 11 08:00:44.083004 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.082750 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 11 08:00:44.088426 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.088391 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 11 08:00:44.094866 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.094844 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cf8c56449-95qgx"] Sep 11 08:00:44.168870 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.168841 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vnj9\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-kube-api-access-7vnj9\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.169050 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.168897 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f0bed84-e3b8-46e7-a773-0d97903965c5-trusted-ca\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.169050 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.169006 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-bound-sa-token\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.169050 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.169031 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f0bed84-e3b8-46e7-a773-0d97903965c5-installation-pull-secrets\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.169181 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.169115 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f0bed84-e3b8-46e7-a773-0d97903965c5-image-registry-private-configuration\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.169181 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.169149 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-certificates\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.169181 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.169181 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f0bed84-e3b8-46e7-a773-0d97903965c5-ca-trust-extracted\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.169284 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.169200 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.270203 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.270164 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f0bed84-e3b8-46e7-a773-0d97903965c5-trusted-ca\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.270413 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.270220 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-bound-sa-token\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.270413 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.270327 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f0bed84-e3b8-46e7-a773-0d97903965c5-installation-pull-secrets\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.270413 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.270379 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f0bed84-e3b8-46e7-a773-0d97903965c5-image-registry-private-configuration\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.270413 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.270406 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-certificates\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.270638 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.270443 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f0bed84-e3b8-46e7-a773-0d97903965c5-ca-trust-extracted\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.270638 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.270474 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.270638 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.270506 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vnj9\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-kube-api-access-7vnj9\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.270785 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:44.270667 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 08:00:44.270785 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:44.270684 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cf8c56449-95qgx: secret "image-registry-tls" not found Sep 11 08:00:44.270785 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:44.270738 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls podName:5f0bed84-e3b8-46e7-a773-0d97903965c5 nodeName:}" failed. No retries permitted until 2026-09-11 08:00:44.770719175 +0000 UTC m=+73.464084267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls") pod "image-registry-5cf8c56449-95qgx" (UID: "5f0bed84-e3b8-46e7-a773-0d97903965c5") : secret "image-registry-tls" not found Sep 11 08:00:44.271119 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.271093 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f0bed84-e3b8-46e7-a773-0d97903965c5-ca-trust-extracted\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.271119 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.271101 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-certificates\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.271428 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.271405 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f0bed84-e3b8-46e7-a773-0d97903965c5-trusted-ca\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.273329 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.273313 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f0bed84-e3b8-46e7-a773-0d97903965c5-image-registry-private-configuration\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.273468 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.273450 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f0bed84-e3b8-46e7-a773-0d97903965c5-installation-pull-secrets\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.280202 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.280173 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-bound-sa-token\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.281293 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.281277 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vnj9\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-kube-api-access-7vnj9\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.374967 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.374873 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-996qn_829c494b-8597-4f21-b062-ddaf585c527c/serve-healthcheck-canary/0.log" Sep 11 08:00:44.773678 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.773642 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:44.773828 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:44.773801 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 08:00:44.773828 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:44.773822 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cf8c56449-95qgx: secret "image-registry-tls" not found Sep 11 08:00:44.773916 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:44.773879 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls podName:5f0bed84-e3b8-46e7-a773-0d97903965c5 nodeName:}" failed. No retries permitted until 2026-09-11 08:00:45.773862566 +0000 UTC m=+74.467227668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls") pod "image-registry-5cf8c56449-95qgx" (UID: "5f0bed84-e3b8-46e7-a773-0d97903965c5") : secret "image-registry-tls" not found Sep 11 08:00:44.874045 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.874005 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:44.874188 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:44.874056 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:44.874188 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:44.874138 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 08:00:44.874188 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:44.874155 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 08:00:44.874281 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:44.874201 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls podName:7507a76c-ad19-44ab-a11d-2a026642a18f nodeName:}" failed. No retries permitted until 2026-09-11 08:00:48.87418442 +0000 UTC m=+77.567549504 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ckf7k" (UID: "7507a76c-ad19-44ab-a11d-2a026642a18f") : secret "insights-runtime-extractor-tls" not found Sep 11 08:00:44.874281 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:44.874216 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm podName:7507a76c-ad19-44ab-a11d-2a026642a18f nodeName:}" failed. No retries permitted until 2026-09-11 08:00:48.874208464 +0000 UTC m=+77.567573549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ckf7k" (UID: "7507a76c-ad19-44ab-a11d-2a026642a18f") : configmap "kube-rbac-proxy" not found Sep 11 08:00:45.781202 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:45.781166 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:45.781557 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:45.781313 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 08:00:45.781557 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:45.781330 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cf8c56449-95qgx: secret "image-registry-tls" not found Sep 11 08:00:45.781557 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:45.781387 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls podName:5f0bed84-e3b8-46e7-a773-0d97903965c5 nodeName:}" failed. No retries permitted until 2026-09-11 08:00:47.78136831 +0000 UTC m=+76.474733394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls") pod "image-registry-5cf8c56449-95qgx" (UID: "5f0bed84-e3b8-46e7-a773-0d97903965c5") : secret "image-registry-tls" not found Sep 11 08:00:47.798407 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:47.798366 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:47.798799 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:47.798536 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 08:00:47.798799 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:47.798554 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cf8c56449-95qgx: secret "image-registry-tls" not found Sep 11 08:00:47.798799 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:47.798620 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls podName:5f0bed84-e3b8-46e7-a773-0d97903965c5 nodeName:}" failed. No retries permitted until 2026-09-11 08:00:51.798604656 +0000 UTC m=+80.491969741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls") pod "image-registry-5cf8c56449-95qgx" (UID: "5f0bed84-e3b8-46e7-a773-0d97903965c5") : secret "image-registry-tls" not found Sep 11 08:00:48.908008 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:48.907971 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:48.908384 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:48.908018 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:48.908384 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:48.908129 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 08:00:48.908384 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:48.908160 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 08:00:48.908384 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:48.908194 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls podName:7507a76c-ad19-44ab-a11d-2a026642a18f nodeName:}" failed. No retries permitted until 2026-09-11 08:00:56.908179779 +0000 UTC m=+85.601544876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ckf7k" (UID: "7507a76c-ad19-44ab-a11d-2a026642a18f") : secret "insights-runtime-extractor-tls" not found Sep 11 08:00:48.908384 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:48.908220 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm podName:7507a76c-ad19-44ab-a11d-2a026642a18f nodeName:}" failed. No retries permitted until 2026-09-11 08:00:56.908207121 +0000 UTC m=+85.601572205 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ckf7k" (UID: "7507a76c-ad19-44ab-a11d-2a026642a18f") : configmap "kube-rbac-proxy" not found Sep 11 08:00:51.127782 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:51.127739 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-5wpqd\" (UID: \"f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd" Sep 11 08:00:51.130228 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:51.130207 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-5wpqd\" (UID: \"f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd" Sep 11 08:00:51.163276 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:51.163235 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd" Sep 11 08:00:51.432358 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:51.432329 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd"] Sep 11 08:00:51.832395 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:51.832319 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:51.834761 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:51.834731 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls\") pod \"image-registry-5cf8c56449-95qgx\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:51.888535 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:51.888498 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:52.160718 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:52.160554 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cf8c56449-95qgx"] Sep 11 08:00:52.163091 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:00:52.163061 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0bed84_e3b8_46e7_a773_0d97903965c5.slice/crio-f5ffc2148fbe1537a8bbac1a25cf898dc177ea7ee5b74b27373e9df3d6917e89 WatchSource:0}: Error finding container f5ffc2148fbe1537a8bbac1a25cf898dc177ea7ee5b74b27373e9df3d6917e89: Status 404 returned error can't find the container with id f5ffc2148fbe1537a8bbac1a25cf898dc177ea7ee5b74b27373e9df3d6917e89 Sep 11 08:00:52.246870 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:52.246793 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd" event={"ID":"f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca","Type":"ContainerStarted","Data":"fd211fbab0b8d53e22d9a08776f4f0f5de5ca773ba12f45a1606d7b63eb34ae9"} Sep 11 08:00:52.248575 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:52.248551 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" event={"ID":"5f0bed84-e3b8-46e7-a773-0d97903965c5","Type":"ContainerStarted","Data":"002bf86d2f05148525144c6c5dc2dbec13bd7204bb929359b49d46b86c5b3407"} Sep 11 08:00:52.248689 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:52.248597 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" event={"ID":"5f0bed84-e3b8-46e7-a773-0d97903965c5","Type":"ContainerStarted","Data":"f5ffc2148fbe1537a8bbac1a25cf898dc177ea7ee5b74b27373e9df3d6917e89"} Sep 11 08:00:52.248744 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:52.248709 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:00:54.258073 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:54.258035 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd" event={"ID":"f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca","Type":"ContainerStarted","Data":"82451cdcecef8c3177af91e61d7df1b26cfdd97851221d9ba4a2b5dc0193d91e"} Sep 11 08:00:54.258439 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:54.258094 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd" event={"ID":"f8d5c30d-a2b7-4e1c-96b4-6d48dc5127ca","Type":"ContainerStarted","Data":"3b3500a76c48fccb76531d8e3fd0df5d5e16de9d071a6c70960e9a6d91611eb8"} Sep 11 08:00:54.278140 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:54.278093 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-5wpqd" podStartSLOduration=17.397832214 podStartE2EDuration="19.278076544s" totalImagesPullingTime="1.88024433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:00:54.277207149 +0000 UTC m=+82.970572255" watchObservedRunningTime="2026-09-11 08:00:54.278076544 +0000 UTC m=+82.971441693" Sep 11 08:00:54.278274 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:54.278173 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" podStartSLOduration=10.27816629 podStartE2EDuration="10.27816629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:00:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:00:52.269713746 +0000 UTC m=+80.963078854" watchObservedRunningTime="2026-09-11 08:00:54.27816629 +0000 UTC m=+82.971531397" Sep 11 08:00:56.972573 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:56.972542 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:56.972923 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:56.972579 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:00:56.972923 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:56.972690 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 08:00:56.972923 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:00:56.972760 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls podName:7507a76c-ad19-44ab-a11d-2a026642a18f nodeName:}" failed. No retries permitted until 2026-09-11 08:01:12.972740724 +0000 UTC m=+101.666105824 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ckf7k" (UID: "7507a76c-ad19-44ab-a11d-2a026642a18f") : secret "insights-runtime-extractor-tls" not found Sep 11 08:00:56.973160 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:00:56.973139 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7507a76c-ad19-44ab-a11d-2a026642a18f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:01:05.253757 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.253721 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ffbd56464-lxbqg"] Sep 11 08:01:05.258155 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.258136 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ffbd56464-lxbqg" Sep 11 08:01:05.263315 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.263285 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 11 08:01:05.264342 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.264077 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 11 08:01:05.265643 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.265623 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 11 08:01:05.267478 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.267461 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ms6b8\"" Sep 11 08:01:05.269260 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.269241 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 11 08:01:05.296848 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.296824 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ffbd56464-lxbqg"] Sep 11 08:01:05.335823 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.335794 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26574949-0531-4d58-803d-7c1959508319-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6ffbd56464-lxbqg\" (UID: \"26574949-0531-4d58-803d-7c1959508319\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ffbd56464-lxbqg" Sep 11 08:01:05.335996 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.335904 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5dn6\" (UniqueName: \"kubernetes.io/projected/26574949-0531-4d58-803d-7c1959508319-kube-api-access-q5dn6\") pod \"managed-serviceaccount-addon-agent-6ffbd56464-lxbqg\" (UID: \"26574949-0531-4d58-803d-7c1959508319\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ffbd56464-lxbqg" Sep 11 08:01:05.356563 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.356529 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cf8c56449-95qgx"] Sep 11 08:01:05.370852 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.370826 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-bl6hb"] Sep 11 08:01:05.373990 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.373969 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-bl6hb" Sep 11 08:01:05.377103 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.377079 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 11 08:01:05.377215 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.377198 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9dls4\"" Sep 11 08:01:05.384388 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.384373 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 11 08:01:05.392566 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.392545 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-bl6hb"] Sep 11 08:01:05.437583 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.436978 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqn9z\" (UniqueName: \"kubernetes.io/projected/96d1bce2-bfd5-4f80-9b61-a2bdf0f7ff56-kube-api-access-sqn9z\") pod \"downloads-76f99584f4-bl6hb\" (UID: \"96d1bce2-bfd5-4f80-9b61-a2bdf0f7ff56\") " pod="openshift-console/downloads-76f99584f4-bl6hb" Sep 11 08:01:05.437583 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.437057 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5dn6\" (UniqueName: \"kubernetes.io/projected/26574949-0531-4d58-803d-7c1959508319-kube-api-access-q5dn6\") pod \"managed-serviceaccount-addon-agent-6ffbd56464-lxbqg\" (UID: \"26574949-0531-4d58-803d-7c1959508319\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ffbd56464-lxbqg" Sep 11 08:01:05.437583 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.437108 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26574949-0531-4d58-803d-7c1959508319-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6ffbd56464-lxbqg\" (UID: \"26574949-0531-4d58-803d-7c1959508319\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ffbd56464-lxbqg" Sep 11 08:01:05.438840 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.438822 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75668786cb-bvcks"] Sep 11 08:01:05.439771 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.439747 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26574949-0531-4d58-803d-7c1959508319-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6ffbd56464-lxbqg\" (UID: \"26574949-0531-4d58-803d-7c1959508319\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ffbd56464-lxbqg" Sep 11 08:01:05.441822 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.441805 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.455551 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.455530 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5dn6\" (UniqueName: \"kubernetes.io/projected/26574949-0531-4d58-803d-7c1959508319-kube-api-access-q5dn6\") pod \"managed-serviceaccount-addon-agent-6ffbd56464-lxbqg\" (UID: \"26574949-0531-4d58-803d-7c1959508319\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ffbd56464-lxbqg" Sep 11 08:01:05.459646 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.459621 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75668786cb-bvcks"] Sep 11 08:01:05.538198 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.538115 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ed1d0bec-274f-4377-947e-93d17a5430c6-trusted-ca\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.538198 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.538153 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ed1d0bec-274f-4377-947e-93d17a5430c6-registry-certificates\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.538198 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.538175 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed1d0bec-274f-4377-947e-93d17a5430c6-bound-sa-token\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.538401 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.538230 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqn9z\" (UniqueName: \"kubernetes.io/projected/96d1bce2-bfd5-4f80-9b61-a2bdf0f7ff56-kube-api-access-sqn9z\") pod \"downloads-76f99584f4-bl6hb\" (UID: \"96d1bce2-bfd5-4f80-9b61-a2bdf0f7ff56\") " pod="openshift-console/downloads-76f99584f4-bl6hb" Sep 11 08:01:05.538401 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.538261 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ed1d0bec-274f-4377-947e-93d17a5430c6-installation-pull-secrets\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.538401 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.538307 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ed1d0bec-274f-4377-947e-93d17a5430c6-image-registry-private-configuration\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.538401 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.538332 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed1d0bec-274f-4377-947e-93d17a5430c6-registry-tls\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.538401 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.538349 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxfps\" (UniqueName: \"kubernetes.io/projected/ed1d0bec-274f-4377-947e-93d17a5430c6-kube-api-access-bxfps\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.538563 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.538428 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ed1d0bec-274f-4377-947e-93d17a5430c6-ca-trust-extracted\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.551855 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.551825 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqn9z\" (UniqueName: \"kubernetes.io/projected/96d1bce2-bfd5-4f80-9b61-a2bdf0f7ff56-kube-api-access-sqn9z\") pod \"downloads-76f99584f4-bl6hb\" (UID: \"96d1bce2-bfd5-4f80-9b61-a2bdf0f7ff56\") " pod="openshift-console/downloads-76f99584f4-bl6hb" Sep 11 08:01:05.576702 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.576676 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ffbd56464-lxbqg" Sep 11 08:01:05.639908 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.639676 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ed1d0bec-274f-4377-947e-93d17a5430c6-ca-trust-extracted\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.639908 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.639730 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ed1d0bec-274f-4377-947e-93d17a5430c6-trusted-ca\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.639908 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.639764 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ed1d0bec-274f-4377-947e-93d17a5430c6-registry-certificates\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.640809 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.640017 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed1d0bec-274f-4377-947e-93d17a5430c6-bound-sa-token\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.640809 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.640070 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ed1d0bec-274f-4377-947e-93d17a5430c6-installation-pull-secrets\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.640809 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.640135 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ed1d0bec-274f-4377-947e-93d17a5430c6-image-registry-private-configuration\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.640809 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.640173 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed1d0bec-274f-4377-947e-93d17a5430c6-registry-tls\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.640809 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.640217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxfps\" (UniqueName: \"kubernetes.io/projected/ed1d0bec-274f-4377-947e-93d17a5430c6-kube-api-access-bxfps\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.640809 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.640249 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ed1d0bec-274f-4377-947e-93d17a5430c6-ca-trust-extracted\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.641811 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.641783 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ed1d0bec-274f-4377-947e-93d17a5430c6-registry-certificates\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.643917 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.643879 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ed1d0bec-274f-4377-947e-93d17a5430c6-installation-pull-secrets\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.644030 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.643909 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed1d0bec-274f-4377-947e-93d17a5430c6-registry-tls\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.644307 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.644287 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ed1d0bec-274f-4377-947e-93d17a5430c6-image-registry-private-configuration\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.644802 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.644779 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ed1d0bec-274f-4377-947e-93d17a5430c6-trusted-ca\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.661429 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.661404 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed1d0bec-274f-4377-947e-93d17a5430c6-bound-sa-token\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.669737 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.669711 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxfps\" (UniqueName: \"kubernetes.io/projected/ed1d0bec-274f-4377-947e-93d17a5430c6-kube-api-access-bxfps\") pod \"image-registry-75668786cb-bvcks\" (UID: \"ed1d0bec-274f-4377-947e-93d17a5430c6\") " pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.682579 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.682562 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-bl6hb" Sep 11 08:01:05.751999 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.751965 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:05.875752 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.875721 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ffbd56464-lxbqg"] Sep 11 08:01:05.878638 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:01:05.878609 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26574949_0531_4d58_803d_7c1959508319.slice/crio-7c4f81c60b4a9d8987bf2ffc1212d27e8e97fb066618ef0cdcad26655c30df8b WatchSource:0}: Error finding container 7c4f81c60b4a9d8987bf2ffc1212d27e8e97fb066618ef0cdcad26655c30df8b: Status 404 returned error can't find the container with id 7c4f81c60b4a9d8987bf2ffc1212d27e8e97fb066618ef0cdcad26655c30df8b Sep 11 08:01:05.974335 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:05.974301 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-bl6hb"] Sep 11 08:01:05.986626 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:01:05.986600 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d1bce2_bfd5_4f80_9b61_a2bdf0f7ff56.slice/crio-e67b2271ff3447956024173fb2b33a938a24af7a699fe4185f399b2fc4844d95 WatchSource:0}: Error finding container e67b2271ff3447956024173fb2b33a938a24af7a699fe4185f399b2fc4844d95: Status 404 returned error can't find the container with id e67b2271ff3447956024173fb2b33a938a24af7a699fe4185f399b2fc4844d95 Sep 11 08:01:06.047578 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:06.047500 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75668786cb-bvcks"] Sep 11 08:01:06.050428 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:01:06.050400 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded1d0bec_274f_4377_947e_93d17a5430c6.slice/crio-81699e37bfdf194ab88316bb25f4e3c9d30b0d4e26906d83ee05a86168844f08 WatchSource:0}: Error finding container 81699e37bfdf194ab88316bb25f4e3c9d30b0d4e26906d83ee05a86168844f08: Status 404 returned error can't find the container with id 81699e37bfdf194ab88316bb25f4e3c9d30b0d4e26906d83ee05a86168844f08 Sep 11 08:01:06.300113 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:06.300021 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75668786cb-bvcks" event={"ID":"ed1d0bec-274f-4377-947e-93d17a5430c6","Type":"ContainerStarted","Data":"0dd8242af9115daab6edf8519f1ff38b883bebe56041c54835fedc067c442fdb"} Sep 11 08:01:06.300113 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:06.300069 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75668786cb-bvcks" event={"ID":"ed1d0bec-274f-4377-947e-93d17a5430c6","Type":"ContainerStarted","Data":"81699e37bfdf194ab88316bb25f4e3c9d30b0d4e26906d83ee05a86168844f08"} Sep 11 08:01:06.300556 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:06.300113 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:06.301407 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:06.301382 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-bl6hb" event={"ID":"96d1bce2-bfd5-4f80-9b61-a2bdf0f7ff56","Type":"ContainerStarted","Data":"e67b2271ff3447956024173fb2b33a938a24af7a699fe4185f399b2fc4844d95"} Sep 11 08:01:06.302518 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:06.302498 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ffbd56464-lxbqg" event={"ID":"26574949-0531-4d58-803d-7c1959508319","Type":"ContainerStarted","Data":"7c4f81c60b4a9d8987bf2ffc1212d27e8e97fb066618ef0cdcad26655c30df8b"} Sep 11 08:01:06.332487 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:06.332423 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75668786cb-bvcks" podStartSLOduration=1.332406195 podStartE2EDuration="1.332406195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:01:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:01:06.331680535 +0000 UTC m=+95.025045639" watchObservedRunningTime="2026-09-11 08:01:06.332406195 +0000 UTC m=+95.025771300" Sep 11 08:01:08.164357 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:08.164318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:01:08.168698 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:08.168668 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f34985f-637a-4d5e-a0a9-67181090b361-metrics-tls\") pod \"dns-default-hcwhz\" (UID: \"1f34985f-637a-4d5e-a0a9-67181090b361\") " pod="openshift-dns/dns-default-hcwhz" Sep 11 08:01:08.435838 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:08.435759 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g75rl\"" Sep 11 08:01:08.444111 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:08.444070 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hcwhz" Sep 11 08:01:08.893408 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:08.893375 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hcwhz"] Sep 11 08:01:08.896864 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:01:08.896835 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f34985f_637a_4d5e_a0a9_67181090b361.slice/crio-65e98586603ee9a6026c778f1904b9c6a20fdfe5d985a5b4afef87ee3ae9e005 WatchSource:0}: Error finding container 65e98586603ee9a6026c778f1904b9c6a20fdfe5d985a5b4afef87ee3ae9e005: Status 404 returned error can't find the container with id 65e98586603ee9a6026c778f1904b9c6a20fdfe5d985a5b4afef87ee3ae9e005 Sep 11 08:01:09.318142 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:09.318060 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hcwhz" event={"ID":"1f34985f-637a-4d5e-a0a9-67181090b361","Type":"ContainerStarted","Data":"65e98586603ee9a6026c778f1904b9c6a20fdfe5d985a5b4afef87ee3ae9e005"} Sep 11 08:01:09.319673 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:09.319651 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ffbd56464-lxbqg" event={"ID":"26574949-0531-4d58-803d-7c1959508319","Type":"ContainerStarted","Data":"8f53d38a026d2777c29450bdb9593c82f5f6299eefd8eceb207457f4befec2af"} Sep 11 08:01:11.328144 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:11.328113 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hcwhz" event={"ID":"1f34985f-637a-4d5e-a0a9-67181090b361","Type":"ContainerStarted","Data":"13f04e6c65a53e0d42d2ea5cf6cb0f5750f12cdc80ad1a76edfb4503b454e281"} Sep 11 08:01:12.334604 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:12.334564 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hcwhz" event={"ID":"1f34985f-637a-4d5e-a0a9-67181090b361","Type":"ContainerStarted","Data":"54264e184aec13b25d83fc0c1490497b446311ea474be93964e2dc7a17aa2065"} Sep 11 08:01:12.335057 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:12.334695 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hcwhz" Sep 11 08:01:12.360522 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:12.360465 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hcwhz" podStartSLOduration=66.08532019 podStartE2EDuration="1m8.360445998s" totalImagesPullingTime="2.275125808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:01:12.359533571 +0000 UTC m=+101.052898679" watchObservedRunningTime="2026-09-11 08:01:12.360445998 +0000 UTC m=+101.053811116" Sep 11 08:01:12.361363 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:12.361322 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ffbd56464-lxbqg" podStartSLOduration=4.539443979 podStartE2EDuration="7.361313242s" totalImagesPullingTime="2.821869263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:01:09.340960344 +0000 UTC m=+98.034325452" watchObservedRunningTime="2026-09-11 08:01:12.361313242 +0000 UTC m=+101.054678343" Sep 11 08:01:13.005179 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:13.005144 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:01:13.007562 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:13.007540 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7507a76c-ad19-44ab-a11d-2a026642a18f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ckf7k\" (UID: \"7507a76c-ad19-44ab-a11d-2a026642a18f\") " pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:01:13.169161 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:13.169124 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ckf7k" Sep 11 08:01:13.489198 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:13.489165 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ckf7k"] Sep 11 08:01:13.492350 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:01:13.492308 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7507a76c_ad19_44ab_a11d_2a026642a18f.slice/crio-5d1f4c1540ec84b5a794ec55fe66e684ee18c3d1e20e697d27826668476715f1 WatchSource:0}: Error finding container 5d1f4c1540ec84b5a794ec55fe66e684ee18c3d1e20e697d27826668476715f1: Status 404 returned error can't find the container with id 5d1f4c1540ec84b5a794ec55fe66e684ee18c3d1e20e697d27826668476715f1 Sep 11 08:01:14.224339 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:14.224313 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w4bks" Sep 11 08:01:14.344368 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:14.344331 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ckf7k" event={"ID":"7507a76c-ad19-44ab-a11d-2a026642a18f","Type":"ContainerStarted","Data":"528acdd8fa2cac9c6c63124a96c92e42d2fc515e2e669ca1fb1657f9a698e377"} Sep 11 08:01:14.344540 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:14.344403 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ckf7k" event={"ID":"7507a76c-ad19-44ab-a11d-2a026642a18f","Type":"ContainerStarted","Data":"5d1f4c1540ec84b5a794ec55fe66e684ee18c3d1e20e697d27826668476715f1"} Sep 11 08:01:15.350169 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:15.350135 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ckf7k" event={"ID":"7507a76c-ad19-44ab-a11d-2a026642a18f","Type":"ContainerStarted","Data":"d467dd41b74363db26af093f1a885700cd67e893a487c45ab165f323ab8f2f0f"} Sep 11 08:01:15.363245 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:15.363202 2566 patch_prober.go:28] interesting pod/image-registry-5cf8c56449-95qgx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 11 08:01:15.363396 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:15.363264 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" podUID="5f0bed84-e3b8-46e7-a773-0d97903965c5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 11 08:01:17.361246 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:17.361211 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ckf7k" event={"ID":"7507a76c-ad19-44ab-a11d-2a026642a18f","Type":"ContainerStarted","Data":"ba873f13e7d226b23c911b9c3ffbe1cd7fb0d23c77603b02311d450217025b8a"} Sep 11 08:01:17.398145 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:17.398074 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ckf7k" podStartSLOduration=33.638774463 podStartE2EDuration="36.398051536s" totalImagesPullingTime="2.759277073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 08:00:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:01:17.397783308 +0000 UTC m=+106.091148414" watchObservedRunningTime="2026-09-11 08:01:17.398051536 +0000 UTC m=+106.091416642" Sep 11 08:01:22.341548 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:22.341510 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hcwhz" Sep 11 08:01:23.339114 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.339079 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s8mqg"] Sep 11 08:01:23.341522 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.341501 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz"] Sep 11 08:01:23.341665 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.341648 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.343728 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.343704 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.350194 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.350174 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 11 08:01:23.350822 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.350624 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 11 08:01:23.350822 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.350677 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 11 08:01:23.350822 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.350708 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f78r6\"" Sep 11 08:01:23.351067 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.350895 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 11 08:01:23.351124 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.351063 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 11 08:01:23.351463 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.351445 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 11 08:01:23.351647 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.351631 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-shzls\"" Sep 11 08:01:23.352441 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.352425 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 11 08:01:23.353171 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.353156 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 11 08:01:23.353538 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.353524 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 11 08:01:23.361071 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.361050 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz"] Sep 11 08:01:23.497628 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.497593 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/540c9aba-acc3-49ba-9972-09dd84125f98-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.497628 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.497637 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75601bf7-1576-41a7-80d0-c627a1f9e23a-node-exporter-textfile\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.497879 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.497666 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75601bf7-1576-41a7-80d0-c627a1f9e23a-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.497879 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.497694 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tv97\" (UniqueName: \"kubernetes.io/projected/540c9aba-acc3-49ba-9972-09dd84125f98-kube-api-access-4tv97\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.497879 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.497735 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75601bf7-1576-41a7-80d0-c627a1f9e23a-metrics-client-ca\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.497879 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.497754 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/540c9aba-acc3-49ba-9972-09dd84125f98-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.497879 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.497775 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/540c9aba-acc3-49ba-9972-09dd84125f98-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.497879 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.497855 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75601bf7-1576-41a7-80d0-c627a1f9e23a-node-exporter-wtmp\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.498241 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.497881 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75601bf7-1576-41a7-80d0-c627a1f9e23a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.498241 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.497919 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75601bf7-1576-41a7-80d0-c627a1f9e23a-sys\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.498241 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.497968 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf8hv\" (UniqueName: \"kubernetes.io/projected/75601bf7-1576-41a7-80d0-c627a1f9e23a-kube-api-access-qf8hv\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.498241 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.498000 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/540c9aba-acc3-49ba-9972-09dd84125f98-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.498241 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.498029 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/540c9aba-acc3-49ba-9972-09dd84125f98-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.498241 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.498059 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75601bf7-1576-41a7-80d0-c627a1f9e23a-node-exporter-tls\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.498241 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.498087 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75601bf7-1576-41a7-80d0-c627a1f9e23a-root\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.599385 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.599290 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/540c9aba-acc3-49ba-9972-09dd84125f98-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.599385 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.599340 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75601bf7-1576-41a7-80d0-c627a1f9e23a-node-exporter-textfile\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.599589 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.599458 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75601bf7-1576-41a7-80d0-c627a1f9e23a-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.599589 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.599510 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tv97\" (UniqueName: \"kubernetes.io/projected/540c9aba-acc3-49ba-9972-09dd84125f98-kube-api-access-4tv97\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.599589 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.599559 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75601bf7-1576-41a7-80d0-c627a1f9e23a-metrics-client-ca\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.599589 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.599584 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/540c9aba-acc3-49ba-9972-09dd84125f98-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.599721 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.599607 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/540c9aba-acc3-49ba-9972-09dd84125f98-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.599721 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.599661 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75601bf7-1576-41a7-80d0-c627a1f9e23a-node-exporter-wtmp\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.599721 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.599668 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75601bf7-1576-41a7-80d0-c627a1f9e23a-node-exporter-textfile\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.599721 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.599688 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75601bf7-1576-41a7-80d0-c627a1f9e23a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.599853 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.599732 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75601bf7-1576-41a7-80d0-c627a1f9e23a-sys\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.599853 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.599758 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf8hv\" (UniqueName: \"kubernetes.io/projected/75601bf7-1576-41a7-80d0-c627a1f9e23a-kube-api-access-qf8hv\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.599853 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.599779 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/540c9aba-acc3-49ba-9972-09dd84125f98-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.599853 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.599802 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/540c9aba-acc3-49ba-9972-09dd84125f98-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.599853 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.599821 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75601bf7-1576-41a7-80d0-c627a1f9e23a-node-exporter-tls\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.599853 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.599841 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75601bf7-1576-41a7-80d0-c627a1f9e23a-root\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.600149 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.599912 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75601bf7-1576-41a7-80d0-c627a1f9e23a-root\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.600149 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:01:23.600016 2566 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 11 08:01:23.600149 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.600045 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75601bf7-1576-41a7-80d0-c627a1f9e23a-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.600149 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:01:23.600112 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/540c9aba-acc3-49ba-9972-09dd84125f98-kube-state-metrics-tls podName:540c9aba-acc3-49ba-9972-09dd84125f98 nodeName:}" failed. No retries permitted until 2026-09-11 08:01:24.100084726 +0000 UTC m=+112.793449858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/540c9aba-acc3-49ba-9972-09dd84125f98-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-kdnrz" (UID: "540c9aba-acc3-49ba-9972-09dd84125f98") : secret "kube-state-metrics-tls" not found Sep 11 08:01:23.600327 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.600181 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75601bf7-1576-41a7-80d0-c627a1f9e23a-metrics-client-ca\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.600369 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.600337 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/540c9aba-acc3-49ba-9972-09dd84125f98-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.600459 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.600439 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75601bf7-1576-41a7-80d0-c627a1f9e23a-node-exporter-wtmp\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.600514 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.600495 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75601bf7-1576-41a7-80d0-c627a1f9e23a-sys\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.600865 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.600844 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/540c9aba-acc3-49ba-9972-09dd84125f98-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.601152 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.600996 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/540c9aba-acc3-49ba-9972-09dd84125f98-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.602593 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.602537 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/540c9aba-acc3-49ba-9972-09dd84125f98-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.602798 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.602775 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75601bf7-1576-41a7-80d0-c627a1f9e23a-node-exporter-tls\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.603303 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.603279 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75601bf7-1576-41a7-80d0-c627a1f9e23a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.659242 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.659211 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tv97\" (UniqueName: \"kubernetes.io/projected/540c9aba-acc3-49ba-9972-09dd84125f98-kube-api-access-4tv97\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:23.660663 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.660634 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf8hv\" (UniqueName: \"kubernetes.io/projected/75601bf7-1576-41a7-80d0-c627a1f9e23a-kube-api-access-qf8hv\") pod \"node-exporter-s8mqg\" (UID: \"75601bf7-1576-41a7-80d0-c627a1f9e23a\") " pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:23.953641 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:23.953604 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8mqg" Sep 11 08:01:24.105121 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.105083 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/540c9aba-acc3-49ba-9972-09dd84125f98-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:24.107777 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.107751 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/540c9aba-acc3-49ba-9972-09dd84125f98-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-kdnrz\" (UID: \"540c9aba-acc3-49ba-9972-09dd84125f98\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:24.259414 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.259333 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" Sep 11 08:01:24.643320 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.643228 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:01:24.646378 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.646350 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.680213 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.680184 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 11 08:01:24.680362 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.680251 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 11 08:01:24.680362 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.680285 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 11 08:01:24.682559 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.682537 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 11 08:01:24.682822 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.682798 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 11 08:01:24.682908 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.682842 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 11 08:01:24.684693 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.684675 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 11 08:01:24.688435 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.688397 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 11 08:01:24.690433 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.690415 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lppns\"" Sep 11 08:01:24.690609 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.690592 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 11 08:01:24.718359 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.718331 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:01:24.810804 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.810762 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.810804 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.810801 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.811092 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.810832 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da1f215-db34-4a63-b609-990e0595b748-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.811092 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.810904 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3da1f215-db34-4a63-b609-990e0595b748-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.811092 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.811006 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3da1f215-db34-4a63-b609-990e0595b748-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.811092 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.811088 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcnmg\" (UniqueName: \"kubernetes.io/projected/3da1f215-db34-4a63-b609-990e0595b748-kube-api-access-qcnmg\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.811290 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.811142 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3da1f215-db34-4a63-b609-990e0595b748-config-out\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.811290 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.811169 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.811290 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.811236 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3da1f215-db34-4a63-b609-990e0595b748-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.811290 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.811278 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.811441 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.811302 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-config-volume\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.811441 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.811317 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-web-config\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.811441 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.811385 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.912348 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.912308 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.912538 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.912361 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-config-volume\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.912538 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.912383 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-web-config\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.912538 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.912423 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.912538 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.912466 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.912538 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.912496 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.912538 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.912511 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da1f215-db34-4a63-b609-990e0595b748-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.912538 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.912534 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3da1f215-db34-4a63-b609-990e0595b748-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.912860 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.912556 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3da1f215-db34-4a63-b609-990e0595b748-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.912860 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.912587 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcnmg\" (UniqueName: \"kubernetes.io/projected/3da1f215-db34-4a63-b609-990e0595b748-kube-api-access-qcnmg\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.912860 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.912630 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3da1f215-db34-4a63-b609-990e0595b748-config-out\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.912860 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.912645 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.912860 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.912673 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3da1f215-db34-4a63-b609-990e0595b748-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.913638 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.913548 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3da1f215-db34-4a63-b609-990e0595b748-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.913740 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.913716 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3da1f215-db34-4a63-b609-990e0595b748-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.914683 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.914651 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da1f215-db34-4a63-b609-990e0595b748-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.915689 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.915644 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.916000 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.915971 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-web-config\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.916415 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.916391 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-config-volume\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.917491 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.917429 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3da1f215-db34-4a63-b609-990e0595b748-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.917491 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.917430 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.917719 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.917692 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3da1f215-db34-4a63-b609-990e0595b748-config-out\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.917903 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.917882 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.918209 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.918190 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.918804 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.918785 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.948384 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.948348 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcnmg\" (UniqueName: \"kubernetes.io/projected/3da1f215-db34-4a63-b609-990e0595b748-kube-api-access-qcnmg\") pod \"alertmanager-main-0\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:24.958344 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:24.958312 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:01:25.361681 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:25.361591 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:01:25.657016 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:01:25.656983 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75601bf7_1576_41a7_80d0_c627a1f9e23a.slice/crio-20140b98379bdbf1c40ad94b45484203eaf5d10577687df3477afc3ad89bee66 WatchSource:0}: Error finding container 20140b98379bdbf1c40ad94b45484203eaf5d10577687df3477afc3ad89bee66: Status 404 returned error can't find the container with id 20140b98379bdbf1c40ad94b45484203eaf5d10577687df3477afc3ad89bee66 Sep 11 08:01:25.937306 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:25.937275 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz"] Sep 11 08:01:25.942904 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:01:25.942866 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod540c9aba_acc3_49ba_9972_09dd84125f98.slice/crio-223cf086540c9ab6b82a5a508b8c00f44b77107da244b5953d0baf1cc8b2074f WatchSource:0}: Error finding container 223cf086540c9ab6b82a5a508b8c00f44b77107da244b5953d0baf1cc8b2074f: Status 404 returned error can't find the container with id 223cf086540c9ab6b82a5a508b8c00f44b77107da244b5953d0baf1cc8b2074f Sep 11 08:01:25.966339 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:25.966307 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:01:25.978618 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:01:25.978445 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da1f215_db34_4a63_b609_990e0595b748.slice/crio-9ed376b4a290dae2b1d61cbdc94107d97aa3613292f667232cc191aa13aa82bb WatchSource:0}: Error finding container 9ed376b4a290dae2b1d61cbdc94107d97aa3613292f667232cc191aa13aa82bb: Status 404 returned error can't find the container with id 9ed376b4a290dae2b1d61cbdc94107d97aa3613292f667232cc191aa13aa82bb Sep 11 08:01:26.399031 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.398988 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-bl6hb" event={"ID":"96d1bce2-bfd5-4f80-9b61-a2bdf0f7ff56","Type":"ContainerStarted","Data":"c34bdfa36ddf74866b1dfbdb9ec243230261743cbea7ceb45c0ada3f3a148f81"} Sep 11 08:01:26.399378 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.399356 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-bl6hb" Sep 11 08:01:26.401508 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.401316 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" event={"ID":"540c9aba-acc3-49ba-9972-09dd84125f98","Type":"ContainerStarted","Data":"223cf086540c9ab6b82a5a508b8c00f44b77107da244b5953d0baf1cc8b2074f"} Sep 11 08:01:26.403304 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.403272 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3da1f215-db34-4a63-b609-990e0595b748","Type":"ContainerStarted","Data":"9ed376b4a290dae2b1d61cbdc94107d97aa3613292f667232cc191aa13aa82bb"} Sep 11 08:01:26.404726 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.404701 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8mqg" event={"ID":"75601bf7-1576-41a7-80d0-c627a1f9e23a","Type":"ContainerStarted","Data":"20140b98379bdbf1c40ad94b45484203eaf5d10577687df3477afc3ad89bee66"} Sep 11 08:01:26.412826 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.412752 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-bl6hb" Sep 11 08:01:26.437804 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.437731 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-bl6hb" podStartSLOduration=1.6942238349999998 podStartE2EDuration="21.437707757s" totalImagesPullingTime="19.743483922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:01:26.430480638 +0000 UTC m=+115.123845745" watchObservedRunningTime="2026-09-11 08:01:26.437707757 +0000 UTC m=+115.131072865" Sep 11 08:01:26.439528 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.439460 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn"] Sep 11 08:01:26.453610 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.453577 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.459760 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.458701 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 11 08:01:26.464463 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.462623 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 11 08:01:26.464463 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.462637 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 11 08:01:26.464463 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.462750 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-92vnmclpsdhbe\"" Sep 11 08:01:26.464463 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.460604 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 11 08:01:26.464463 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.463090 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 11 08:01:26.464793 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.464557 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-s7878\"" Sep 11 08:01:26.466047 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.465960 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn"] Sep 11 08:01:26.629288 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.629245 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-metrics-client-ca\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.629470 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.629337 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-thanos-querier-tls\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.629470 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.629387 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.629470 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.629422 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.629655 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.629488 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-grpc-tls\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.629655 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.629520 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.629655 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.629551 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.629655 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.629593 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vszw6\" (UniqueName: \"kubernetes.io/projected/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-kube-api-access-vszw6\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.730329 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.730245 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vszw6\" (UniqueName: \"kubernetes.io/projected/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-kube-api-access-vszw6\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.730329 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.730314 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-metrics-client-ca\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.730810 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.730391 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-thanos-querier-tls\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.731012 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.730983 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.731086 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.731035 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.731132 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.731099 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-grpc-tls\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.731184 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.731132 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.731184 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.731163 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.732242 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.732211 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-metrics-client-ca\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.739540 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.739479 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-grpc-tls\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.739540 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.739496 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.740368 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.740312 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.740896 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.740860 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-thanos-querier-tls\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.744685 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.744632 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vszw6\" (UniqueName: \"kubernetes.io/projected/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-kube-api-access-vszw6\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.750513 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.750461 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.754417 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.754370 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b3027a9-b301-4689-95e3-4f2f2d4e2bc1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b8bc5b84-zzhtn\" (UID: \"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1\") " pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:26.772581 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:26.772279 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:27.080590 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:27.080551 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn"] Sep 11 08:01:27.315104 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:27.314549 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75668786cb-bvcks" Sep 11 08:01:27.395839 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:01:27.395753 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3027a9_b301_4689_95e3_4f2f2d4e2bc1.slice/crio-deaa24cdbd8b2c3f914de7e0d8894d4bc76a82f53ee8f9829278db1e27b5c4bc WatchSource:0}: Error finding container deaa24cdbd8b2c3f914de7e0d8894d4bc76a82f53ee8f9829278db1e27b5c4bc: Status 404 returned error can't find the container with id deaa24cdbd8b2c3f914de7e0d8894d4bc76a82f53ee8f9829278db1e27b5c4bc Sep 11 08:01:27.413528 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:27.413495 2566 generic.go:356] "Generic (PLEG): container finished" podID="75601bf7-1576-41a7-80d0-c627a1f9e23a" containerID="4aada45169a3a8d1b0808a43523ce4b1dee3ec36645579d875c42c11088b1d7b" exitCode=0 Sep 11 08:01:27.413667 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:27.413594 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8mqg" event={"ID":"75601bf7-1576-41a7-80d0-c627a1f9e23a","Type":"ContainerDied","Data":"4aada45169a3a8d1b0808a43523ce4b1dee3ec36645579d875c42c11088b1d7b"} Sep 11 08:01:27.415597 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:27.415503 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" event={"ID":"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1","Type":"ContainerStarted","Data":"deaa24cdbd8b2c3f914de7e0d8894d4bc76a82f53ee8f9829278db1e27b5c4bc"} Sep 11 08:01:28.425031 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:28.424990 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" event={"ID":"540c9aba-acc3-49ba-9972-09dd84125f98","Type":"ContainerStarted","Data":"72e55e1d97d4feba9667e2ddfe2357c49f0a32ef1c9abd51116622bc76761215"} Sep 11 08:01:28.430666 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:28.429825 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3da1f215-db34-4a63-b609-990e0595b748","Type":"ContainerStarted","Data":"5838bc3e87f6aa149b9c4fee11f6fd85f898bd061e3e9fa10cf209a12fa76b03"} Sep 11 08:01:28.435318 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:28.435248 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8mqg" event={"ID":"75601bf7-1576-41a7-80d0-c627a1f9e23a","Type":"ContainerStarted","Data":"14fd47690b0eee45e3dd380d322fde7aabbe4e63153bd11d38f796286d20a5b0"} Sep 11 08:01:29.442356 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:29.442318 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" event={"ID":"540c9aba-acc3-49ba-9972-09dd84125f98","Type":"ContainerStarted","Data":"d916d5390a2eee69c0622624352090c0c037dbc1feec57207ffa748fb12ad4b8"} Sep 11 08:01:29.442810 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:29.442394 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" event={"ID":"540c9aba-acc3-49ba-9972-09dd84125f98","Type":"ContainerStarted","Data":"89456d7d15920a6da48ac2143ba90b2d2427f02d995ee6ec666a295d813496f3"} Sep 11 08:01:29.444586 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:29.444557 2566 generic.go:356] "Generic (PLEG): container finished" podID="3da1f215-db34-4a63-b609-990e0595b748" containerID="5838bc3e87f6aa149b9c4fee11f6fd85f898bd061e3e9fa10cf209a12fa76b03" exitCode=0 Sep 11 08:01:29.444713 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:29.444637 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3da1f215-db34-4a63-b609-990e0595b748","Type":"ContainerDied","Data":"5838bc3e87f6aa149b9c4fee11f6fd85f898bd061e3e9fa10cf209a12fa76b03"} Sep 11 08:01:29.447300 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:29.447275 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8mqg" event={"ID":"75601bf7-1576-41a7-80d0-c627a1f9e23a","Type":"ContainerStarted","Data":"a590f13e6bf431971347de246aaaa288df4f3b732c8ffe89b98c9bdc16be745a"} Sep 11 08:01:29.472853 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:29.472761 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-kdnrz" podStartSLOduration=4.208734864 podStartE2EDuration="6.472739249s" totalImagesPullingTime="2.264004385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:01:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:01:29.472216963 +0000 UTC m=+118.165582072" watchObservedRunningTime="2026-09-11 08:01:29.472739249 +0000 UTC m=+118.166104355" Sep 11 08:01:29.503254 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:29.503170 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s8mqg" podStartSLOduration=5.234158219 podStartE2EDuration="6.503148813s" totalImagesPullingTime="1.175750205s" totalInitContainerRuntime="93.240389ms" isStatefulPod=true podCreationTimestamp="2026-09-11 08:01:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:01:29.500825862 +0000 UTC m=+118.194190969" watchObservedRunningTime="2026-09-11 08:01:29.503148813 +0000 UTC m=+118.196513919" Sep 11 08:01:30.375639 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.375553 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" podUID="5f0bed84-e3b8-46e7-a773-0d97903965c5" containerName="registry" containerID="cri-o://002bf86d2f05148525144c6c5dc2dbec13bd7204bb929359b49d46b86c5b3407" gracePeriod=30 Sep 11 08:01:30.696078 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.695529 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:01:30.876955 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.876910 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f0bed84-e3b8-46e7-a773-0d97903965c5-trusted-ca\") pod \"5f0bed84-e3b8-46e7-a773-0d97903965c5\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " Sep 11 08:01:30.877126 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.876989 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls\") pod \"5f0bed84-e3b8-46e7-a773-0d97903965c5\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " Sep 11 08:01:30.877126 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.877031 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-certificates\") pod \"5f0bed84-e3b8-46e7-a773-0d97903965c5\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " Sep 11 08:01:30.877126 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.877063 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f0bed84-e3b8-46e7-a773-0d97903965c5-image-registry-private-configuration\") pod \"5f0bed84-e3b8-46e7-a773-0d97903965c5\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " Sep 11 08:01:30.877126 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.877102 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vnj9\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-kube-api-access-7vnj9\") pod \"5f0bed84-e3b8-46e7-a773-0d97903965c5\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " Sep 11 08:01:30.877305 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.877145 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f0bed84-e3b8-46e7-a773-0d97903965c5-installation-pull-secrets\") pod \"5f0bed84-e3b8-46e7-a773-0d97903965c5\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " Sep 11 08:01:30.877305 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.877190 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f0bed84-e3b8-46e7-a773-0d97903965c5-ca-trust-extracted\") pod \"5f0bed84-e3b8-46e7-a773-0d97903965c5\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " Sep 11 08:01:30.877305 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.877237 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-bound-sa-token\") pod \"5f0bed84-e3b8-46e7-a773-0d97903965c5\" (UID: \"5f0bed84-e3b8-46e7-a773-0d97903965c5\") " Sep 11 08:01:30.877420 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.877380 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f0bed84-e3b8-46e7-a773-0d97903965c5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5f0bed84-e3b8-46e7-a773-0d97903965c5" (UID: "5f0bed84-e3b8-46e7-a773-0d97903965c5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 08:01:30.877562 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.877543 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f0bed84-e3b8-46e7-a773-0d97903965c5-trusted-ca\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:01:30.878365 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.878335 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5f0bed84-e3b8-46e7-a773-0d97903965c5" (UID: "5f0bed84-e3b8-46e7-a773-0d97903965c5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 08:01:30.880659 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.880584 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f0bed84-e3b8-46e7-a773-0d97903965c5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5f0bed84-e3b8-46e7-a773-0d97903965c5" (UID: "5f0bed84-e3b8-46e7-a773-0d97903965c5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:01:30.880659 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.880609 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f0bed84-e3b8-46e7-a773-0d97903965c5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5f0bed84-e3b8-46e7-a773-0d97903965c5" (UID: "5f0bed84-e3b8-46e7-a773-0d97903965c5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:01:30.880659 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.880630 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-kube-api-access-7vnj9" (OuterVolumeSpecName: "kube-api-access-7vnj9") pod "5f0bed84-e3b8-46e7-a773-0d97903965c5" (UID: "5f0bed84-e3b8-46e7-a773-0d97903965c5"). InnerVolumeSpecName "kube-api-access-7vnj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:01:30.880859 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.880624 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5f0bed84-e3b8-46e7-a773-0d97903965c5" (UID: "5f0bed84-e3b8-46e7-a773-0d97903965c5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:01:30.882102 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.881631 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5f0bed84-e3b8-46e7-a773-0d97903965c5" (UID: "5f0bed84-e3b8-46e7-a773-0d97903965c5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:01:30.888931 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.888901 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f0bed84-e3b8-46e7-a773-0d97903965c5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5f0bed84-e3b8-46e7-a773-0d97903965c5" (UID: "5f0bed84-e3b8-46e7-a773-0d97903965c5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 08:01:30.978324 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.978281 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vnj9\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-kube-api-access-7vnj9\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:01:30.978324 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.978317 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f0bed84-e3b8-46e7-a773-0d97903965c5-installation-pull-secrets\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:01:30.978324 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.978326 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f0bed84-e3b8-46e7-a773-0d97903965c5-ca-trust-extracted\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:01:30.978609 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.978336 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-bound-sa-token\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:01:30.978609 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.978350 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:01:30.978609 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.978361 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f0bed84-e3b8-46e7-a773-0d97903965c5-registry-certificates\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:01:30.978609 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:30.978374 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f0bed84-e3b8-46e7-a773-0d97903965c5-image-registry-private-configuration\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:01:31.464361 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:31.464322 2566 generic.go:356] "Generic (PLEG): container finished" podID="5f0bed84-e3b8-46e7-a773-0d97903965c5" containerID="002bf86d2f05148525144c6c5dc2dbec13bd7204bb929359b49d46b86c5b3407" exitCode=0 Sep 11 08:01:31.464643 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:31.464458 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" event={"ID":"5f0bed84-e3b8-46e7-a773-0d97903965c5","Type":"ContainerDied","Data":"002bf86d2f05148525144c6c5dc2dbec13bd7204bb929359b49d46b86c5b3407"} Sep 11 08:01:31.464643 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:31.464507 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" event={"ID":"5f0bed84-e3b8-46e7-a773-0d97903965c5","Type":"ContainerDied","Data":"f5ffc2148fbe1537a8bbac1a25cf898dc177ea7ee5b74b27373e9df3d6917e89"} Sep 11 08:01:31.464643 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:31.464533 2566 scope.go:117] "RemoveContainer" containerID="002bf86d2f05148525144c6c5dc2dbec13bd7204bb929359b49d46b86c5b3407" Sep 11 08:01:31.464811 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:31.464677 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cf8c56449-95qgx" Sep 11 08:01:31.486412 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:31.486349 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" event={"ID":"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1","Type":"ContainerStarted","Data":"ef407f28bbb0d5b577d2ceb01ca5c5c7fd0704552c59ad1331d127137ddd98fb"} Sep 11 08:01:31.486569 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:31.486460 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" event={"ID":"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1","Type":"ContainerStarted","Data":"c6f41bbd9c2308c063104eac48b1ba7d0a94d3b102cb148ab82885fd75c4d7e2"} Sep 11 08:01:31.486569 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:31.486503 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" event={"ID":"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1","Type":"ContainerStarted","Data":"64d592765ed83569647300064c4834e4db6e4572785425997258e78138fdfad7"} Sep 11 08:01:31.516894 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:31.516854 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cf8c56449-95qgx"] Sep 11 08:01:31.524974 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:31.524927 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5cf8c56449-95qgx"] Sep 11 08:01:31.754871 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:31.754726 2566 scope.go:117] "RemoveContainer" containerID="002bf86d2f05148525144c6c5dc2dbec13bd7204bb929359b49d46b86c5b3407" Sep 11 08:01:31.755187 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:01:31.755160 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"002bf86d2f05148525144c6c5dc2dbec13bd7204bb929359b49d46b86c5b3407\": container with ID starting with 002bf86d2f05148525144c6c5dc2dbec13bd7204bb929359b49d46b86c5b3407 not found: ID does not exist" containerID="002bf86d2f05148525144c6c5dc2dbec13bd7204bb929359b49d46b86c5b3407" Sep 11 08:01:31.755254 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:31.755201 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002bf86d2f05148525144c6c5dc2dbec13bd7204bb929359b49d46b86c5b3407"} err="failed to get container status \"002bf86d2f05148525144c6c5dc2dbec13bd7204bb929359b49d46b86c5b3407\": rpc error: code = NotFound desc = could not find container \"002bf86d2f05148525144c6c5dc2dbec13bd7204bb929359b49d46b86c5b3407\": container with ID starting with 002bf86d2f05148525144c6c5dc2dbec13bd7204bb929359b49d46b86c5b3407 not found: ID does not exist" Sep 11 08:01:31.788424 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:31.788392 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f0bed84-e3b8-46e7-a773-0d97903965c5" path="/var/lib/kubelet/pods/5f0bed84-e3b8-46e7-a773-0d97903965c5/volumes" Sep 11 08:01:32.495317 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:32.495238 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3da1f215-db34-4a63-b609-990e0595b748","Type":"ContainerStarted","Data":"73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a"} Sep 11 08:01:33.503931 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:33.503889 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3da1f215-db34-4a63-b609-990e0595b748","Type":"ContainerStarted","Data":"9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6"} Sep 11 08:01:33.504411 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:33.504029 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3da1f215-db34-4a63-b609-990e0595b748","Type":"ContainerStarted","Data":"f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327"} Sep 11 08:01:33.504411 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:33.504074 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3da1f215-db34-4a63-b609-990e0595b748","Type":"ContainerStarted","Data":"67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51"} Sep 11 08:01:33.504411 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:33.504114 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3da1f215-db34-4a63-b609-990e0595b748","Type":"ContainerStarted","Data":"05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67"} Sep 11 08:01:33.504411 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:33.504145 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3da1f215-db34-4a63-b609-990e0595b748","Type":"ContainerStarted","Data":"543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5"} Sep 11 08:01:33.507637 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:33.507602 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" event={"ID":"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1","Type":"ContainerStarted","Data":"2930a7ea320fbf06d876156937ef5896033e8325dd6a51cc81479bec586403d8"} Sep 11 08:01:33.507779 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:33.507668 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" event={"ID":"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1","Type":"ContainerStarted","Data":"341093f8625581581027d004b79948629ca91d9713120d0cba9ade4d1022fec5"} Sep 11 08:01:33.507779 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:33.507707 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" event={"ID":"4b3027a9-b301-4689-95e3-4f2f2d4e2bc1","Type":"ContainerStarted","Data":"ae9de76b0480a5706a0f6f82c764a5a3f25ac683e5cb558424f9ab70c5bab27f"} Sep 11 08:01:33.507888 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:33.507770 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:33.541279 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:33.541218 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.586953118 podStartE2EDuration="9.541196419s" totalImagesPullingTime="4.933783679s" totalInitContainerRuntime="20.459622ms" isStatefulPod=false podCreationTimestamp="2026-09-11 08:01:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:01:33.54090404 +0000 UTC m=+122.234269147" watchObservedRunningTime="2026-09-11 08:01:33.541196419 +0000 UTC m=+122.234561530" Sep 11 08:01:33.575440 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:33.575137 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" podStartSLOduration=2.424691902 podStartE2EDuration="7.575112113s" totalImagesPullingTime="5.150420211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:01:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:01:33.574444455 +0000 UTC m=+122.267809585" watchObservedRunningTime="2026-09-11 08:01:33.575112113 +0000 UTC m=+122.268477221" Sep 11 08:01:39.517304 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:39.517278 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6b8bc5b84-zzhtn" Sep 11 08:01:40.563502 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:40.563464 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs\") pod \"network-metrics-daemon-t6dx2\" (UID: \"67dde785-fd0c-4213-81d9-bfb6374f6f13\") " pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 08:01:40.565864 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:40.565845 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67dde785-fd0c-4213-81d9-bfb6374f6f13-metrics-certs\") pod \"network-metrics-daemon-t6dx2\" (UID: \"67dde785-fd0c-4213-81d9-bfb6374f6f13\") " pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 08:01:40.608264 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:40.608237 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mdzhs\"" Sep 11 08:01:40.615145 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:40.615126 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t6dx2" Sep 11 08:01:40.938286 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:40.938260 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t6dx2"] Sep 11 08:01:40.941771 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:01:40.941745 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67dde785_fd0c_4213_81d9_bfb6374f6f13.slice/crio-f47e7823dbb0828629d4345ff3593485b32c6c83b0bfb68ac6a83aefc791bd9d WatchSource:0}: Error finding container f47e7823dbb0828629d4345ff3593485b32c6c83b0bfb68ac6a83aefc791bd9d: Status 404 returned error can't find the container with id f47e7823dbb0828629d4345ff3593485b32c6c83b0bfb68ac6a83aefc791bd9d Sep 11 08:01:41.541897 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:41.541858 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t6dx2" event={"ID":"67dde785-fd0c-4213-81d9-bfb6374f6f13","Type":"ContainerStarted","Data":"f47e7823dbb0828629d4345ff3593485b32c6c83b0bfb68ac6a83aefc791bd9d"} Sep 11 08:01:43.551992 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:43.551954 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t6dx2" event={"ID":"67dde785-fd0c-4213-81d9-bfb6374f6f13","Type":"ContainerStarted","Data":"f024bc642a401405c553b9858046a2679c7f288364cb2ab6f121e59fc7be3963"} Sep 11 08:01:43.552366 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:43.552009 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t6dx2" event={"ID":"67dde785-fd0c-4213-81d9-bfb6374f6f13","Type":"ContainerStarted","Data":"e9660232a594ad25ee98c039c414d7758fac7aeb9446c9733e2e78fe051a5468"} Sep 11 08:01:43.580154 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:43.580107 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t6dx2" podStartSLOduration=131.086934392 podStartE2EDuration="2m12.58008909s" totalImagesPullingTime="1.493154698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 07:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:01:43.577792706 +0000 UTC m=+132.271157810" watchObservedRunningTime="2026-09-11 08:01:43.58008909 +0000 UTC m=+132.273454198" Sep 11 08:01:50.579624 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:50.579590 2566 generic.go:356] "Generic (PLEG): container finished" podID="7e443d50-9cf7-49d1-86ef-1263699df771" containerID="af563a1c49c37a5955d2f5d766e05b492f5386d64eb370e98a3c0b6933aa5ab6" exitCode=0 Sep 11 08:01:50.580057 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:50.579662 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j" event={"ID":"7e443d50-9cf7-49d1-86ef-1263699df771","Type":"ContainerDied","Data":"af563a1c49c37a5955d2f5d766e05b492f5386d64eb370e98a3c0b6933aa5ab6"} Sep 11 08:01:50.580057 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:50.579999 2566 scope.go:117] "RemoveContainer" containerID="af563a1c49c37a5955d2f5d766e05b492f5386d64eb370e98a3c0b6933aa5ab6" Sep 11 08:01:51.586441 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:01:51.586408 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-bmc8j" event={"ID":"7e443d50-9cf7-49d1-86ef-1263699df771","Type":"ContainerStarted","Data":"cb597c31a5ad0688001de4d0432da19662378d333f70d8c3211b92ea33ae6341"} Sep 11 08:02:10.658379 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:10.658343 2566 generic.go:356] "Generic (PLEG): container finished" podID="fb46297f-c9c2-4169-8d9f-128b7af240b3" containerID="855f9ae38ca54e47bf89f049e33c7c964e91590cb6a9f9f2a1b981e8407b1f94" exitCode=0 Sep 11 08:02:10.658821 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:10.658413 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-dfbs4" event={"ID":"fb46297f-c9c2-4169-8d9f-128b7af240b3","Type":"ContainerDied","Data":"855f9ae38ca54e47bf89f049e33c7c964e91590cb6a9f9f2a1b981e8407b1f94"} Sep 11 08:02:10.658821 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:10.658795 2566 scope.go:117] "RemoveContainer" containerID="855f9ae38ca54e47bf89f049e33c7c964e91590cb6a9f9f2a1b981e8407b1f94" Sep 11 08:02:10.660075 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:10.660055 2566 generic.go:356] "Generic (PLEG): container finished" podID="355f2490-ff55-4f47-a7fc-c51d26eed56f" containerID="65a16c8d7ec0a12ffe04d61723da2dccec8e83c5acabad8a52d9e5333468936d" exitCode=0 Sep 11 08:02:10.660163 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:10.660087 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9" event={"ID":"355f2490-ff55-4f47-a7fc-c51d26eed56f","Type":"ContainerDied","Data":"65a16c8d7ec0a12ffe04d61723da2dccec8e83c5acabad8a52d9e5333468936d"} Sep 11 08:02:10.660342 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:10.660331 2566 scope.go:117] "RemoveContainer" containerID="65a16c8d7ec0a12ffe04d61723da2dccec8e83c5acabad8a52d9e5333468936d" Sep 11 08:02:11.666142 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:11.666106 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-l42k9" event={"ID":"355f2490-ff55-4f47-a7fc-c51d26eed56f","Type":"ContainerStarted","Data":"0ff87a02298366ae7a0e9e48d9c663defdf88ec63ea7403140ebfd7d4a32ab0e"} Sep 11 08:02:11.667793 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:11.667769 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-dfbs4" event={"ID":"fb46297f-c9c2-4169-8d9f-128b7af240b3","Type":"ContainerStarted","Data":"f462987326bd188bfefbd58983bb51b22e0fb7db1fa9b79f1d419bb24b406b22"} Sep 11 08:02:44.098551 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:44.098507 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:02:44.099187 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:44.098873 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="alertmanager" containerID="cri-o://73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a" gracePeriod=120 Sep 11 08:02:44.099187 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:44.098930 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="kube-rbac-proxy-web" containerID="cri-o://05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67" gracePeriod=120 Sep 11 08:02:44.099187 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:44.098918 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="kube-rbac-proxy-metric" containerID="cri-o://f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327" gracePeriod=120 Sep 11 08:02:44.099187 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:44.099028 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="prom-label-proxy" containerID="cri-o://9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6" gracePeriod=120 Sep 11 08:02:44.099187 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:44.099031 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="config-reloader" containerID="cri-o://543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5" gracePeriod=120 Sep 11 08:02:44.099187 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:44.099009 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="kube-rbac-proxy" containerID="cri-o://67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51" gracePeriod=120 Sep 11 08:02:44.802486 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:44.802457 2566 generic.go:356] "Generic (PLEG): container finished" podID="3da1f215-db34-4a63-b609-990e0595b748" containerID="9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6" exitCode=0 Sep 11 08:02:44.802486 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:44.802480 2566 generic.go:356] "Generic (PLEG): container finished" podID="3da1f215-db34-4a63-b609-990e0595b748" containerID="67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51" exitCode=0 Sep 11 08:02:44.802486 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:44.802486 2566 generic.go:356] "Generic (PLEG): container finished" podID="3da1f215-db34-4a63-b609-990e0595b748" containerID="543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5" exitCode=0 Sep 11 08:02:44.802486 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:44.802492 2566 generic.go:356] "Generic (PLEG): container finished" podID="3da1f215-db34-4a63-b609-990e0595b748" containerID="73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a" exitCode=0 Sep 11 08:02:44.802761 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:44.802524 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3da1f215-db34-4a63-b609-990e0595b748","Type":"ContainerDied","Data":"9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6"} Sep 11 08:02:44.802761 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:44.802584 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3da1f215-db34-4a63-b609-990e0595b748","Type":"ContainerDied","Data":"67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51"} Sep 11 08:02:44.802761 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:44.802611 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3da1f215-db34-4a63-b609-990e0595b748","Type":"ContainerDied","Data":"543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5"} Sep 11 08:02:44.802761 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:44.802634 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3da1f215-db34-4a63-b609-990e0595b748","Type":"ContainerDied","Data":"73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a"} Sep 11 08:02:45.342773 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.342750 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:45.407413 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.407333 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-config-volume\") pod \"3da1f215-db34-4a63-b609-990e0595b748\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " Sep 11 08:02:45.407413 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.407364 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da1f215-db34-4a63-b609-990e0595b748-alertmanager-trusted-ca-bundle\") pod \"3da1f215-db34-4a63-b609-990e0595b748\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " Sep 11 08:02:45.407413 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.407394 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcnmg\" (UniqueName: \"kubernetes.io/projected/3da1f215-db34-4a63-b609-990e0595b748-kube-api-access-qcnmg\") pod \"3da1f215-db34-4a63-b609-990e0595b748\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " Sep 11 08:02:45.407688 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.407420 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3da1f215-db34-4a63-b609-990e0595b748-config-out\") pod \"3da1f215-db34-4a63-b609-990e0595b748\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " Sep 11 08:02:45.407688 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.407442 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy-web\") pod \"3da1f215-db34-4a63-b609-990e0595b748\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " Sep 11 08:02:45.407688 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.407469 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-web-config\") pod \"3da1f215-db34-4a63-b609-990e0595b748\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " Sep 11 08:02:45.407688 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.407507 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3da1f215-db34-4a63-b609-990e0595b748-alertmanager-main-db\") pod \"3da1f215-db34-4a63-b609-990e0595b748\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " Sep 11 08:02:45.407688 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.407552 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3da1f215-db34-4a63-b609-990e0595b748-tls-assets\") pod \"3da1f215-db34-4a63-b609-990e0595b748\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " Sep 11 08:02:45.407688 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.407579 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-main-tls\") pod \"3da1f215-db34-4a63-b609-990e0595b748\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " Sep 11 08:02:45.407688 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.407601 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy\") pod \"3da1f215-db34-4a63-b609-990e0595b748\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " Sep 11 08:02:45.407688 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.407641 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-cluster-tls-config\") pod \"3da1f215-db34-4a63-b609-990e0595b748\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " Sep 11 08:02:45.407688 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.407670 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3da1f215-db34-4a63-b609-990e0595b748\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " Sep 11 08:02:45.408310 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.407712 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3da1f215-db34-4a63-b609-990e0595b748-metrics-client-ca\") pod \"3da1f215-db34-4a63-b609-990e0595b748\" (UID: \"3da1f215-db34-4a63-b609-990e0595b748\") " Sep 11 08:02:45.408310 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.407813 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3da1f215-db34-4a63-b609-990e0595b748-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3da1f215-db34-4a63-b609-990e0595b748" (UID: "3da1f215-db34-4a63-b609-990e0595b748"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 08:02:45.408414 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.408310 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da1f215-db34-4a63-b609-990e0595b748-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3da1f215-db34-4a63-b609-990e0595b748" (UID: "3da1f215-db34-4a63-b609-990e0595b748"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 08:02:45.408414 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.408007 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da1f215-db34-4a63-b609-990e0595b748-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:02:45.409024 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.408993 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3da1f215-db34-4a63-b609-990e0595b748-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3da1f215-db34-4a63-b609-990e0595b748" (UID: "3da1f215-db34-4a63-b609-990e0595b748"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 08:02:45.410575 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.410530 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da1f215-db34-4a63-b609-990e0595b748-config-out" (OuterVolumeSpecName: "config-out") pod "3da1f215-db34-4a63-b609-990e0595b748" (UID: "3da1f215-db34-4a63-b609-990e0595b748"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 08:02:45.410743 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.410649 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-config-volume" (OuterVolumeSpecName: "config-volume") pod "3da1f215-db34-4a63-b609-990e0595b748" (UID: "3da1f215-db34-4a63-b609-990e0595b748"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:02:45.411458 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.411427 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3da1f215-db34-4a63-b609-990e0595b748-kube-api-access-qcnmg" (OuterVolumeSpecName: "kube-api-access-qcnmg") pod "3da1f215-db34-4a63-b609-990e0595b748" (UID: "3da1f215-db34-4a63-b609-990e0595b748"). InnerVolumeSpecName "kube-api-access-qcnmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:02:45.411888 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.411854 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3da1f215-db34-4a63-b609-990e0595b748" (UID: "3da1f215-db34-4a63-b609-990e0595b748"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:02:45.412273 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.412234 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3da1f215-db34-4a63-b609-990e0595b748" (UID: "3da1f215-db34-4a63-b609-990e0595b748"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:02:45.412496 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.412444 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3da1f215-db34-4a63-b609-990e0595b748" (UID: "3da1f215-db34-4a63-b609-990e0595b748"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:02:45.412496 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.412466 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3da1f215-db34-4a63-b609-990e0595b748" (UID: "3da1f215-db34-4a63-b609-990e0595b748"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:02:45.412621 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.412506 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3da1f215-db34-4a63-b609-990e0595b748-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3da1f215-db34-4a63-b609-990e0595b748" (UID: "3da1f215-db34-4a63-b609-990e0595b748"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:02:45.415994 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.415968 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3da1f215-db34-4a63-b609-990e0595b748" (UID: "3da1f215-db34-4a63-b609-990e0595b748"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:02:45.422345 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.422323 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-web-config" (OuterVolumeSpecName: "web-config") pod "3da1f215-db34-4a63-b609-990e0595b748" (UID: "3da1f215-db34-4a63-b609-990e0595b748"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:02:45.509544 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.509507 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:02:45.509544 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.509535 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3da1f215-db34-4a63-b609-990e0595b748-metrics-client-ca\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:02:45.509544 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.509546 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-config-volume\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:02:45.509544 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.509554 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcnmg\" (UniqueName: \"kubernetes.io/projected/3da1f215-db34-4a63-b609-990e0595b748-kube-api-access-qcnmg\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:02:45.509805 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.509562 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3da1f215-db34-4a63-b609-990e0595b748-config-out\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:02:45.509805 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.509572 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:02:45.509805 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.509581 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-web-config\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:02:45.509805 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.509588 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3da1f215-db34-4a63-b609-990e0595b748-alertmanager-main-db\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:02:45.509805 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.509596 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3da1f215-db34-4a63-b609-990e0595b748-tls-assets\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:02:45.509805 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.509604 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-main-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:02:45.509805 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.509613 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:02:45.509805 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.509622 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3da1f215-db34-4a63-b609-990e0595b748-cluster-tls-config\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:02:45.809311 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.809281 2566 generic.go:356] "Generic (PLEG): container finished" podID="3da1f215-db34-4a63-b609-990e0595b748" containerID="f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327" exitCode=0 Sep 11 08:02:45.809311 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.809309 2566 generic.go:356] "Generic (PLEG): container finished" podID="3da1f215-db34-4a63-b609-990e0595b748" containerID="05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67" exitCode=0 Sep 11 08:02:45.809537 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.809368 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:45.809537 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.809359 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3da1f215-db34-4a63-b609-990e0595b748","Type":"ContainerDied","Data":"f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327"} Sep 11 08:02:45.809537 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.809447 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3da1f215-db34-4a63-b609-990e0595b748","Type":"ContainerDied","Data":"05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67"} Sep 11 08:02:45.809537 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.809486 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3da1f215-db34-4a63-b609-990e0595b748","Type":"ContainerDied","Data":"9ed376b4a290dae2b1d61cbdc94107d97aa3613292f667232cc191aa13aa82bb"} Sep 11 08:02:45.809537 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.809519 2566 scope.go:117] "RemoveContainer" containerID="9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6" Sep 11 08:02:45.823482 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.823444 2566 scope.go:117] "RemoveContainer" containerID="f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327" Sep 11 08:02:45.831224 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.831207 2566 scope.go:117] "RemoveContainer" containerID="67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51" Sep 11 08:02:45.835508 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.835485 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:02:45.838684 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.838665 2566 scope.go:117] "RemoveContainer" containerID="05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67" Sep 11 08:02:45.846256 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.846148 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:02:45.846309 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.846286 2566 scope.go:117] "RemoveContainer" containerID="543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5" Sep 11 08:02:45.853262 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.853247 2566 scope.go:117] "RemoveContainer" containerID="73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a" Sep 11 08:02:45.860320 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.860298 2566 scope.go:117] "RemoveContainer" containerID="5838bc3e87f6aa149b9c4fee11f6fd85f898bd061e3e9fa10cf209a12fa76b03" Sep 11 08:02:45.867143 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.867128 2566 scope.go:117] "RemoveContainer" containerID="9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6" Sep 11 08:02:45.867409 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:02:45.867387 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6\": container with ID starting with 9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6 not found: ID does not exist" containerID="9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6" Sep 11 08:02:45.867454 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.867417 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6"} err="failed to get container status \"9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6\": rpc error: code = NotFound desc = could not find container \"9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6\": container with ID starting with 9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6 not found: ID does not exist" Sep 11 08:02:45.867454 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.867434 2566 scope.go:117] "RemoveContainer" containerID="f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327" Sep 11 08:02:45.867707 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:02:45.867688 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327\": container with ID starting with f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327 not found: ID does not exist" containerID="f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327" Sep 11 08:02:45.867750 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.867712 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327"} err="failed to get container status \"f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327\": rpc error: code = NotFound desc = could not find container \"f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327\": container with ID starting with f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327 not found: ID does not exist" Sep 11 08:02:45.867750 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.867727 2566 scope.go:117] "RemoveContainer" containerID="67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51" Sep 11 08:02:45.867931 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:02:45.867916 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51\": container with ID starting with 67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51 not found: ID does not exist" containerID="67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51" Sep 11 08:02:45.867998 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.867952 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51"} err="failed to get container status \"67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51\": rpc error: code = NotFound desc = could not find container \"67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51\": container with ID starting with 67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51 not found: ID does not exist" Sep 11 08:02:45.867998 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.867966 2566 scope.go:117] "RemoveContainer" containerID="05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67" Sep 11 08:02:45.868214 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:02:45.868198 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67\": container with ID starting with 05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67 not found: ID does not exist" containerID="05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67" Sep 11 08:02:45.868272 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.868222 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67"} err="failed to get container status \"05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67\": rpc error: code = NotFound desc = could not find container \"05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67\": container with ID starting with 05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67 not found: ID does not exist" Sep 11 08:02:45.868272 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.868242 2566 scope.go:117] "RemoveContainer" containerID="543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5" Sep 11 08:02:45.868483 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:02:45.868468 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5\": container with ID starting with 543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5 not found: ID does not exist" containerID="543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5" Sep 11 08:02:45.868522 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.868487 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5"} err="failed to get container status \"543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5\": rpc error: code = NotFound desc = could not find container \"543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5\": container with ID starting with 543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5 not found: ID does not exist" Sep 11 08:02:45.868522 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.868500 2566 scope.go:117] "RemoveContainer" containerID="73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a" Sep 11 08:02:45.868685 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:02:45.868666 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a\": container with ID starting with 73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a not found: ID does not exist" containerID="73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a" Sep 11 08:02:45.868722 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.868690 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a"} err="failed to get container status \"73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a\": rpc error: code = NotFound desc = could not find container \"73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a\": container with ID starting with 73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a not found: ID does not exist" Sep 11 08:02:45.868722 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.868702 2566 scope.go:117] "RemoveContainer" containerID="5838bc3e87f6aa149b9c4fee11f6fd85f898bd061e3e9fa10cf209a12fa76b03" Sep 11 08:02:45.868904 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:02:45.868889 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5838bc3e87f6aa149b9c4fee11f6fd85f898bd061e3e9fa10cf209a12fa76b03\": container with ID starting with 5838bc3e87f6aa149b9c4fee11f6fd85f898bd061e3e9fa10cf209a12fa76b03 not found: ID does not exist" containerID="5838bc3e87f6aa149b9c4fee11f6fd85f898bd061e3e9fa10cf209a12fa76b03" Sep 11 08:02:45.869013 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.868912 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5838bc3e87f6aa149b9c4fee11f6fd85f898bd061e3e9fa10cf209a12fa76b03"} err="failed to get container status \"5838bc3e87f6aa149b9c4fee11f6fd85f898bd061e3e9fa10cf209a12fa76b03\": rpc error: code = NotFound desc = could not find container \"5838bc3e87f6aa149b9c4fee11f6fd85f898bd061e3e9fa10cf209a12fa76b03\": container with ID starting with 5838bc3e87f6aa149b9c4fee11f6fd85f898bd061e3e9fa10cf209a12fa76b03 not found: ID does not exist" Sep 11 08:02:45.869013 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.868930 2566 scope.go:117] "RemoveContainer" containerID="9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6" Sep 11 08:02:45.869242 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.869219 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6"} err="failed to get container status \"9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6\": rpc error: code = NotFound desc = could not find container \"9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6\": container with ID starting with 9d6964113d1e1fb2ae1b4baff03eb8786e7c27ca908a9b73389e172f8f0607d6 not found: ID does not exist" Sep 11 08:02:45.869242 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.869236 2566 scope.go:117] "RemoveContainer" containerID="f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327" Sep 11 08:02:45.869458 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.869443 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327"} err="failed to get container status \"f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327\": rpc error: code = NotFound desc = could not find container \"f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327\": container with ID starting with f9436eb37434488d7860a1c25f361c8bd2bd83f6f2c0ce46c71940efe5e60327 not found: ID does not exist" Sep 11 08:02:45.869458 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.869458 2566 scope.go:117] "RemoveContainer" containerID="67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51" Sep 11 08:02:45.869755 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.869692 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51"} err="failed to get container status \"67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51\": rpc error: code = NotFound desc = could not find container \"67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51\": container with ID starting with 67d0b9a1bc0962312e08c97f60396413dd36dd8718e58ae3c9a960b22543fa51 not found: ID does not exist" Sep 11 08:02:45.869755 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.869712 2566 scope.go:117] "RemoveContainer" containerID="05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67" Sep 11 08:02:45.870064 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.870038 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67"} err="failed to get container status \"05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67\": rpc error: code = NotFound desc = could not find container \"05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67\": container with ID starting with 05e6c3ec12df22be36da64c33115a2ecda0aaa718335e3c23cdf3ed649768a67 not found: ID does not exist" Sep 11 08:02:45.870064 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.870063 2566 scope.go:117] "RemoveContainer" containerID="543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5" Sep 11 08:02:45.870355 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.870336 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5"} err="failed to get container status \"543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5\": rpc error: code = NotFound desc = could not find container \"543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5\": container with ID starting with 543d880b8a0147c7dabbdbda43034c419f66ba5a345ebeedbcb953c86db654d5 not found: ID does not exist" Sep 11 08:02:45.870355 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.870353 2566 scope.go:117] "RemoveContainer" containerID="73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a" Sep 11 08:02:45.870594 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.870574 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a"} err="failed to get container status \"73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a\": rpc error: code = NotFound desc = could not find container \"73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a\": container with ID starting with 73d7f98ca8f4204e1e08a5fffaccfedd04fc386edfbb85fdf4a8d0ade51bd99a not found: ID does not exist" Sep 11 08:02:45.870638 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.870597 2566 scope.go:117] "RemoveContainer" containerID="5838bc3e87f6aa149b9c4fee11f6fd85f898bd061e3e9fa10cf209a12fa76b03" Sep 11 08:02:45.870833 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.870813 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5838bc3e87f6aa149b9c4fee11f6fd85f898bd061e3e9fa10cf209a12fa76b03"} err="failed to get container status \"5838bc3e87f6aa149b9c4fee11f6fd85f898bd061e3e9fa10cf209a12fa76b03\": rpc error: code = NotFound desc = could not find container \"5838bc3e87f6aa149b9c4fee11f6fd85f898bd061e3e9fa10cf209a12fa76b03\": container with ID starting with 5838bc3e87f6aa149b9c4fee11f6fd85f898bd061e3e9fa10cf209a12fa76b03 not found: ID does not exist" Sep 11 08:02:45.880776 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.880756 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:02:45.881079 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881066 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="kube-rbac-proxy-web" Sep 11 08:02:45.881124 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881080 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="kube-rbac-proxy-web" Sep 11 08:02:45.881124 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881091 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="init-config-reloader" Sep 11 08:02:45.881124 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881096 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="init-config-reloader" Sep 11 08:02:45.881124 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881110 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="kube-rbac-proxy" Sep 11 08:02:45.881124 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881118 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="kube-rbac-proxy" Sep 11 08:02:45.881257 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881130 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="config-reloader" Sep 11 08:02:45.881257 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881138 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="config-reloader" Sep 11 08:02:45.881257 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881143 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="prom-label-proxy" Sep 11 08:02:45.881257 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881149 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="prom-label-proxy" Sep 11 08:02:45.881257 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881155 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="alertmanager" Sep 11 08:02:45.881257 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881161 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="alertmanager" Sep 11 08:02:45.881257 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881169 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="kube-rbac-proxy-metric" Sep 11 08:02:45.881257 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881176 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="kube-rbac-proxy-metric" Sep 11 08:02:45.881257 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881184 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f0bed84-e3b8-46e7-a773-0d97903965c5" containerName="registry" Sep 11 08:02:45.881257 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881189 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f0bed84-e3b8-46e7-a773-0d97903965c5" containerName="registry" Sep 11 08:02:45.881257 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881252 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f0bed84-e3b8-46e7-a773-0d97903965c5" containerName="registry" Sep 11 08:02:45.881257 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881260 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="prom-label-proxy" Sep 11 08:02:45.881596 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881265 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="alertmanager" Sep 11 08:02:45.881596 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881272 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="kube-rbac-proxy-metric" Sep 11 08:02:45.881596 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881277 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="kube-rbac-proxy" Sep 11 08:02:45.881596 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881281 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="kube-rbac-proxy-web" Sep 11 08:02:45.881596 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.881286 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3da1f215-db34-4a63-b609-990e0595b748" containerName="config-reloader" Sep 11 08:02:45.884232 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.884218 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:45.887073 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.887055 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 11 08:02:45.887196 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.887055 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 11 08:02:45.887258 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.887248 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 11 08:02:45.887304 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.887277 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 11 08:02:45.887607 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.887591 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 11 08:02:45.887674 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.887651 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 11 08:02:45.887869 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.887853 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lppns\"" Sep 11 08:02:45.888111 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.888096 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 11 08:02:45.888253 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.888238 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 11 08:02:45.894656 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.894634 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 11 08:02:45.906502 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:45.906476 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:02:46.013492 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.013448 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8480ca0d-41f3-45a3-8c90-9c721d235206-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.013691 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.013505 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.013691 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.013530 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64rwb\" (UniqueName: \"kubernetes.io/projected/8480ca0d-41f3-45a3-8c90-9c721d235206-kube-api-access-64rwb\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.013691 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.013553 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-config-volume\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.013691 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.013574 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8480ca0d-41f3-45a3-8c90-9c721d235206-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.013691 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.013641 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8480ca0d-41f3-45a3-8c90-9c721d235206-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.013691 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.013672 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8480ca0d-41f3-45a3-8c90-9c721d235206-config-out\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.013923 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.013703 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.013923 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.013722 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8480ca0d-41f3-45a3-8c90-9c721d235206-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.013923 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.013757 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.013923 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.013782 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.013923 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.013795 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.013923 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.013808 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-web-config\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.114608 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.114521 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.114608 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.114556 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64rwb\" (UniqueName: \"kubernetes.io/projected/8480ca0d-41f3-45a3-8c90-9c721d235206-kube-api-access-64rwb\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.114608 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.114577 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-config-volume\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.114608 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.114602 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8480ca0d-41f3-45a3-8c90-9c721d235206-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.114975 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.114632 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8480ca0d-41f3-45a3-8c90-9c721d235206-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.114975 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.114659 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8480ca0d-41f3-45a3-8c90-9c721d235206-config-out\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.114975 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.114695 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.114975 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.114716 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8480ca0d-41f3-45a3-8c90-9c721d235206-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.114975 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.114744 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.114975 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.114782 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.114975 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.114807 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.114975 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.114827 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-web-config\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.114975 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.114889 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8480ca0d-41f3-45a3-8c90-9c721d235206-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.115397 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.115174 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8480ca0d-41f3-45a3-8c90-9c721d235206-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.115722 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.115620 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8480ca0d-41f3-45a3-8c90-9c721d235206-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.116318 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.116255 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8480ca0d-41f3-45a3-8c90-9c721d235206-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.117991 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.117970 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8480ca0d-41f3-45a3-8c90-9c721d235206-config-out\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.118213 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.118189 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.118336 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.118246 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8480ca0d-41f3-45a3-8c90-9c721d235206-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.118394 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.118329 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.118394 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.118379 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.118480 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.118406 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-config-volume\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.118629 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.118606 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.118838 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.118823 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-web-config\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.119323 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.119307 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8480ca0d-41f3-45a3-8c90-9c721d235206-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.124183 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.124164 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64rwb\" (UniqueName: \"kubernetes.io/projected/8480ca0d-41f3-45a3-8c90-9c721d235206-kube-api-access-64rwb\") pod \"alertmanager-main-0\" (UID: \"8480ca0d-41f3-45a3-8c90-9c721d235206\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.194145 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.194119 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:02:46.477287 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.477007 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:02:46.479570 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:02:46.479543 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8480ca0d_41f3_45a3_8c90_9c721d235206.slice/crio-311ca89cb97c54c689152b3d128889aed4def5381ef29ad4cf0812e3318952ee WatchSource:0}: Error finding container 311ca89cb97c54c689152b3d128889aed4def5381ef29ad4cf0812e3318952ee: Status 404 returned error can't find the container with id 311ca89cb97c54c689152b3d128889aed4def5381ef29ad4cf0812e3318952ee Sep 11 08:02:46.815362 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.815268 2566 generic.go:356] "Generic (PLEG): container finished" podID="8480ca0d-41f3-45a3-8c90-9c721d235206" containerID="b7d291984d8edfb3afbc9f2ca0edb2d5b36efc2f0ccf2a4ff56b381f1f9f5fee" exitCode=0 Sep 11 08:02:46.815531 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.815348 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8480ca0d-41f3-45a3-8c90-9c721d235206","Type":"ContainerDied","Data":"b7d291984d8edfb3afbc9f2ca0edb2d5b36efc2f0ccf2a4ff56b381f1f9f5fee"} Sep 11 08:02:46.815531 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:46.815430 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8480ca0d-41f3-45a3-8c90-9c721d235206","Type":"ContainerStarted","Data":"311ca89cb97c54c689152b3d128889aed4def5381ef29ad4cf0812e3318952ee"} Sep 11 08:02:47.791692 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:47.790152 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3da1f215-db34-4a63-b609-990e0595b748" path="/var/lib/kubelet/pods/3da1f215-db34-4a63-b609-990e0595b748/volumes" Sep 11 08:02:47.823715 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:47.823680 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8480ca0d-41f3-45a3-8c90-9c721d235206","Type":"ContainerStarted","Data":"39a3fe6d32e77642a76bad2f9e8229b3697be619b32bf655ad8224d704a3b560"} Sep 11 08:02:47.823877 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:47.823755 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8480ca0d-41f3-45a3-8c90-9c721d235206","Type":"ContainerStarted","Data":"1c3cbb749e42b1a2982be84a752f10b5ba2fff6be558a67c6ea3fc39e0a16dd3"} Sep 11 08:02:47.823877 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:47.823782 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8480ca0d-41f3-45a3-8c90-9c721d235206","Type":"ContainerStarted","Data":"d3224b5d83194f25b8e6c079bb6ab23b90dd66af8a1c4b7ff46f255ab96b8a47"} Sep 11 08:02:47.823877 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:47.823809 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8480ca0d-41f3-45a3-8c90-9c721d235206","Type":"ContainerStarted","Data":"cd2381d8d956cbbc8f272de70c0ee5815f85ba9ca80ccd90248b784a7e6b6992"} Sep 11 08:02:47.823877 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:47.823842 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8480ca0d-41f3-45a3-8c90-9c721d235206","Type":"ContainerStarted","Data":"5e50b0865a01f52bc9d02ac3915f01077de3a3fd9994c6753db685fb3bb089b9"} Sep 11 08:02:47.823877 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:47.823876 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8480ca0d-41f3-45a3-8c90-9c721d235206","Type":"ContainerStarted","Data":"196fef559b4f46b4bd30092aa2ae149491a9355ce33fea28abc5e9766cfbd530"} Sep 11 08:02:47.854962 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:47.854881 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.839387859 podStartE2EDuration="2.854865158s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.477299ms" isStatefulPod=false podCreationTimestamp="2026-09-11 08:02:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:02:47.853027782 +0000 UTC m=+196.546392888" watchObservedRunningTime="2026-09-11 08:02:47.854865158 +0000 UTC m=+196.548230263" Sep 11 08:02:48.062400 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.062320 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7688d866bc-87d2z"] Sep 11 08:02:48.065053 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.065032 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.067419 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.067375 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 11 08:02:48.067544 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.067419 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8d58b\"" Sep 11 08:02:48.067544 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.067436 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 11 08:02:48.067704 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.067689 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 11 08:02:48.067797 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.067759 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 11 08:02:48.068116 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.068101 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 11 08:02:48.073441 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.073418 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 11 08:02:48.078380 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.078356 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7688d866bc-87d2z"] Sep 11 08:02:48.131304 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.131268 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-serving-certs-ca-bundle\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.131472 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.131307 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.131472 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.131338 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-telemeter-client-tls\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.131472 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.131444 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-federate-client-tls\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.131568 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.131478 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-secret-telemeter-client\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.131568 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.131539 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g9c5\" (UniqueName: \"kubernetes.io/projected/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-kube-api-access-2g9c5\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.131568 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.131565 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-metrics-client-ca\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.131666 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.131582 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.232036 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.231996 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-metrics-client-ca\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.232036 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.232035 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.232298 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.232070 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-serving-certs-ca-bundle\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.232298 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.232088 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.232298 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.232111 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-telemeter-client-tls\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.232298 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.232152 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-federate-client-tls\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.232298 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.232170 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-secret-telemeter-client\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.232298 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.232192 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g9c5\" (UniqueName: \"kubernetes.io/projected/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-kube-api-access-2g9c5\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.232802 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.232776 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-metrics-client-ca\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.233273 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.233249 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.233273 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.233264 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-serving-certs-ca-bundle\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.234860 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.234836 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-federate-client-tls\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.234974 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.234882 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-telemeter-client-tls\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.235070 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.235053 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.235168 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.235148 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-secret-telemeter-client\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.241829 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.241806 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g9c5\" (UniqueName: \"kubernetes.io/projected/0447e0f9-6bfa-4195-ba3a-8fa394afc32d-kube-api-access-2g9c5\") pod \"telemeter-client-7688d866bc-87d2z\" (UID: \"0447e0f9-6bfa-4195-ba3a-8fa394afc32d\") " pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.375141 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.375057 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" Sep 11 08:02:48.659799 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.659770 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7688d866bc-87d2z"] Sep 11 08:02:48.662722 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:02:48.662696 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0447e0f9_6bfa_4195_ba3a_8fa394afc32d.slice/crio-5659444d310daad471f1d7ac415b0409deea1f21406a8dfbd661e02b9c2be626 WatchSource:0}: Error finding container 5659444d310daad471f1d7ac415b0409deea1f21406a8dfbd661e02b9c2be626: Status 404 returned error can't find the container with id 5659444d310daad471f1d7ac415b0409deea1f21406a8dfbd661e02b9c2be626 Sep 11 08:02:48.829588 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:48.829552 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" event={"ID":"0447e0f9-6bfa-4195-ba3a-8fa394afc32d","Type":"ContainerStarted","Data":"5659444d310daad471f1d7ac415b0409deea1f21406a8dfbd661e02b9c2be626"} Sep 11 08:02:50.839143 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:50.839105 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" event={"ID":"0447e0f9-6bfa-4195-ba3a-8fa394afc32d","Type":"ContainerStarted","Data":"9e445811f94516c8fd3a0751683fdf58c8e8f216ae4849dc03a43a383d38261e"} Sep 11 08:02:50.839543 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:50.839176 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" event={"ID":"0447e0f9-6bfa-4195-ba3a-8fa394afc32d","Type":"ContainerStarted","Data":"88f5552956e22f581685ef968fac494ee1bc2aabd24e54332c31d3dd19b6ccbd"} Sep 11 08:02:50.839543 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:50.839204 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" event={"ID":"0447e0f9-6bfa-4195-ba3a-8fa394afc32d","Type":"ContainerStarted","Data":"10dd7c37da0a28e3f35d94648fa256fc25fdc32975d8eaf0b2017b372424f887"} Sep 11 08:02:50.871270 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:02:50.871214 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7688d866bc-87d2z" podStartSLOduration=1.303921111 podStartE2EDuration="2.871198667s" totalImagesPullingTime="1.567277556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:02:50.870407319 +0000 UTC m=+199.563772436" watchObservedRunningTime="2026-09-11 08:02:50.871198667 +0000 UTC m=+199.564563772" Sep 11 08:04:31.733237 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:04:31.733037 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 08:04:31.747673 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:04:31.747646 2566 kubelet.go:1648] "Image garbage collection succeeded" Sep 11 08:04:31.747876 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:04:31.747803 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 08:06:54.314378 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.314301 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j"] Sep 11 08:06:54.317165 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.317144 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:54.319465 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.319411 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 11 08:06:54.319598 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.319490 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Sep 11 08:06:54.319598 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.319579 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 11 08:06:54.319598 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.319584 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 11 08:06:54.319763 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.319716 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 11 08:06:54.319763 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.319741 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 11 08:06:54.319858 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.319792 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 11 08:06:54.320090 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.320069 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-ssm2w\"" Sep 11 08:06:54.331981 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.331959 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j"] Sep 11 08:06:54.395962 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.395901 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-registry-tls\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:54.395962 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.395961 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/381a8a97-bf07-4c71-b8f9-6c032799348f-feast-data\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:54.396193 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.396001 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-online-tls\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:54.396193 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.396029 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glnx5\" (UniqueName: \"kubernetes.io/projected/381a8a97-bf07-4c71-b8f9-6c032799348f-kube-api-access-glnx5\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:54.396193 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.396155 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-offline-tls\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:54.396290 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.396197 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-ui-tls\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:54.497159 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.497121 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-registry-tls\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:54.497159 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.497159 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/381a8a97-bf07-4c71-b8f9-6c032799348f-feast-data\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:54.497401 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.497187 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-online-tls\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:54.497401 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.497231 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glnx5\" (UniqueName: \"kubernetes.io/projected/381a8a97-bf07-4c71-b8f9-6c032799348f-kube-api-access-glnx5\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:54.497401 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.497284 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-offline-tls\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:54.497401 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.497319 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-ui-tls\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:54.497586 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:06:54.497439 2566 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 11 08:06:54.497586 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:06:54.497497 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-ui-tls podName:381a8a97-bf07-4c71-b8f9-6c032799348f nodeName:}" failed. No retries permitted until 2026-09-11 08:06:54.997478715 +0000 UTC m=+443.690843813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-ui-tls") pod "feast-simple-feast-setup-5ddbd78447-7789j" (UID: "381a8a97-bf07-4c71-b8f9-6c032799348f") : secret "feast-simple-feast-setup-ui-tls" not found Sep 11 08:06:54.497699 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.497576 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/381a8a97-bf07-4c71-b8f9-6c032799348f-feast-data\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:54.499761 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.499742 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-offline-tls\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:54.499859 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.499777 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-registry-tls\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:54.499954 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.499921 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-online-tls\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:54.517317 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:54.517291 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glnx5\" (UniqueName: \"kubernetes.io/projected/381a8a97-bf07-4c71-b8f9-6c032799348f-kube-api-access-glnx5\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:55.000723 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:55.000677 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-ui-tls\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:55.003201 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:55.003178 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-ui-tls\") pod \"feast-simple-feast-setup-5ddbd78447-7789j\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:55.227143 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:55.227102 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:06:55.505537 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:55.505511 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j"] Sep 11 08:06:55.507694 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:06:55.507670 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod381a8a97_bf07_4c71_b8f9_6c032799348f.slice/crio-6e68dbe44b296cdd4aee7746b25ca2e15bc2db8cccf448482db08fb848c5c9a5 WatchSource:0}: Error finding container 6e68dbe44b296cdd4aee7746b25ca2e15bc2db8cccf448482db08fb848c5c9a5: Status 404 returned error can't find the container with id 6e68dbe44b296cdd4aee7746b25ca2e15bc2db8cccf448482db08fb848c5c9a5 Sep 11 08:06:55.509976 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:55.509922 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 08:06:55.811165 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:06:55.811130 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" event={"ID":"381a8a97-bf07-4c71-b8f9-6c032799348f","Type":"ContainerStarted","Data":"6e68dbe44b296cdd4aee7746b25ca2e15bc2db8cccf448482db08fb848c5c9a5"} Sep 11 08:07:21.929544 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:21.929506 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" event={"ID":"381a8a97-bf07-4c71-b8f9-6c032799348f","Type":"ContainerStarted","Data":"b9d3fb31493668683c84e1a0e7eb227f7ebdf0f64380a109dbfac603c1c972e1"} Sep 11 08:07:25.946516 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:25.946481 2566 generic.go:356] "Generic (PLEG): container finished" podID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerID="b9d3fb31493668683c84e1a0e7eb227f7ebdf0f64380a109dbfac603c1c972e1" exitCode=0 Sep 11 08:07:25.946901 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:25.946535 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" event={"ID":"381a8a97-bf07-4c71-b8f9-6c032799348f","Type":"ContainerDied","Data":"b9d3fb31493668683c84e1a0e7eb227f7ebdf0f64380a109dbfac603c1c972e1"} Sep 11 08:07:26.953129 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:26.953093 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" event={"ID":"381a8a97-bf07-4c71-b8f9-6c032799348f","Type":"ContainerStarted","Data":"e4aa1685d7ad196f04e5414eee0a3dfba7fcc39d336fc3bf79d9102bbe9c1b76"} Sep 11 08:07:31.978110 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:31.978074 2566 generic.go:356] "Generic (PLEG): container finished" podID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerID="e4aa1685d7ad196f04e5414eee0a3dfba7fcc39d336fc3bf79d9102bbe9c1b76" exitCode=0 Sep 11 08:07:31.978490 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:31.978143 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" event={"ID":"381a8a97-bf07-4c71-b8f9-6c032799348f","Type":"ContainerDied","Data":"e4aa1685d7ad196f04e5414eee0a3dfba7fcc39d336fc3bf79d9102bbe9c1b76"} Sep 11 08:07:31.984234 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:31.984213 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Sep 11 08:07:32.989136 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:32.989096 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" event={"ID":"381a8a97-bf07-4c71-b8f9-6c032799348f","Type":"ContainerStarted","Data":"4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0"} Sep 11 08:07:32.989607 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:32.989154 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" event={"ID":"381a8a97-bf07-4c71-b8f9-6c032799348f","Type":"ContainerStarted","Data":"dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4"} Sep 11 08:07:32.989607 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:32.989172 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" event={"ID":"381a8a97-bf07-4c71-b8f9-6c032799348f","Type":"ContainerStarted","Data":"7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b"} Sep 11 08:07:32.989607 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:32.989189 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" event={"ID":"381a8a97-bf07-4c71-b8f9-6c032799348f","Type":"ContainerStarted","Data":"1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e"} Sep 11 08:07:33.031353 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:33.031282 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podStartSLOduration=13.422704747 podStartE2EDuration="39.03125897s" totalImagesPullingTime="25.608554223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:07:33.028850689 +0000 UTC m=+481.722215796" watchObservedRunningTime="2026-09-11 08:07:33.03125897 +0000 UTC m=+481.724624076" Sep 11 08:07:34.228825 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:34.228232 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:07:34.228825 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:34.228294 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:07:34.228825 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:34.228313 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:07:34.228825 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:34.228436 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:07:34.230626 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:34.230588 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.23:6571: connect: connection refused" Sep 11 08:07:34.230744 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:34.230620 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Sep 11 08:07:34.230744 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:34.230645 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 11 08:07:34.230744 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:34.230734 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.23:8816: connect: connection refused" Sep 11 08:07:35.227892 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:35.227847 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:07:35.228131 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:35.227918 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:07:35.228131 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:35.227955 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:07:35.228131 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:35.227974 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:07:37.227877 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:37.227835 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.23:8816: connect: connection refused" Sep 11 08:07:37.228507 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:37.227861 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 11 08:07:37.228586 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:37.227931 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.23:6571: connect: connection refused" Sep 11 08:07:37.228586 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:37.228015 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Sep 11 08:07:40.228893 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:40.228864 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:07:40.229274 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:40.228993 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:07:40.229370 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:40.229343 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:07:40.229889 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:40.229869 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:07:40.230016 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:40.229916 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:07:40.230016 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:40.229969 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:07:40.234491 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:40.234466 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:07:41.036301 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:07:41.036270 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:08:42.691211 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:42.691127 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j"] Sep 11 08:08:42.691717 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:42.691391 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="registry" containerID="cri-o://1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e" gracePeriod=30 Sep 11 08:08:42.691717 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:42.691431 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="online" containerID="cri-o://7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b" gracePeriod=30 Sep 11 08:08:42.691717 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:42.691442 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="ui" containerID="cri-o://4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0" gracePeriod=30 Sep 11 08:08:42.691717 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:42.691465 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="offline" containerID="cri-o://dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4" gracePeriod=30 Sep 11 08:08:43.418825 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.418792 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8"] Sep 11 08:08:43.421717 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.421698 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:43.424508 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.424483 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-85c2x\"" Sep 11 08:08:43.466209 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.466174 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-online-tls\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:43.466209 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.466209 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-ui-tls\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:43.466460 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.466246 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-offline-tls\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:43.466460 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.466331 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/995e573c-9be6-4be7-b34b-334da2dcfacf-feast-data\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:43.466460 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.466388 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsjlf\" (UniqueName: \"kubernetes.io/projected/995e573c-9be6-4be7-b34b-334da2dcfacf-kube-api-access-gsjlf\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:43.466460 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.466435 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-registry-tls\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:43.497030 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.497000 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8"] Sep 11 08:08:43.567478 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.567447 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-ui-tls\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:43.567655 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.567490 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-offline-tls\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:43.567655 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.567516 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/995e573c-9be6-4be7-b34b-334da2dcfacf-feast-data\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:43.567725 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.567644 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsjlf\" (UniqueName: \"kubernetes.io/projected/995e573c-9be6-4be7-b34b-334da2dcfacf-kube-api-access-gsjlf\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:43.567725 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.567687 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-registry-tls\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:43.567811 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.567769 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-online-tls\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:43.567902 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.567881 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/995e573c-9be6-4be7-b34b-334da2dcfacf-feast-data\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:43.568004 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:08:43.567908 2566 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 11 08:08:43.568077 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:08:43.568045 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-online-tls podName:995e573c-9be6-4be7-b34b-334da2dcfacf nodeName:}" failed. No retries permitted until 2026-09-11 08:08:44.068018513 +0000 UTC m=+552.761383616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-online-tls") pod "feast-simple-feast-setup-5ddbd78447-h88b8" (UID: "995e573c-9be6-4be7-b34b-334da2dcfacf") : secret "feast-simple-feast-setup-online-tls" not found Sep 11 08:08:43.570062 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.570030 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-ui-tls\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:43.570181 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.570127 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-offline-tls\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:43.570260 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.570240 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-registry-tls\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:43.585810 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:43.585785 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsjlf\" (UniqueName: \"kubernetes.io/projected/995e573c-9be6-4be7-b34b-334da2dcfacf-kube-api-access-gsjlf\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:44.073458 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:44.073421 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-online-tls\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:44.075960 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:44.075922 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-online-tls\") pod \"feast-simple-feast-setup-5ddbd78447-h88b8\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:44.291005 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:44.290975 2566 generic.go:356] "Generic (PLEG): container finished" podID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerID="4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0" exitCode=0 Sep 11 08:08:44.291005 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:44.291000 2566 generic.go:356] "Generic (PLEG): container finished" podID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerID="7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b" exitCode=0 Sep 11 08:08:44.291206 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:44.291048 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" event={"ID":"381a8a97-bf07-4c71-b8f9-6c032799348f","Type":"ContainerDied","Data":"4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0"} Sep 11 08:08:44.291206 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:44.291089 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" event={"ID":"381a8a97-bf07-4c71-b8f9-6c032799348f","Type":"ContainerDied","Data":"7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b"} Sep 11 08:08:44.331290 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:44.331207 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:44.631638 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:44.631451 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8"] Sep 11 08:08:44.634237 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:08:44.634210 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod995e573c_9be6_4be7_b34b_334da2dcfacf.slice/crio-b3b00d00865e954fafa469e74160e021c19cbf84643ae992223214499b06db9d WatchSource:0}: Error finding container b3b00d00865e954fafa469e74160e021c19cbf84643ae992223214499b06db9d: Status 404 returned error can't find the container with id b3b00d00865e954fafa469e74160e021c19cbf84643ae992223214499b06db9d Sep 11 08:08:45.296997 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:45.296964 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" event={"ID":"995e573c-9be6-4be7-b34b-334da2dcfacf","Type":"ContainerStarted","Data":"f496ae02a638f607c0d8fb0f7c38a14f6a112b1b1934016dddbc6fc50e4f6314"} Sep 11 08:08:45.297457 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:45.297008 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" event={"ID":"995e573c-9be6-4be7-b34b-334da2dcfacf","Type":"ContainerStarted","Data":"b3b00d00865e954fafa469e74160e021c19cbf84643ae992223214499b06db9d"} Sep 11 08:08:50.230018 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:50.229970 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Sep 11 08:08:50.317658 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:50.317627 2566 generic.go:356] "Generic (PLEG): container finished" podID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerID="f496ae02a638f607c0d8fb0f7c38a14f6a112b1b1934016dddbc6fc50e4f6314" exitCode=0 Sep 11 08:08:50.317819 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:50.317698 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" event={"ID":"995e573c-9be6-4be7-b34b-334da2dcfacf","Type":"ContainerDied","Data":"f496ae02a638f607c0d8fb0f7c38a14f6a112b1b1934016dddbc6fc50e4f6314"} Sep 11 08:08:51.033740 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:51.033693 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 11 08:08:51.323620 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:51.323538 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" event={"ID":"995e573c-9be6-4be7-b34b-334da2dcfacf","Type":"ContainerStarted","Data":"3cbf3cbc1615a9499605256a0836ed2757c9da05e13c2e29d72273c84f2b9a13"} Sep 11 08:08:56.348757 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:56.348672 2566 generic.go:356] "Generic (PLEG): container finished" podID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerID="3cbf3cbc1615a9499605256a0836ed2757c9da05e13c2e29d72273c84f2b9a13" exitCode=0 Sep 11 08:08:56.348757 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:56.348710 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" event={"ID":"995e573c-9be6-4be7-b34b-334da2dcfacf","Type":"ContainerDied","Data":"3cbf3cbc1615a9499605256a0836ed2757c9da05e13c2e29d72273c84f2b9a13"} Sep 11 08:08:57.358790 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:57.358744 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" event={"ID":"995e573c-9be6-4be7-b34b-334da2dcfacf","Type":"ContainerStarted","Data":"2b421bb1c5b25309740917dc90b5639ff0fb53b8841d3f6c308fd4f5cf77c241"} Sep 11 08:08:57.359259 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:57.358815 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" event={"ID":"995e573c-9be6-4be7-b34b-334da2dcfacf","Type":"ContainerStarted","Data":"ed98bb154585e8ed15478b1137e0007eba50b36845ce2c4f99c5edecc2e714dd"} Sep 11 08:08:57.359259 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:57.358837 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" event={"ID":"995e573c-9be6-4be7-b34b-334da2dcfacf","Type":"ContainerStarted","Data":"f3263e885ec567b22ccf258569153c008dbe779018014e151392ee24a73d3574"} Sep 11 08:08:57.359259 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:57.358854 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" event={"ID":"995e573c-9be6-4be7-b34b-334da2dcfacf","Type":"ContainerStarted","Data":"a9188d9042f04e774d0ec80abc06729b44af84b259c8bd58b8677d3affbac650"} Sep 11 08:08:57.397531 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:57.397464 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podStartSLOduration=14.397440402 podStartE2EDuration="14.397440402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:08:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:08:57.396304843 +0000 UTC m=+566.089669975" watchObservedRunningTime="2026-09-11 08:08:57.397440402 +0000 UTC m=+566.090805509" Sep 11 08:08:59.332035 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:59.331922 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:59.332035 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:59.332014 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:59.332035 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:59.332042 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:59.332626 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:59.332059 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:08:59.334724 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:59.334529 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused" Sep 11 08:08:59.334724 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:59.334584 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.24:6571: connect: connection refused" Sep 11 08:08:59.334724 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:59.334590 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused" Sep 11 08:08:59.334724 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:08:59.334584 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.24:8816: connect: connection refused" Sep 11 08:09:00.230028 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:00.229981 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Sep 11 08:09:01.033528 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:01.033482 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 11 08:09:02.331740 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:02.331697 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.24:6571: connect: connection refused" Sep 11 08:09:02.332360 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:02.331697 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.24:8816: connect: connection refused" Sep 11 08:09:02.332575 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:02.331697 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused" Sep 11 08:09:02.332575 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:02.331882 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused" Sep 11 08:09:04.331493 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:04.331435 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:09:04.331493 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:04.331511 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:09:04.332006 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:04.331526 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:09:04.332006 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:04.331537 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:09:05.333255 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:05.333220 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:09:05.333625 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:05.333352 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:09:05.333625 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:05.333536 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:09:05.334111 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:05.334085 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:09:05.334257 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:05.334159 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:09:05.334367 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:05.334349 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:09:05.338268 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:05.338251 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:09:05.409167 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:05.409136 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:09:10.229533 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:10.229490 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Sep 11 08:09:10.230016 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:10.229650 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:09:11.033478 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:11.033431 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 11 08:09:11.033683 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:11.033581 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:09:13.331825 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.331800 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:09:13.333798 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.333779 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glnx5\" (UniqueName: \"kubernetes.io/projected/381a8a97-bf07-4c71-b8f9-6c032799348f-kube-api-access-glnx5\") pod \"381a8a97-bf07-4c71-b8f9-6c032799348f\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " Sep 11 08:09:13.333851 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.333837 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-registry-tls\") pod \"381a8a97-bf07-4c71-b8f9-6c032799348f\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " Sep 11 08:09:13.333894 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.333855 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/381a8a97-bf07-4c71-b8f9-6c032799348f-feast-data\") pod \"381a8a97-bf07-4c71-b8f9-6c032799348f\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " Sep 11 08:09:13.333894 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.333872 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-ui-tls\") pod \"381a8a97-bf07-4c71-b8f9-6c032799348f\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " Sep 11 08:09:13.333894 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.333888 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-online-tls\") pod \"381a8a97-bf07-4c71-b8f9-6c032799348f\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " Sep 11 08:09:13.334072 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.333906 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-offline-tls\") pod \"381a8a97-bf07-4c71-b8f9-6c032799348f\" (UID: \"381a8a97-bf07-4c71-b8f9-6c032799348f\") " Sep 11 08:09:13.334447 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.334419 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381a8a97-bf07-4c71-b8f9-6c032799348f-feast-data" (OuterVolumeSpecName: "feast-data") pod "381a8a97-bf07-4c71-b8f9-6c032799348f" (UID: "381a8a97-bf07-4c71-b8f9-6c032799348f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 08:09:13.336685 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.336657 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/381a8a97-bf07-4c71-b8f9-6c032799348f-kube-api-access-glnx5" (OuterVolumeSpecName: "kube-api-access-glnx5") pod "381a8a97-bf07-4c71-b8f9-6c032799348f" (UID: "381a8a97-bf07-4c71-b8f9-6c032799348f"). InnerVolumeSpecName "kube-api-access-glnx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:09:13.336907 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.336881 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "381a8a97-bf07-4c71-b8f9-6c032799348f" (UID: "381a8a97-bf07-4c71-b8f9-6c032799348f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:09:13.337043 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.336906 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-online-tls" (OuterVolumeSpecName: "online-tls") pod "381a8a97-bf07-4c71-b8f9-6c032799348f" (UID: "381a8a97-bf07-4c71-b8f9-6c032799348f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:09:13.337043 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.336925 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "381a8a97-bf07-4c71-b8f9-6c032799348f" (UID: "381a8a97-bf07-4c71-b8f9-6c032799348f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:09:13.337043 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.337024 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "381a8a97-bf07-4c71-b8f9-6c032799348f" (UID: "381a8a97-bf07-4c71-b8f9-6c032799348f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:09:13.435092 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.435056 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-online-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:09:13.435092 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.435084 2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-offline-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:09:13.435092 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.435093 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glnx5\" (UniqueName: \"kubernetes.io/projected/381a8a97-bf07-4c71-b8f9-6c032799348f-kube-api-access-glnx5\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:09:13.435092 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.435101 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-registry-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:09:13.435366 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.435109 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/381a8a97-bf07-4c71-b8f9-6c032799348f-feast-data\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:09:13.435366 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.435116 2566 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/381a8a97-bf07-4c71-b8f9-6c032799348f-ui-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:09:13.447661 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.447620 2566 generic.go:356] "Generic (PLEG): container finished" podID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerID="dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4" exitCode=137 Sep 11 08:09:13.447661 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.447654 2566 generic.go:356] "Generic (PLEG): container finished" podID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerID="1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e" exitCode=137 Sep 11 08:09:13.447826 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.447702 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" Sep 11 08:09:13.447826 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.447706 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" event={"ID":"381a8a97-bf07-4c71-b8f9-6c032799348f","Type":"ContainerDied","Data":"dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4"} Sep 11 08:09:13.447826 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.447754 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" event={"ID":"381a8a97-bf07-4c71-b8f9-6c032799348f","Type":"ContainerDied","Data":"1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e"} Sep 11 08:09:13.447826 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.447769 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j" event={"ID":"381a8a97-bf07-4c71-b8f9-6c032799348f","Type":"ContainerDied","Data":"6e68dbe44b296cdd4aee7746b25ca2e15bc2db8cccf448482db08fb848c5c9a5"} Sep 11 08:09:13.447826 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.447786 2566 scope.go:117] "RemoveContainer" containerID="4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0" Sep 11 08:09:13.456420 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.456401 2566 scope.go:117] "RemoveContainer" containerID="dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4" Sep 11 08:09:13.464273 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.464253 2566 scope.go:117] "RemoveContainer" containerID="7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b" Sep 11 08:09:13.471606 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.471581 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j"] Sep 11 08:09:13.472787 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.472767 2566 scope.go:117] "RemoveContainer" containerID="1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e" Sep 11 08:09:13.476580 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.476553 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5ddbd78447-7789j"] Sep 11 08:09:13.480815 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.480787 2566 scope.go:117] "RemoveContainer" containerID="e4aa1685d7ad196f04e5414eee0a3dfba7fcc39d336fc3bf79d9102bbe9c1b76" Sep 11 08:09:13.487983 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.487967 2566 scope.go:117] "RemoveContainer" containerID="b9d3fb31493668683c84e1a0e7eb227f7ebdf0f64380a109dbfac603c1c972e1" Sep 11 08:09:13.495037 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.495009 2566 scope.go:117] "RemoveContainer" containerID="4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0" Sep 11 08:09:13.495302 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:09:13.495285 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0\": container with ID starting with 4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0 not found: ID does not exist" containerID="4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0" Sep 11 08:09:13.495364 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.495311 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0"} err="failed to get container status \"4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0\": rpc error: code = NotFound desc = could not find container \"4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0\": container with ID starting with 4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0 not found: ID does not exist" Sep 11 08:09:13.495364 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.495330 2566 scope.go:117] "RemoveContainer" containerID="dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4" Sep 11 08:09:13.495578 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:09:13.495562 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4\": container with ID starting with dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4 not found: ID does not exist" containerID="dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4" Sep 11 08:09:13.495614 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.495585 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4"} err="failed to get container status \"dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4\": rpc error: code = NotFound desc = could not find container \"dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4\": container with ID starting with dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4 not found: ID does not exist" Sep 11 08:09:13.495614 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.495599 2566 scope.go:117] "RemoveContainer" containerID="7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b" Sep 11 08:09:13.495837 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:09:13.495822 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b\": container with ID starting with 7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b not found: ID does not exist" containerID="7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b" Sep 11 08:09:13.495879 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.495842 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b"} err="failed to get container status \"7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b\": rpc error: code = NotFound desc = could not find container \"7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b\": container with ID starting with 7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b not found: ID does not exist" Sep 11 08:09:13.495879 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.495855 2566 scope.go:117] "RemoveContainer" containerID="1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e" Sep 11 08:09:13.496128 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:09:13.496112 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e\": container with ID starting with 1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e not found: ID does not exist" containerID="1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e" Sep 11 08:09:13.496166 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.496131 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e"} err="failed to get container status \"1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e\": rpc error: code = NotFound desc = could not find container \"1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e\": container with ID starting with 1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e not found: ID does not exist" Sep 11 08:09:13.496166 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.496143 2566 scope.go:117] "RemoveContainer" containerID="e4aa1685d7ad196f04e5414eee0a3dfba7fcc39d336fc3bf79d9102bbe9c1b76" Sep 11 08:09:13.496393 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:09:13.496376 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4aa1685d7ad196f04e5414eee0a3dfba7fcc39d336fc3bf79d9102bbe9c1b76\": container with ID starting with e4aa1685d7ad196f04e5414eee0a3dfba7fcc39d336fc3bf79d9102bbe9c1b76 not found: ID does not exist" containerID="e4aa1685d7ad196f04e5414eee0a3dfba7fcc39d336fc3bf79d9102bbe9c1b76" Sep 11 08:09:13.496443 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.496405 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4aa1685d7ad196f04e5414eee0a3dfba7fcc39d336fc3bf79d9102bbe9c1b76"} err="failed to get container status \"e4aa1685d7ad196f04e5414eee0a3dfba7fcc39d336fc3bf79d9102bbe9c1b76\": rpc error: code = NotFound desc = could not find container \"e4aa1685d7ad196f04e5414eee0a3dfba7fcc39d336fc3bf79d9102bbe9c1b76\": container with ID starting with e4aa1685d7ad196f04e5414eee0a3dfba7fcc39d336fc3bf79d9102bbe9c1b76 not found: ID does not exist" Sep 11 08:09:13.496443 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.496418 2566 scope.go:117] "RemoveContainer" containerID="b9d3fb31493668683c84e1a0e7eb227f7ebdf0f64380a109dbfac603c1c972e1" Sep 11 08:09:13.496651 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:09:13.496635 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9d3fb31493668683c84e1a0e7eb227f7ebdf0f64380a109dbfac603c1c972e1\": container with ID starting with b9d3fb31493668683c84e1a0e7eb227f7ebdf0f64380a109dbfac603c1c972e1 not found: ID does not exist" containerID="b9d3fb31493668683c84e1a0e7eb227f7ebdf0f64380a109dbfac603c1c972e1" Sep 11 08:09:13.496691 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.496656 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9d3fb31493668683c84e1a0e7eb227f7ebdf0f64380a109dbfac603c1c972e1"} err="failed to get container status \"b9d3fb31493668683c84e1a0e7eb227f7ebdf0f64380a109dbfac603c1c972e1\": rpc error: code = NotFound desc = could not find container \"b9d3fb31493668683c84e1a0e7eb227f7ebdf0f64380a109dbfac603c1c972e1\": container with ID starting with b9d3fb31493668683c84e1a0e7eb227f7ebdf0f64380a109dbfac603c1c972e1 not found: ID does not exist" Sep 11 08:09:13.496691 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.496670 2566 scope.go:117] "RemoveContainer" containerID="4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0" Sep 11 08:09:13.496879 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.496863 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0"} err="failed to get container status \"4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0\": rpc error: code = NotFound desc = could not find container \"4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0\": container with ID starting with 4c5bb37d543ecab028fed74857b7662ded5bb19608176ffca1fe6a629ea6e0b0 not found: ID does not exist" Sep 11 08:09:13.496921 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.496878 2566 scope.go:117] "RemoveContainer" containerID="dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4" Sep 11 08:09:13.497120 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.497105 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4"} err="failed to get container status \"dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4\": rpc error: code = NotFound desc = could not find container \"dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4\": container with ID starting with dc2c0c227d684b0342876dc0f447856abc7de49553574b4569a3cddaea87e0f4 not found: ID does not exist" Sep 11 08:09:13.497191 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.497120 2566 scope.go:117] "RemoveContainer" containerID="7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b" Sep 11 08:09:13.497348 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.497331 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b"} err="failed to get container status \"7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b\": rpc error: code = NotFound desc = could not find container \"7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b\": container with ID starting with 7d56611af96e7d67e200e714e413c296c0e8437427be40e88eb8c79bb380930b not found: ID does not exist" Sep 11 08:09:13.497386 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.497349 2566 scope.go:117] "RemoveContainer" containerID="1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e" Sep 11 08:09:13.497609 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.497593 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e"} err="failed to get container status \"1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e\": rpc error: code = NotFound desc = could not find container \"1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e\": container with ID starting with 1b83a201dc389c4289bd0e9ded028478286a4304107153836be62fe89d02fc1e not found: ID does not exist" Sep 11 08:09:13.497645 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.497611 2566 scope.go:117] "RemoveContainer" containerID="e4aa1685d7ad196f04e5414eee0a3dfba7fcc39d336fc3bf79d9102bbe9c1b76" Sep 11 08:09:13.497849 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.497834 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4aa1685d7ad196f04e5414eee0a3dfba7fcc39d336fc3bf79d9102bbe9c1b76"} err="failed to get container status \"e4aa1685d7ad196f04e5414eee0a3dfba7fcc39d336fc3bf79d9102bbe9c1b76\": rpc error: code = NotFound desc = could not find container \"e4aa1685d7ad196f04e5414eee0a3dfba7fcc39d336fc3bf79d9102bbe9c1b76\": container with ID starting with e4aa1685d7ad196f04e5414eee0a3dfba7fcc39d336fc3bf79d9102bbe9c1b76 not found: ID does not exist" Sep 11 08:09:13.497900 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.497849 2566 scope.go:117] "RemoveContainer" containerID="b9d3fb31493668683c84e1a0e7eb227f7ebdf0f64380a109dbfac603c1c972e1" Sep 11 08:09:13.498077 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.498059 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9d3fb31493668683c84e1a0e7eb227f7ebdf0f64380a109dbfac603c1c972e1"} err="failed to get container status \"b9d3fb31493668683c84e1a0e7eb227f7ebdf0f64380a109dbfac603c1c972e1\": rpc error: code = NotFound desc = could not find container \"b9d3fb31493668683c84e1a0e7eb227f7ebdf0f64380a109dbfac603c1c972e1\": container with ID starting with b9d3fb31493668683c84e1a0e7eb227f7ebdf0f64380a109dbfac603c1c972e1 not found: ID does not exist" Sep 11 08:09:13.787159 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:13.787081 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" path="/var/lib/kubelet/pods/381a8a97-bf07-4c71-b8f9-6c032799348f/volumes" Sep 11 08:09:31.771601 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:31.771573 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 08:09:31.776053 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:09:31.776035 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 08:10:08.444947 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.444914 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r"] Sep 11 08:10:08.445454 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.445303 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="registry" Sep 11 08:10:08.445454 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.445321 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="registry" Sep 11 08:10:08.445454 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.445343 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="ui" Sep 11 08:10:08.445454 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.445351 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="ui" Sep 11 08:10:08.445454 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.445363 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="feast-apply" Sep 11 08:10:08.445454 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.445371 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="feast-apply" Sep 11 08:10:08.445454 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.445394 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="offline" Sep 11 08:10:08.445454 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.445402 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="offline" Sep 11 08:10:08.445454 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.445412 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="online" Sep 11 08:10:08.445454 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.445420 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="online" Sep 11 08:10:08.445454 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.445433 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="feast-init" Sep 11 08:10:08.445454 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.445441 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="feast-init" Sep 11 08:10:08.445811 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.445517 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="registry" Sep 11 08:10:08.445811 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.445525 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="offline" Sep 11 08:10:08.445811 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.445530 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="ui" Sep 11 08:10:08.445811 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.445538 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="381a8a97-bf07-4c71-b8f9-6c032799348f" containerName="online" Sep 11 08:10:08.448882 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.448864 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.454247 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.454223 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 11 08:10:08.454436 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.454356 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 11 08:10:08.454436 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.454362 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 11 08:10:08.454679 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.454447 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 11 08:10:08.454793 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.454757 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 11 08:10:08.454856 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.454817 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Sep 11 08:10:08.454952 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.454858 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 11 08:10:08.456420 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.456399 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-tbl49\"" Sep 11 08:10:08.467920 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.467894 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r"] Sep 11 08:10:08.586393 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.586359 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-offline-tls\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.586569 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.586412 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6jlh\" (UniqueName: \"kubernetes.io/projected/7981db82-6c8e-479e-b4bc-d94fc475ab08-kube-api-access-t6jlh\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.586569 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.586447 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7981db82-6c8e-479e-b4bc-d94fc475ab08-feast-data\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.586569 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.586486 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-ui-tls\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.586569 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.586516 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-online-tls\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.586569 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.586534 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7981db82-6c8e-479e-b4bc-d94fc475ab08-registry-tls\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.687418 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.687373 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-ui-tls\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.687610 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.687432 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-online-tls\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.687610 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.687454 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7981db82-6c8e-479e-b4bc-d94fc475ab08-registry-tls\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.687610 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.687550 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-offline-tls\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.687778 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.687613 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6jlh\" (UniqueName: \"kubernetes.io/projected/7981db82-6c8e-479e-b4bc-d94fc475ab08-kube-api-access-t6jlh\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.687778 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.687663 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7981db82-6c8e-479e-b4bc-d94fc475ab08-feast-data\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.688054 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.688017 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7981db82-6c8e-479e-b4bc-d94fc475ab08-feast-data\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.688298 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.688126 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7981db82-6c8e-479e-b4bc-d94fc475ab08-registry-tls\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.690165 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.690137 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-offline-tls\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.690269 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.690137 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-online-tls\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.690269 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.690198 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-ui-tls\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.698815 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.698769 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6jlh\" (UniqueName: \"kubernetes.io/projected/7981db82-6c8e-479e-b4bc-d94fc475ab08-kube-api-access-t6jlh\") pod \"feast-simple-feast-remote-setup-5f65d669dc-ktq7r\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:08.757854 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:08.757823 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:09.044983 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:09.044958 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r"] Sep 11 08:10:09.047130 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:10:09.047101 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7981db82_6c8e_479e_b4bc_d94fc475ab08.slice/crio-8ac7edda0e7b5ec0b54499afb40703d4d3bb8f595c7f2bb6bb710332f2fcf24f WatchSource:0}: Error finding container 8ac7edda0e7b5ec0b54499afb40703d4d3bb8f595c7f2bb6bb710332f2fcf24f: Status 404 returned error can't find the container with id 8ac7edda0e7b5ec0b54499afb40703d4d3bb8f595c7f2bb6bb710332f2fcf24f Sep 11 08:10:09.672105 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:09.672071 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" event={"ID":"7981db82-6c8e-479e-b4bc-d94fc475ab08","Type":"ContainerStarted","Data":"bc524c5b2eee65c38c9067d7fe5df04b357c54e366b30a36e8ca0d5a8ac0f4dd"} Sep 11 08:10:09.672105 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:09.672120 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" event={"ID":"7981db82-6c8e-479e-b4bc-d94fc475ab08","Type":"ContainerStarted","Data":"8ac7edda0e7b5ec0b54499afb40703d4d3bb8f595c7f2bb6bb710332f2fcf24f"} Sep 11 08:10:13.691674 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:13.691647 2566 generic.go:356] "Generic (PLEG): container finished" podID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerID="bc524c5b2eee65c38c9067d7fe5df04b357c54e366b30a36e8ca0d5a8ac0f4dd" exitCode=0 Sep 11 08:10:13.691976 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:13.691683 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" event={"ID":"7981db82-6c8e-479e-b4bc-d94fc475ab08","Type":"ContainerDied","Data":"bc524c5b2eee65c38c9067d7fe5df04b357c54e366b30a36e8ca0d5a8ac0f4dd"} Sep 11 08:10:14.697503 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:14.697472 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" event={"ID":"7981db82-6c8e-479e-b4bc-d94fc475ab08","Type":"ContainerStarted","Data":"b5e905c7b3e410fe48eda26f7e586d2720c4ee929867f1ffcba9df57be6f0464"} Sep 11 08:10:41.809822 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:41.809787 2566 generic.go:356] "Generic (PLEG): container finished" podID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerID="b5e905c7b3e410fe48eda26f7e586d2720c4ee929867f1ffcba9df57be6f0464" exitCode=0 Sep 11 08:10:41.810288 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:41.809842 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" event={"ID":"7981db82-6c8e-479e-b4bc-d94fc475ab08","Type":"ContainerDied","Data":"b5e905c7b3e410fe48eda26f7e586d2720c4ee929867f1ffcba9df57be6f0464"} Sep 11 08:10:41.812908 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:41.812884 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Sep 11 08:10:42.819202 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:42.819161 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" event={"ID":"7981db82-6c8e-479e-b4bc-d94fc475ab08","Type":"ContainerStarted","Data":"41a5b8766177ab312aed28387d51ed61eea32e6dcbdd3d508d8deb885344641c"} Sep 11 08:10:42.819685 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:42.819229 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" event={"ID":"7981db82-6c8e-479e-b4bc-d94fc475ab08","Type":"ContainerStarted","Data":"e093eb174ff017d7322ad18dc1b9cf052e23af6b3ecff492028829dfe6d0c6f5"} Sep 11 08:10:42.819685 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:42.819251 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" event={"ID":"7981db82-6c8e-479e-b4bc-d94fc475ab08","Type":"ContainerStarted","Data":"e3504d707b950117240af7b0f7a4e24aa9eca5c9563c4b13844e29b9eac26927"} Sep 11 08:10:42.846039 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:42.845964 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" podStartSLOduration=34.845921548 podStartE2EDuration="34.845921548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:10:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:10:42.843662384 +0000 UTC m=+671.537027510" watchObservedRunningTime="2026-09-11 08:10:42.845921548 +0000 UTC m=+671.539286655" Sep 11 08:10:44.758660 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:44.758623 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:44.759152 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:44.758759 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:44.759152 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:44.758789 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:44.760493 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:44.760467 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.25:8816: connect: connection refused" Sep 11 08:10:44.760608 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:44.760532 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Sep 11 08:10:44.760608 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:44.760466 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Sep 11 08:10:47.758478 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:47.758429 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Sep 11 08:10:47.758850 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:47.758441 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Sep 11 08:10:47.758850 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:47.758437 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.25:8816: connect: connection refused" Sep 11 08:10:48.758812 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:48.758768 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:48.759240 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:48.758890 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:48.759240 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:48.758951 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:50.759697 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:50.759668 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:50.760099 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:50.759798 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:50.760589 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:50.760539 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:50.760751 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:50.760733 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:50.785540 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:50.785510 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:10:50.886348 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:10:50.886315 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:11:52.738144 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:52.738113 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r"] Sep 11 08:11:52.738631 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:52.738340 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="online" containerID="cri-o://e3504d707b950117240af7b0f7a4e24aa9eca5c9563c4b13844e29b9eac26927" gracePeriod=30 Sep 11 08:11:52.738631 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:52.738453 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="ui" containerID="cri-o://41a5b8766177ab312aed28387d51ed61eea32e6dcbdd3d508d8deb885344641c" gracePeriod=30 Sep 11 08:11:52.738631 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:52.738454 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="offline" containerID="cri-o://e093eb174ff017d7322ad18dc1b9cf052e23af6b3ecff492028829dfe6d0c6f5" gracePeriod=30 Sep 11 08:11:52.825242 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:52.825208 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8"] Sep 11 08:11:52.825436 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:52.825415 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="registry" containerID="cri-o://a9188d9042f04e774d0ec80abc06729b44af84b259c8bd58b8677d3affbac650" gracePeriod=30 Sep 11 08:11:52.825516 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:52.825488 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="offline" containerID="cri-o://ed98bb154585e8ed15478b1137e0007eba50b36845ce2c4f99c5edecc2e714dd" gracePeriod=30 Sep 11 08:11:52.825565 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:52.825501 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="online" containerID="cri-o://f3263e885ec567b22ccf258569153c008dbe779018014e151392ee24a73d3574" gracePeriod=30 Sep 11 08:11:52.825620 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:52.825478 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="ui" containerID="cri-o://2b421bb1c5b25309740917dc90b5639ff0fb53b8841d3f6c308fd4f5cf77c241" gracePeriod=30 Sep 11 08:11:54.127626 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:54.127599 2566 generic.go:356] "Generic (PLEG): container finished" podID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerID="41a5b8766177ab312aed28387d51ed61eea32e6dcbdd3d508d8deb885344641c" exitCode=0 Sep 11 08:11:54.127626 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:54.127620 2566 generic.go:356] "Generic (PLEG): container finished" podID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerID="e3504d707b950117240af7b0f7a4e24aa9eca5c9563c4b13844e29b9eac26927" exitCode=0 Sep 11 08:11:54.128140 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:54.127673 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" event={"ID":"7981db82-6c8e-479e-b4bc-d94fc475ab08","Type":"ContainerDied","Data":"41a5b8766177ab312aed28387d51ed61eea32e6dcbdd3d508d8deb885344641c"} Sep 11 08:11:54.128140 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:54.127714 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" event={"ID":"7981db82-6c8e-479e-b4bc-d94fc475ab08","Type":"ContainerDied","Data":"e3504d707b950117240af7b0f7a4e24aa9eca5c9563c4b13844e29b9eac26927"} Sep 11 08:11:54.130517 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:54.130498 2566 generic.go:356] "Generic (PLEG): container finished" podID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerID="2b421bb1c5b25309740917dc90b5639ff0fb53b8841d3f6c308fd4f5cf77c241" exitCode=0 Sep 11 08:11:54.130517 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:54.130513 2566 generic.go:356] "Generic (PLEG): container finished" podID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerID="f3263e885ec567b22ccf258569153c008dbe779018014e151392ee24a73d3574" exitCode=0 Sep 11 08:11:54.130656 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:54.130540 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" event={"ID":"995e573c-9be6-4be7-b34b-334da2dcfacf","Type":"ContainerDied","Data":"2b421bb1c5b25309740917dc90b5639ff0fb53b8841d3f6c308fd4f5cf77c241"} Sep 11 08:11:54.130656 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:54.130563 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" event={"ID":"995e573c-9be6-4be7-b34b-334da2dcfacf","Type":"ContainerDied","Data":"f3263e885ec567b22ccf258569153c008dbe779018014e151392ee24a73d3574"} Sep 11 08:11:55.334140 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:55.334093 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused" Sep 11 08:11:55.406455 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:11:55.406416 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused" Sep 11 08:12:00.760823 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:00.760777 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Sep 11 08:12:00.860222 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:00.860182 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Sep 11 08:12:05.334543 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:05.334499 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused" Sep 11 08:12:05.406662 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:05.406625 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused" Sep 11 08:12:10.760883 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:10.760839 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Sep 11 08:12:10.860107 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:10.860071 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Sep 11 08:12:15.334098 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:15.334052 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused" Sep 11 08:12:15.334526 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:15.334193 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:12:15.406368 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:15.406334 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused" Sep 11 08:12:15.406526 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:15.406429 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:12:20.761284 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:20.761242 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Sep 11 08:12:20.761677 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:20.761375 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:12:20.860697 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:20.860656 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Sep 11 08:12:20.860883 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:20.860759 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:12:23.250240 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.250211 2566 generic.go:356] "Generic (PLEG): container finished" podID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerID="e093eb174ff017d7322ad18dc1b9cf052e23af6b3ecff492028829dfe6d0c6f5" exitCode=137 Sep 11 08:12:23.250715 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.250284 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" event={"ID":"7981db82-6c8e-479e-b4bc-d94fc475ab08","Type":"ContainerDied","Data":"e093eb174ff017d7322ad18dc1b9cf052e23af6b3ecff492028829dfe6d0c6f5"} Sep 11 08:12:23.253283 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.253260 2566 generic.go:356] "Generic (PLEG): container finished" podID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerID="ed98bb154585e8ed15478b1137e0007eba50b36845ce2c4f99c5edecc2e714dd" exitCode=137 Sep 11 08:12:23.253283 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.253279 2566 generic.go:356] "Generic (PLEG): container finished" podID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerID="a9188d9042f04e774d0ec80abc06729b44af84b259c8bd58b8677d3affbac650" exitCode=137 Sep 11 08:12:23.253425 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.253307 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" event={"ID":"995e573c-9be6-4be7-b34b-334da2dcfacf","Type":"ContainerDied","Data":"ed98bb154585e8ed15478b1137e0007eba50b36845ce2c4f99c5edecc2e714dd"} Sep 11 08:12:23.253425 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.253336 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" event={"ID":"995e573c-9be6-4be7-b34b-334da2dcfacf","Type":"ContainerDied","Data":"a9188d9042f04e774d0ec80abc06729b44af84b259c8bd58b8677d3affbac650"} Sep 11 08:12:23.386839 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.386815 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:12:23.469559 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.469533 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:12:23.538437 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.538364 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7981db82-6c8e-479e-b4bc-d94fc475ab08-registry-tls\") pod \"7981db82-6c8e-479e-b4bc-d94fc475ab08\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " Sep 11 08:12:23.538437 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.538396 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-offline-tls\") pod \"7981db82-6c8e-479e-b4bc-d94fc475ab08\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " Sep 11 08:12:23.538437 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.538429 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-online-tls\") pod \"7981db82-6c8e-479e-b4bc-d94fc475ab08\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " Sep 11 08:12:23.538709 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.538540 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6jlh\" (UniqueName: \"kubernetes.io/projected/7981db82-6c8e-479e-b4bc-d94fc475ab08-kube-api-access-t6jlh\") pod \"7981db82-6c8e-479e-b4bc-d94fc475ab08\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " Sep 11 08:12:23.538709 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.538597 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7981db82-6c8e-479e-b4bc-d94fc475ab08-feast-data\") pod \"7981db82-6c8e-479e-b4bc-d94fc475ab08\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " Sep 11 08:12:23.538709 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.538621 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-ui-tls\") pod \"7981db82-6c8e-479e-b4bc-d94fc475ab08\" (UID: \"7981db82-6c8e-479e-b4bc-d94fc475ab08\") " Sep 11 08:12:23.538850 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.538781 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7981db82-6c8e-479e-b4bc-d94fc475ab08-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7981db82-6c8e-479e-b4bc-d94fc475ab08" (UID: "7981db82-6c8e-479e-b4bc-d94fc475ab08"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 08:12:23.538932 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.538914 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7981db82-6c8e-479e-b4bc-d94fc475ab08-registry-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:12:23.539344 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.539307 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7981db82-6c8e-479e-b4bc-d94fc475ab08-feast-data" (OuterVolumeSpecName: "feast-data") pod "7981db82-6c8e-479e-b4bc-d94fc475ab08" (UID: "7981db82-6c8e-479e-b4bc-d94fc475ab08"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 08:12:23.540770 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.540727 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "7981db82-6c8e-479e-b4bc-d94fc475ab08" (UID: "7981db82-6c8e-479e-b4bc-d94fc475ab08"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:12:23.540874 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.540786 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-online-tls" (OuterVolumeSpecName: "online-tls") pod "7981db82-6c8e-479e-b4bc-d94fc475ab08" (UID: "7981db82-6c8e-479e-b4bc-d94fc475ab08"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:12:23.540874 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.540820 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "7981db82-6c8e-479e-b4bc-d94fc475ab08" (UID: "7981db82-6c8e-479e-b4bc-d94fc475ab08"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:12:23.540874 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.540827 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7981db82-6c8e-479e-b4bc-d94fc475ab08-kube-api-access-t6jlh" (OuterVolumeSpecName: "kube-api-access-t6jlh") pod "7981db82-6c8e-479e-b4bc-d94fc475ab08" (UID: "7981db82-6c8e-479e-b4bc-d94fc475ab08"). InnerVolumeSpecName "kube-api-access-t6jlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:12:23.640105 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.640073 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-online-tls\") pod \"995e573c-9be6-4be7-b34b-334da2dcfacf\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " Sep 11 08:12:23.640262 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.640121 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsjlf\" (UniqueName: \"kubernetes.io/projected/995e573c-9be6-4be7-b34b-334da2dcfacf-kube-api-access-gsjlf\") pod \"995e573c-9be6-4be7-b34b-334da2dcfacf\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " Sep 11 08:12:23.640262 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.640160 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-ui-tls\") pod \"995e573c-9be6-4be7-b34b-334da2dcfacf\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " Sep 11 08:12:23.640262 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.640176 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-offline-tls\") pod \"995e573c-9be6-4be7-b34b-334da2dcfacf\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " Sep 11 08:12:23.640262 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.640211 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/995e573c-9be6-4be7-b34b-334da2dcfacf-feast-data\") pod \"995e573c-9be6-4be7-b34b-334da2dcfacf\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " Sep 11 08:12:23.640262 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.640232 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-registry-tls\") pod \"995e573c-9be6-4be7-b34b-334da2dcfacf\" (UID: \"995e573c-9be6-4be7-b34b-334da2dcfacf\") " Sep 11 08:12:23.640532 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.640505 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6jlh\" (UniqueName: \"kubernetes.io/projected/7981db82-6c8e-479e-b4bc-d94fc475ab08-kube-api-access-t6jlh\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:12:23.640607 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.640535 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7981db82-6c8e-479e-b4bc-d94fc475ab08-feast-data\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:12:23.640607 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.640553 2566 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-ui-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:12:23.640607 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.640565 2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-offline-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:12:23.640607 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.640597 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7981db82-6c8e-479e-b4bc-d94fc475ab08-online-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:12:23.640978 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.640901 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995e573c-9be6-4be7-b34b-334da2dcfacf-feast-data" (OuterVolumeSpecName: "feast-data") pod "995e573c-9be6-4be7-b34b-334da2dcfacf" (UID: "995e573c-9be6-4be7-b34b-334da2dcfacf"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 08:12:23.642330 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.642301 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "995e573c-9be6-4be7-b34b-334da2dcfacf" (UID: "995e573c-9be6-4be7-b34b-334da2dcfacf"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:12:23.642432 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.642347 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "995e573c-9be6-4be7-b34b-334da2dcfacf" (UID: "995e573c-9be6-4be7-b34b-334da2dcfacf"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:12:23.642432 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.642366 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-online-tls" (OuterVolumeSpecName: "online-tls") pod "995e573c-9be6-4be7-b34b-334da2dcfacf" (UID: "995e573c-9be6-4be7-b34b-334da2dcfacf"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:12:23.642765 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.642748 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "995e573c-9be6-4be7-b34b-334da2dcfacf" (UID: "995e573c-9be6-4be7-b34b-334da2dcfacf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:12:23.642765 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.642754 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/995e573c-9be6-4be7-b34b-334da2dcfacf-kube-api-access-gsjlf" (OuterVolumeSpecName: "kube-api-access-gsjlf") pod "995e573c-9be6-4be7-b34b-334da2dcfacf" (UID: "995e573c-9be6-4be7-b34b-334da2dcfacf"). InnerVolumeSpecName "kube-api-access-gsjlf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:12:23.741602 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.741567 2566 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-ui-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:12:23.741602 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.741597 2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-offline-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:12:23.741602 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.741607 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/995e573c-9be6-4be7-b34b-334da2dcfacf-feast-data\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:12:23.741819 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.741616 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-registry-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:12:23.741819 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.741624 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/995e573c-9be6-4be7-b34b-334da2dcfacf-online-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:12:23.741819 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:23.741631 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsjlf\" (UniqueName: \"kubernetes.io/projected/995e573c-9be6-4be7-b34b-334da2dcfacf-kube-api-access-gsjlf\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:12:24.260057 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.260021 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" Sep 11 08:12:24.260529 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.260016 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r" event={"ID":"7981db82-6c8e-479e-b4bc-d94fc475ab08","Type":"ContainerDied","Data":"8ac7edda0e7b5ec0b54499afb40703d4d3bb8f595c7f2bb6bb710332f2fcf24f"} Sep 11 08:12:24.260529 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.260158 2566 scope.go:117] "RemoveContainer" containerID="41a5b8766177ab312aed28387d51ed61eea32e6dcbdd3d508d8deb885344641c" Sep 11 08:12:24.263421 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.263389 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" event={"ID":"995e573c-9be6-4be7-b34b-334da2dcfacf","Type":"ContainerDied","Data":"b3b00d00865e954fafa469e74160e021c19cbf84643ae992223214499b06db9d"} Sep 11 08:12:24.263512 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.263452 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8" Sep 11 08:12:24.269696 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.269680 2566 scope.go:117] "RemoveContainer" containerID="e093eb174ff017d7322ad18dc1b9cf052e23af6b3ecff492028829dfe6d0c6f5" Sep 11 08:12:24.277667 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.277650 2566 scope.go:117] "RemoveContainer" containerID="e3504d707b950117240af7b0f7a4e24aa9eca5c9563c4b13844e29b9eac26927" Sep 11 08:12:24.285101 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.285082 2566 scope.go:117] "RemoveContainer" containerID="b5e905c7b3e410fe48eda26f7e586d2720c4ee929867f1ffcba9df57be6f0464" Sep 11 08:12:24.286769 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.286748 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8"] Sep 11 08:12:24.289770 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.289747 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-5ddbd78447-h88b8"] Sep 11 08:12:24.292978 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.292962 2566 scope.go:117] "RemoveContainer" containerID="bc524c5b2eee65c38c9067d7fe5df04b357c54e366b30a36e8ca0d5a8ac0f4dd" Sep 11 08:12:24.301507 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.301488 2566 scope.go:117] "RemoveContainer" containerID="2b421bb1c5b25309740917dc90b5639ff0fb53b8841d3f6c308fd4f5cf77c241" Sep 11 08:12:24.304926 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.304907 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r"] Sep 11 08:12:24.309135 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.309116 2566 scope.go:117] "RemoveContainer" containerID="ed98bb154585e8ed15478b1137e0007eba50b36845ce2c4f99c5edecc2e714dd" Sep 11 08:12:24.315098 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.315078 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5f65d669dc-ktq7r"] Sep 11 08:12:24.317143 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.317131 2566 scope.go:117] "RemoveContainer" containerID="f3263e885ec567b22ccf258569153c008dbe779018014e151392ee24a73d3574" Sep 11 08:12:24.324294 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.324277 2566 scope.go:117] "RemoveContainer" containerID="a9188d9042f04e774d0ec80abc06729b44af84b259c8bd58b8677d3affbac650" Sep 11 08:12:24.331327 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.331306 2566 scope.go:117] "RemoveContainer" containerID="3cbf3cbc1615a9499605256a0836ed2757c9da05e13c2e29d72273c84f2b9a13" Sep 11 08:12:24.337933 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:24.337917 2566 scope.go:117] "RemoveContainer" containerID="f496ae02a638f607c0d8fb0f7c38a14f6a112b1b1934016dddbc6fc50e4f6314" Sep 11 08:12:25.786917 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:25.786887 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" path="/var/lib/kubelet/pods/7981db82-6c8e-479e-b4bc-d94fc475ab08/volumes" Sep 11 08:12:25.787432 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:25.787418 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" path="/var/lib/kubelet/pods/995e573c-9be6-4be7-b34b-334da2dcfacf/volumes" Sep 11 08:12:36.041458 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041429 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-q7k24"] Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041724 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="ui" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041735 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="ui" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041744 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="online" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041749 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="online" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041759 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="ui" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041764 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="ui" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041773 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="registry" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041778 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="registry" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041786 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="feast-init" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041792 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="feast-init" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041797 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="feast-apply" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041802 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="feast-apply" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041809 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="feast-apply" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041814 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="feast-apply" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041825 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="offline" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041829 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="offline" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041836 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="online" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041841 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="online" Sep 11 08:12:36.041845 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041852 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="feast-init" Sep 11 08:12:36.042470 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041857 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="feast-init" Sep 11 08:12:36.042470 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041863 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="offline" Sep 11 08:12:36.042470 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041868 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="offline" Sep 11 08:12:36.042470 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041910 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="registry" Sep 11 08:12:36.042470 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041917 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="offline" Sep 11 08:12:36.042470 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041923 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="ui" Sep 11 08:12:36.042470 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041928 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="online" Sep 11 08:12:36.042470 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041952 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="online" Sep 11 08:12:36.042470 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041959 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="995e573c-9be6-4be7-b34b-334da2dcfacf" containerName="offline" Sep 11 08:12:36.042470 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.041964 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7981db82-6c8e-479e-b4bc-d94fc475ab08" containerName="ui" Sep 11 08:12:36.046750 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.046720 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-q7k24" Sep 11 08:12:36.050899 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.050876 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-7wv2k\"" Sep 11 08:12:36.051259 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.051236 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 11 08:12:36.051448 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.050901 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 11 08:12:36.056053 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.056031 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-q7k24"] Sep 11 08:12:36.147659 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.147625 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnqjg\" (UniqueName: \"kubernetes.io/projected/0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c-kube-api-access-bnqjg\") pod \"redis-69bbd798b6-q7k24\" (UID: \"0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c\") " pod="test-ns-feast/redis-69bbd798b6-q7k24" Sep 11 08:12:36.248505 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.248471 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnqjg\" (UniqueName: \"kubernetes.io/projected/0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c-kube-api-access-bnqjg\") pod \"redis-69bbd798b6-q7k24\" (UID: \"0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c\") " pod="test-ns-feast/redis-69bbd798b6-q7k24" Sep 11 08:12:36.259876 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.259852 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnqjg\" (UniqueName: \"kubernetes.io/projected/0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c-kube-api-access-bnqjg\") pod \"redis-69bbd798b6-q7k24\" (UID: \"0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c\") " pod="test-ns-feast/redis-69bbd798b6-q7k24" Sep 11 08:12:36.361494 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.361408 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-q7k24" Sep 11 08:12:36.630396 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.630313 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-q7k24"] Sep 11 08:12:36.633237 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:12:36.633213 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b9fd3e1_a383_46ab_b1b6_9e9f570cb32c.slice/crio-7991cee41a2313dc94d0c1eb305d22d23bfb6fb32fae77a89889629e60ca1f22 WatchSource:0}: Error finding container 7991cee41a2313dc94d0c1eb305d22d23bfb6fb32fae77a89889629e60ca1f22: Status 404 returned error can't find the container with id 7991cee41a2313dc94d0c1eb305d22d23bfb6fb32fae77a89889629e60ca1f22 Sep 11 08:12:36.635478 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:36.635458 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 08:12:37.316460 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:37.316428 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-q7k24" event={"ID":"0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c","Type":"ContainerStarted","Data":"7991cee41a2313dc94d0c1eb305d22d23bfb6fb32fae77a89889629e60ca1f22"} Sep 11 08:12:39.328197 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:39.328166 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-q7k24" event={"ID":"0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c","Type":"ContainerStarted","Data":"94d35f80e734956b3f0747ca5b1c6ef90aeb05423be14dcaeb4e143dddbc5205"} Sep 11 08:12:39.348689 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:39.348642 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-q7k24" podStartSLOduration=1.672585797 podStartE2EDuration="3.348627395s" totalImagesPullingTime="1.676041598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:12:39.346282507 +0000 UTC m=+788.039647625" watchObservedRunningTime="2026-09-11 08:12:39.348627395 +0000 UTC m=+788.041992500" Sep 11 08:12:46.888178 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:46.888143 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw"] Sep 11 08:12:46.892040 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:46.892013 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:46.894161 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:46.894132 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\"" Sep 11 08:12:46.894331 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:46.894159 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\"" Sep 11 08:12:46.894331 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:46.894168 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 11 08:12:46.894331 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:46.894206 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-89jq8\"" Sep 11 08:12:46.894331 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:46.894216 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Sep 11 08:12:46.894331 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:46.894219 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\"" Sep 11 08:12:46.904387 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:46.904363 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw"] Sep 11 08:12:46.941089 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:46.941061 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-offline-tls\") pod \"feast-credit-scoring-79c4df66f8-f82mw\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:46.941089 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:46.941090 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-online-tls\") pod \"feast-credit-scoring-79c4df66f8-f82mw\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:46.941256 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:46.941130 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-registry-tls\") pod \"feast-credit-scoring-79c4df66f8-f82mw\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:46.941256 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:46.941153 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shcdr\" (UniqueName: \"kubernetes.io/projected/b71fe0b6-28c6-408d-ade9-7335c8ac177e-kube-api-access-shcdr\") pod \"feast-credit-scoring-79c4df66f8-f82mw\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:46.941256 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:46.941178 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b71fe0b6-28c6-408d-ade9-7335c8ac177e-feast-data\") pod \"feast-credit-scoring-79c4df66f8-f82mw\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:47.041957 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:47.041904 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-offline-tls\") pod \"feast-credit-scoring-79c4df66f8-f82mw\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:47.041957 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:47.041956 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-online-tls\") pod \"feast-credit-scoring-79c4df66f8-f82mw\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:47.042147 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:47.041986 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-registry-tls\") pod \"feast-credit-scoring-79c4df66f8-f82mw\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:47.042147 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:47.042002 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shcdr\" (UniqueName: \"kubernetes.io/projected/b71fe0b6-28c6-408d-ade9-7335c8ac177e-kube-api-access-shcdr\") pod \"feast-credit-scoring-79c4df66f8-f82mw\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:47.042147 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:47.042026 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b71fe0b6-28c6-408d-ade9-7335c8ac177e-feast-data\") pod \"feast-credit-scoring-79c4df66f8-f82mw\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:47.042147 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:12:47.042065 2566 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-offline-tls: secret "feast-credit-scoring-offline-tls" not found Sep 11 08:12:47.042147 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:12:47.042135 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-offline-tls podName:b71fe0b6-28c6-408d-ade9-7335c8ac177e nodeName:}" failed. No retries permitted until 2026-09-11 08:12:47.542115809 +0000 UTC m=+796.235480895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-offline-tls") pod "feast-credit-scoring-79c4df66f8-f82mw" (UID: "b71fe0b6-28c6-408d-ade9-7335c8ac177e") : secret "feast-credit-scoring-offline-tls" not found Sep 11 08:12:47.042501 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:47.042484 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b71fe0b6-28c6-408d-ade9-7335c8ac177e-feast-data\") pod \"feast-credit-scoring-79c4df66f8-f82mw\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:47.044542 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:47.044523 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-registry-tls\") pod \"feast-credit-scoring-79c4df66f8-f82mw\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:47.044587 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:47.044561 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-online-tls\") pod \"feast-credit-scoring-79c4df66f8-f82mw\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:47.056415 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:47.056390 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shcdr\" (UniqueName: \"kubernetes.io/projected/b71fe0b6-28c6-408d-ade9-7335c8ac177e-kube-api-access-shcdr\") pod \"feast-credit-scoring-79c4df66f8-f82mw\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:47.545754 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:47.545719 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-offline-tls\") pod \"feast-credit-scoring-79c4df66f8-f82mw\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:47.548227 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:47.548209 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-offline-tls\") pod \"feast-credit-scoring-79c4df66f8-f82mw\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:47.801163 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:47.801075 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:48.078580 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:48.078555 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw"] Sep 11 08:12:48.080774 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:12:48.080739 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb71fe0b6_28c6_408d_ade9_7335c8ac177e.slice/crio-891eb188345dcd0fa7fd55606d1a56850ba2fe308ba16447eb69387877335770 WatchSource:0}: Error finding container 891eb188345dcd0fa7fd55606d1a56850ba2fe308ba16447eb69387877335770: Status 404 returned error can't find the container with id 891eb188345dcd0fa7fd55606d1a56850ba2fe308ba16447eb69387877335770 Sep 11 08:12:48.365002 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:48.364893 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" event={"ID":"b71fe0b6-28c6-408d-ade9-7335c8ac177e","Type":"ContainerStarted","Data":"412ada53d2a494bda67001b3d1506be8f901976037f4df0ffbdc8ac5d63fd8e5"} Sep 11 08:12:48.365002 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:48.364967 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" event={"ID":"b71fe0b6-28c6-408d-ade9-7335c8ac177e","Type":"ContainerStarted","Data":"891eb188345dcd0fa7fd55606d1a56850ba2fe308ba16447eb69387877335770"} Sep 11 08:12:50.375097 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:50.375069 2566 generic.go:356] "Generic (PLEG): container finished" podID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerID="412ada53d2a494bda67001b3d1506be8f901976037f4df0ffbdc8ac5d63fd8e5" exitCode=0 Sep 11 08:12:50.375444 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:50.375136 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" event={"ID":"b71fe0b6-28c6-408d-ade9-7335c8ac177e","Type":"ContainerDied","Data":"412ada53d2a494bda67001b3d1506be8f901976037f4df0ffbdc8ac5d63fd8e5"} Sep 11 08:12:51.381264 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:51.381230 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" event={"ID":"b71fe0b6-28c6-408d-ade9-7335c8ac177e","Type":"ContainerStarted","Data":"b689552f079c01f91651be8cae6a2a7516e676d1b8b4aeb1cfb4f7f57b2a1a97"} Sep 11 08:12:57.408146 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:57.408114 2566 generic.go:356] "Generic (PLEG): container finished" podID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerID="b689552f079c01f91651be8cae6a2a7516e676d1b8b4aeb1cfb4f7f57b2a1a97" exitCode=0 Sep 11 08:12:57.408539 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:57.408189 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" event={"ID":"b71fe0b6-28c6-408d-ade9-7335c8ac177e","Type":"ContainerDied","Data":"b689552f079c01f91651be8cae6a2a7516e676d1b8b4aeb1cfb4f7f57b2a1a97"} Sep 11 08:12:58.417493 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:58.417459 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" event={"ID":"b71fe0b6-28c6-408d-ade9-7335c8ac177e","Type":"ContainerStarted","Data":"ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae"} Sep 11 08:12:58.417981 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:58.417523 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" event={"ID":"b71fe0b6-28c6-408d-ade9-7335c8ac177e","Type":"ContainerStarted","Data":"1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb"} Sep 11 08:12:58.417981 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:58.417545 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" event={"ID":"b71fe0b6-28c6-408d-ade9-7335c8ac177e","Type":"ContainerStarted","Data":"cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97"} Sep 11 08:12:58.441754 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:58.441685 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" podStartSLOduration=12.441661639 podStartE2EDuration="12.441661639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:12:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:12:58.439959159 +0000 UTC m=+807.133324276" watchObservedRunningTime="2026-09-11 08:12:58.441661639 +0000 UTC m=+807.135026746" Sep 11 08:12:59.801953 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:59.801894 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:59.802331 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:59.801985 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:59.802331 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:59.802012 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:12:59.803750 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:59.803716 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.27:6571: connect: connection refused" Sep 11 08:12:59.803889 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:59.803753 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.27:8816: connect: connection refused" Sep 11 08:12:59.803889 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:12:59.803752 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Sep 11 08:13:02.801703 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:13:02.801656 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.27:8816: connect: connection refused" Sep 11 08:13:02.802132 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:13:02.801662 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Sep 11 08:13:02.802132 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:13:02.801664 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.27:6571: connect: connection refused" Sep 11 08:13:05.801578 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:13:05.801520 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.27:6571: connect: connection refused" Sep 11 08:13:05.802636 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:13:05.802610 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:13:05.803165 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:13:05.803142 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:13:05.803694 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:13:05.803672 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:13:05.881996 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:13:05.881960 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:13:06.463080 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:13:06.463054 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:13:06.467571 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:13:06.467547 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:13:07.801511 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:13:07.801478 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:13:08.801603 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:13:08.801563 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.27:6571: connect: connection refused" Sep 11 08:13:11.802254 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:13:11.802220 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:13:11.803165 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:13:11.803147 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:14:17.239553 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.239513 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw"] Sep 11 08:14:17.240102 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.239762 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="registry" containerID="cri-o://cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97" gracePeriod=30 Sep 11 08:14:17.240102 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.239802 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="offline" containerID="cri-o://ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae" gracePeriod=30 Sep 11 08:14:17.240102 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.239822 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="online" containerID="cri-o://1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb" gracePeriod=30 Sep 11 08:14:17.292317 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.292283 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-q7k24"] Sep 11 08:14:17.292531 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.292489 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-q7k24" podUID="0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c" containerName="redis" containerID="cri-o://94d35f80e734956b3f0747ca5b1c6ef90aeb05423be14dcaeb4e143dddbc5205" gracePeriod=30 Sep 11 08:14:17.539162 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.539137 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-q7k24" Sep 11 08:14:17.626632 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.626589 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnqjg\" (UniqueName: \"kubernetes.io/projected/0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c-kube-api-access-bnqjg\") pod \"0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c\" (UID: \"0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c\") " Sep 11 08:14:17.628804 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.628768 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c-kube-api-access-bnqjg" (OuterVolumeSpecName: "kube-api-access-bnqjg") pod "0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c" (UID: "0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c"). InnerVolumeSpecName "kube-api-access-bnqjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:14:17.727372 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.727328 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnqjg\" (UniqueName: \"kubernetes.io/projected/0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c-kube-api-access-bnqjg\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:14:17.771182 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.771101 2566 generic.go:356] "Generic (PLEG): container finished" podID="0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c" containerID="94d35f80e734956b3f0747ca5b1c6ef90aeb05423be14dcaeb4e143dddbc5205" exitCode=0 Sep 11 08:14:17.771182 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.771147 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-q7k24" Sep 11 08:14:17.771363 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.771189 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-q7k24" event={"ID":"0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c","Type":"ContainerDied","Data":"94d35f80e734956b3f0747ca5b1c6ef90aeb05423be14dcaeb4e143dddbc5205"} Sep 11 08:14:17.771363 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.771232 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-q7k24" event={"ID":"0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c","Type":"ContainerDied","Data":"7991cee41a2313dc94d0c1eb305d22d23bfb6fb32fae77a89889629e60ca1f22"} Sep 11 08:14:17.771363 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.771255 2566 scope.go:117] "RemoveContainer" containerID="94d35f80e734956b3f0747ca5b1c6ef90aeb05423be14dcaeb4e143dddbc5205" Sep 11 08:14:17.782519 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.782452 2566 scope.go:117] "RemoveContainer" containerID="94d35f80e734956b3f0747ca5b1c6ef90aeb05423be14dcaeb4e143dddbc5205" Sep 11 08:14:17.782922 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:14:17.782898 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94d35f80e734956b3f0747ca5b1c6ef90aeb05423be14dcaeb4e143dddbc5205\": container with ID starting with 94d35f80e734956b3f0747ca5b1c6ef90aeb05423be14dcaeb4e143dddbc5205 not found: ID does not exist" containerID="94d35f80e734956b3f0747ca5b1c6ef90aeb05423be14dcaeb4e143dddbc5205" Sep 11 08:14:17.783065 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.782930 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94d35f80e734956b3f0747ca5b1c6ef90aeb05423be14dcaeb4e143dddbc5205"} err="failed to get container status \"94d35f80e734956b3f0747ca5b1c6ef90aeb05423be14dcaeb4e143dddbc5205\": rpc error: code = NotFound desc = could not find container \"94d35f80e734956b3f0747ca5b1c6ef90aeb05423be14dcaeb4e143dddbc5205\": container with ID starting with 94d35f80e734956b3f0747ca5b1c6ef90aeb05423be14dcaeb4e143dddbc5205 not found: ID does not exist" Sep 11 08:14:17.793396 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.793365 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-q7k24"] Sep 11 08:14:17.798527 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:17.798503 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-q7k24"] Sep 11 08:14:18.778547 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:18.778513 2566 generic.go:356] "Generic (PLEG): container finished" podID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerID="1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb" exitCode=0 Sep 11 08:14:18.778898 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:18.778580 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" event={"ID":"b71fe0b6-28c6-408d-ade9-7335c8ac177e","Type":"ContainerDied","Data":"1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb"} Sep 11 08:14:19.786848 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:19.786819 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c" path="/var/lib/kubelet/pods/0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c/volumes" Sep 11 08:14:26.463772 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:26.463680 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Sep 11 08:14:31.808729 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:31.808698 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 08:14:31.810818 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:31.810794 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 08:14:36.463799 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:36.463756 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Sep 11 08:14:46.463909 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:46.463872 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Sep 11 08:14:46.464301 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:46.464052 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:14:47.886162 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.886138 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:14:47.901860 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.901834 2566 generic.go:356] "Generic (PLEG): container finished" podID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerID="ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae" exitCode=137 Sep 11 08:14:47.901860 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.901857 2566 generic.go:356] "Generic (PLEG): container finished" podID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerID="cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97" exitCode=137 Sep 11 08:14:47.902078 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.901889 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" Sep 11 08:14:47.902078 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.901923 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" event={"ID":"b71fe0b6-28c6-408d-ade9-7335c8ac177e","Type":"ContainerDied","Data":"ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae"} Sep 11 08:14:47.902078 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.902005 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" event={"ID":"b71fe0b6-28c6-408d-ade9-7335c8ac177e","Type":"ContainerDied","Data":"cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97"} Sep 11 08:14:47.902078 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.902033 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw" event={"ID":"b71fe0b6-28c6-408d-ade9-7335c8ac177e","Type":"ContainerDied","Data":"891eb188345dcd0fa7fd55606d1a56850ba2fe308ba16447eb69387877335770"} Sep 11 08:14:47.902078 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.902068 2566 scope.go:117] "RemoveContainer" containerID="ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae" Sep 11 08:14:47.910126 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.910108 2566 scope.go:117] "RemoveContainer" containerID="1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb" Sep 11 08:14:47.917387 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.917370 2566 scope.go:117] "RemoveContainer" containerID="cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97" Sep 11 08:14:47.924981 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.924962 2566 scope.go:117] "RemoveContainer" containerID="b689552f079c01f91651be8cae6a2a7516e676d1b8b4aeb1cfb4f7f57b2a1a97" Sep 11 08:14:47.933122 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.933095 2566 scope.go:117] "RemoveContainer" containerID="412ada53d2a494bda67001b3d1506be8f901976037f4df0ffbdc8ac5d63fd8e5" Sep 11 08:14:47.941582 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.941564 2566 scope.go:117] "RemoveContainer" containerID="ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae" Sep 11 08:14:47.941866 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:14:47.941838 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae\": container with ID starting with ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae not found: ID does not exist" containerID="ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae" Sep 11 08:14:47.942062 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.941871 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae"} err="failed to get container status \"ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae\": rpc error: code = NotFound desc = could not find container \"ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae\": container with ID starting with ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae not found: ID does not exist" Sep 11 08:14:47.942062 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.941889 2566 scope.go:117] "RemoveContainer" containerID="1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb" Sep 11 08:14:47.942423 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:14:47.942401 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb\": container with ID starting with 1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb not found: ID does not exist" containerID="1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb" Sep 11 08:14:47.942498 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.942427 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb"} err="failed to get container status \"1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb\": rpc error: code = NotFound desc = could not find container \"1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb\": container with ID starting with 1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb not found: ID does not exist" Sep 11 08:14:47.942498 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.942475 2566 scope.go:117] "RemoveContainer" containerID="cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97" Sep 11 08:14:47.942767 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:14:47.942749 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97\": container with ID starting with cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97 not found: ID does not exist" containerID="cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97" Sep 11 08:14:47.942830 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.942771 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97"} err="failed to get container status \"cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97\": rpc error: code = NotFound desc = could not find container \"cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97\": container with ID starting with cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97 not found: ID does not exist" Sep 11 08:14:47.942830 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.942783 2566 scope.go:117] "RemoveContainer" containerID="b689552f079c01f91651be8cae6a2a7516e676d1b8b4aeb1cfb4f7f57b2a1a97" Sep 11 08:14:47.943411 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:14:47.943396 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b689552f079c01f91651be8cae6a2a7516e676d1b8b4aeb1cfb4f7f57b2a1a97\": container with ID starting with b689552f079c01f91651be8cae6a2a7516e676d1b8b4aeb1cfb4f7f57b2a1a97 not found: ID does not exist" containerID="b689552f079c01f91651be8cae6a2a7516e676d1b8b4aeb1cfb4f7f57b2a1a97" Sep 11 08:14:47.943461 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.943414 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b689552f079c01f91651be8cae6a2a7516e676d1b8b4aeb1cfb4f7f57b2a1a97"} err="failed to get container status \"b689552f079c01f91651be8cae6a2a7516e676d1b8b4aeb1cfb4f7f57b2a1a97\": rpc error: code = NotFound desc = could not find container \"b689552f079c01f91651be8cae6a2a7516e676d1b8b4aeb1cfb4f7f57b2a1a97\": container with ID starting with b689552f079c01f91651be8cae6a2a7516e676d1b8b4aeb1cfb4f7f57b2a1a97 not found: ID does not exist" Sep 11 08:14:47.943461 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.943430 2566 scope.go:117] "RemoveContainer" containerID="412ada53d2a494bda67001b3d1506be8f901976037f4df0ffbdc8ac5d63fd8e5" Sep 11 08:14:47.943641 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:14:47.943627 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"412ada53d2a494bda67001b3d1506be8f901976037f4df0ffbdc8ac5d63fd8e5\": container with ID starting with 412ada53d2a494bda67001b3d1506be8f901976037f4df0ffbdc8ac5d63fd8e5 not found: ID does not exist" containerID="412ada53d2a494bda67001b3d1506be8f901976037f4df0ffbdc8ac5d63fd8e5" Sep 11 08:14:47.943684 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.943644 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412ada53d2a494bda67001b3d1506be8f901976037f4df0ffbdc8ac5d63fd8e5"} err="failed to get container status \"412ada53d2a494bda67001b3d1506be8f901976037f4df0ffbdc8ac5d63fd8e5\": rpc error: code = NotFound desc = could not find container \"412ada53d2a494bda67001b3d1506be8f901976037f4df0ffbdc8ac5d63fd8e5\": container with ID starting with 412ada53d2a494bda67001b3d1506be8f901976037f4df0ffbdc8ac5d63fd8e5 not found: ID does not exist" Sep 11 08:14:47.943684 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.943656 2566 scope.go:117] "RemoveContainer" containerID="ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae" Sep 11 08:14:47.943901 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.943886 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae"} err="failed to get container status \"ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae\": rpc error: code = NotFound desc = could not find container \"ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae\": container with ID starting with ebe444376d25722c862d68a5cbacafa0e9a76af2523408e84a406255d919b0ae not found: ID does not exist" Sep 11 08:14:47.943965 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.943902 2566 scope.go:117] "RemoveContainer" containerID="1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb" Sep 11 08:14:47.944123 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.944102 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb"} err="failed to get container status \"1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb\": rpc error: code = NotFound desc = could not find container \"1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb\": container with ID starting with 1332b2c8fe94cf342304b218560b974f32345e7311792585c7fd11b9539cf1bb not found: ID does not exist" Sep 11 08:14:47.944196 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.944125 2566 scope.go:117] "RemoveContainer" containerID="cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97" Sep 11 08:14:47.944401 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.944386 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97"} err="failed to get container status \"cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97\": rpc error: code = NotFound desc = could not find container \"cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97\": container with ID starting with cf36ff1ede3cf005138c7754069e256a2053e597369bcffb32e8f74a9118ba97 not found: ID does not exist" Sep 11 08:14:47.944447 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.944403 2566 scope.go:117] "RemoveContainer" containerID="b689552f079c01f91651be8cae6a2a7516e676d1b8b4aeb1cfb4f7f57b2a1a97" Sep 11 08:14:47.944585 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.944570 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b689552f079c01f91651be8cae6a2a7516e676d1b8b4aeb1cfb4f7f57b2a1a97"} err="failed to get container status \"b689552f079c01f91651be8cae6a2a7516e676d1b8b4aeb1cfb4f7f57b2a1a97\": rpc error: code = NotFound desc = could not find container \"b689552f079c01f91651be8cae6a2a7516e676d1b8b4aeb1cfb4f7f57b2a1a97\": container with ID starting with b689552f079c01f91651be8cae6a2a7516e676d1b8b4aeb1cfb4f7f57b2a1a97 not found: ID does not exist" Sep 11 08:14:47.944624 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.944585 2566 scope.go:117] "RemoveContainer" containerID="412ada53d2a494bda67001b3d1506be8f901976037f4df0ffbdc8ac5d63fd8e5" Sep 11 08:14:47.944827 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.944807 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412ada53d2a494bda67001b3d1506be8f901976037f4df0ffbdc8ac5d63fd8e5"} err="failed to get container status \"412ada53d2a494bda67001b3d1506be8f901976037f4df0ffbdc8ac5d63fd8e5\": rpc error: code = NotFound desc = could not find container \"412ada53d2a494bda67001b3d1506be8f901976037f4df0ffbdc8ac5d63fd8e5\": container with ID starting with 412ada53d2a494bda67001b3d1506be8f901976037f4df0ffbdc8ac5d63fd8e5 not found: ID does not exist" Sep 11 08:14:47.987277 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.987250 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b71fe0b6-28c6-408d-ade9-7335c8ac177e-feast-data\") pod \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " Sep 11 08:14:47.987422 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.987307 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-registry-tls\") pod \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " Sep 11 08:14:47.987422 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.987327 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shcdr\" (UniqueName: \"kubernetes.io/projected/b71fe0b6-28c6-408d-ade9-7335c8ac177e-kube-api-access-shcdr\") pod \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " Sep 11 08:14:47.987422 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.987355 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-offline-tls\") pod \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " Sep 11 08:14:47.987581 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.987506 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-online-tls\") pod \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\" (UID: \"b71fe0b6-28c6-408d-ade9-7335c8ac177e\") " Sep 11 08:14:47.989634 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.989600 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-online-tls" (OuterVolumeSpecName: "online-tls") pod "b71fe0b6-28c6-408d-ade9-7335c8ac177e" (UID: "b71fe0b6-28c6-408d-ade9-7335c8ac177e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:14:47.989811 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.989792 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b71fe0b6-28c6-408d-ade9-7335c8ac177e-kube-api-access-shcdr" (OuterVolumeSpecName: "kube-api-access-shcdr") pod "b71fe0b6-28c6-408d-ade9-7335c8ac177e" (UID: "b71fe0b6-28c6-408d-ade9-7335c8ac177e"). InnerVolumeSpecName "kube-api-access-shcdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:14:47.989906 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.989888 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "b71fe0b6-28c6-408d-ade9-7335c8ac177e" (UID: "b71fe0b6-28c6-408d-ade9-7335c8ac177e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:14:47.989969 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.989916 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b71fe0b6-28c6-408d-ade9-7335c8ac177e" (UID: "b71fe0b6-28c6-408d-ade9-7335c8ac177e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:14:47.996134 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:47.996112 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b71fe0b6-28c6-408d-ade9-7335c8ac177e-feast-data" (OuterVolumeSpecName: "feast-data") pod "b71fe0b6-28c6-408d-ade9-7335c8ac177e" (UID: "b71fe0b6-28c6-408d-ade9-7335c8ac177e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 08:14:48.088333 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:48.088259 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b71fe0b6-28c6-408d-ade9-7335c8ac177e-feast-data\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:14:48.088333 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:48.088285 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-registry-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:14:48.088333 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:48.088295 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shcdr\" (UniqueName: \"kubernetes.io/projected/b71fe0b6-28c6-408d-ade9-7335c8ac177e-kube-api-access-shcdr\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:14:48.088333 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:48.088304 2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-offline-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:14:48.088333 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:48.088312 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b71fe0b6-28c6-408d-ade9-7335c8ac177e-online-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:14:48.225859 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:48.225817 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw"] Sep 11 08:14:48.231279 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:48.231246 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-79c4df66f8-f82mw"] Sep 11 08:14:49.788460 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:14:49.788425 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" path="/var/lib/kubelet/pods/b71fe0b6-28c6-408d-ade9-7335c8ac177e/volumes" Sep 11 08:17:45.381091 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.381057 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-zmpm5"] Sep 11 08:17:45.381545 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.381382 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c" containerName="redis" Sep 11 08:17:45.381545 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.381394 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c" containerName="redis" Sep 11 08:17:45.381545 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.381403 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="online" Sep 11 08:17:45.381545 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.381413 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="online" Sep 11 08:17:45.381545 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.381428 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="offline" Sep 11 08:17:45.381545 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.381433 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="offline" Sep 11 08:17:45.381545 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.381441 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="feast-init" Sep 11 08:17:45.381545 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.381445 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="feast-init" Sep 11 08:17:45.381545 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.381450 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="feast-apply" Sep 11 08:17:45.381545 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.381455 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="feast-apply" Sep 11 08:17:45.381545 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.381461 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="registry" Sep 11 08:17:45.381545 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.381465 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="registry" Sep 11 08:17:45.381545 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.381518 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b9fd3e1-a383-46ab-b1b6-9e9f570cb32c" containerName="redis" Sep 11 08:17:45.381545 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.381529 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="registry" Sep 11 08:17:45.381545 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.381534 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="online" Sep 11 08:17:45.381545 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.381543 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b71fe0b6-28c6-408d-ade9-7335c8ac177e" containerName="offline" Sep 11 08:17:45.384283 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.384265 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-zmpm5" Sep 11 08:17:45.387129 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.387103 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-5hdfz\"" Sep 11 08:17:45.387254 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.387220 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" Sep 11 08:17:45.387406 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.387385 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" Sep 11 08:17:45.412218 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.412188 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-zmpm5"] Sep 11 08:17:45.426341 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.426309 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smclt\" (UniqueName: \"kubernetes.io/projected/97faa1d8-837a-4631-905f-ece0d638de4c-kube-api-access-smclt\") pod \"redis-69bbd798b6-zmpm5\" (UID: \"97faa1d8-837a-4631-905f-ece0d638de4c\") " pod="test-ns-feast-rest/redis-69bbd798b6-zmpm5" Sep 11 08:17:45.527625 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.527589 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smclt\" (UniqueName: \"kubernetes.io/projected/97faa1d8-837a-4631-905f-ece0d638de4c-kube-api-access-smclt\") pod \"redis-69bbd798b6-zmpm5\" (UID: \"97faa1d8-837a-4631-905f-ece0d638de4c\") " pod="test-ns-feast-rest/redis-69bbd798b6-zmpm5" Sep 11 08:17:45.540186 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.540154 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smclt\" (UniqueName: \"kubernetes.io/projected/97faa1d8-837a-4631-905f-ece0d638de4c-kube-api-access-smclt\") pod \"redis-69bbd798b6-zmpm5\" (UID: \"97faa1d8-837a-4631-905f-ece0d638de4c\") " pod="test-ns-feast-rest/redis-69bbd798b6-zmpm5" Sep 11 08:17:45.692714 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.692676 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-zmpm5" Sep 11 08:17:45.966057 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:45.965903 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-zmpm5"] Sep 11 08:17:45.968781 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:17:45.968755 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97faa1d8_837a_4631_905f_ece0d638de4c.slice/crio-0ea3d3486301cc22087ecb272f3240524ca842702afc16379e3045aa7c04ab4c WatchSource:0}: Error finding container 0ea3d3486301cc22087ecb272f3240524ca842702afc16379e3045aa7c04ab4c: Status 404 returned error can't find the container with id 0ea3d3486301cc22087ecb272f3240524ca842702afc16379e3045aa7c04ab4c Sep 11 08:17:46.587654 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:46.587619 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-zmpm5" event={"ID":"97faa1d8-837a-4631-905f-ece0d638de4c","Type":"ContainerStarted","Data":"7abeeb860664f678c2dbef45fe83a03c9a6e2164fd7663378b72d6de2973a6b3"} Sep 11 08:17:46.587654 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:46.587659 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-zmpm5" event={"ID":"97faa1d8-837a-4631-905f-ece0d638de4c","Type":"ContainerStarted","Data":"0ea3d3486301cc22087ecb272f3240524ca842702afc16379e3045aa7c04ab4c"} Sep 11 08:17:46.609875 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:46.609751 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-zmpm5" podStartSLOduration=1.609730505 podStartE2EDuration="1.609730505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:17:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:17:46.60922754 +0000 UTC m=+1095.302592644" watchObservedRunningTime="2026-09-11 08:17:46.609730505 +0000 UTC m=+1095.303095612" Sep 11 08:17:56.486368 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.486321 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff"] Sep 11 08:17:56.489867 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.489849 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:17:56.492776 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.492755 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\"" Sep 11 08:17:56.492878 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.492756 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\"" Sep 11 08:17:56.493121 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.493105 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" Sep 11 08:17:56.493121 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.493115 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-9qf8q\"" Sep 11 08:17:56.493355 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.493341 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\"" Sep 11 08:17:56.504703 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.504682 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff"] Sep 11 08:17:56.621102 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.621070 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-registry-tls\") pod \"feast-credit-scoring-5477c4978f-fwbff\" (UID: \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\") " pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:17:56.621273 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.621133 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-feast-data\") pod \"feast-credit-scoring-5477c4978f-fwbff\" (UID: \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\") " pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:17:56.621273 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.621190 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-online-tls\") pod \"feast-credit-scoring-5477c4978f-fwbff\" (UID: \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\") " pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:17:56.621273 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.621242 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcs8k\" (UniqueName: \"kubernetes.io/projected/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-kube-api-access-kcs8k\") pod \"feast-credit-scoring-5477c4978f-fwbff\" (UID: \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\") " pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:17:56.722276 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.722239 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-registry-tls\") pod \"feast-credit-scoring-5477c4978f-fwbff\" (UID: \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\") " pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:17:56.722461 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.722316 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-feast-data\") pod \"feast-credit-scoring-5477c4978f-fwbff\" (UID: \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\") " pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:17:56.722461 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.722340 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-online-tls\") pod \"feast-credit-scoring-5477c4978f-fwbff\" (UID: \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\") " pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:17:56.722564 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.722484 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcs8k\" (UniqueName: \"kubernetes.io/projected/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-kube-api-access-kcs8k\") pod \"feast-credit-scoring-5477c4978f-fwbff\" (UID: \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\") " pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:17:56.722783 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.722762 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-feast-data\") pod \"feast-credit-scoring-5477c4978f-fwbff\" (UID: \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\") " pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:17:56.724867 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.724845 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-online-tls\") pod \"feast-credit-scoring-5477c4978f-fwbff\" (UID: \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\") " pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:17:56.724974 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.724866 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-registry-tls\") pod \"feast-credit-scoring-5477c4978f-fwbff\" (UID: \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\") " pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:17:56.736005 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.735971 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcs8k\" (UniqueName: \"kubernetes.io/projected/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-kube-api-access-kcs8k\") pod \"feast-credit-scoring-5477c4978f-fwbff\" (UID: \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\") " pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:17:56.799560 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:56.799493 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:17:57.083462 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:57.083437 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff"] Sep 11 08:17:57.084913 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:17:57.084888 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4fd94d_f169_4ca1_9609_738c4dbe2a42.slice/crio-803a6d175e650c1cb79dd6a79d829a8848d13ed47b443f5b64c33d3d1a22f3f1 WatchSource:0}: Error finding container 803a6d175e650c1cb79dd6a79d829a8848d13ed47b443f5b64c33d3d1a22f3f1: Status 404 returned error can't find the container with id 803a6d175e650c1cb79dd6a79d829a8848d13ed47b443f5b64c33d3d1a22f3f1 Sep 11 08:17:57.633403 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:57.633366 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" event={"ID":"6e4fd94d-f169-4ca1-9609-738c4dbe2a42","Type":"ContainerStarted","Data":"bec2e1df5d837630ec888cf0bae8cb5c8fe57d3d88830ea5a9f1f686f97e69d6"} Sep 11 08:17:57.633796 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:57.633420 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" event={"ID":"6e4fd94d-f169-4ca1-9609-738c4dbe2a42","Type":"ContainerStarted","Data":"803a6d175e650c1cb79dd6a79d829a8848d13ed47b443f5b64c33d3d1a22f3f1"} Sep 11 08:17:58.639195 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:58.639102 2566 generic.go:356] "Generic (PLEG): container finished" podID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerID="bec2e1df5d837630ec888cf0bae8cb5c8fe57d3d88830ea5a9f1f686f97e69d6" exitCode=0 Sep 11 08:17:58.639571 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:58.639188 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" event={"ID":"6e4fd94d-f169-4ca1-9609-738c4dbe2a42","Type":"ContainerDied","Data":"bec2e1df5d837630ec888cf0bae8cb5c8fe57d3d88830ea5a9f1f686f97e69d6"} Sep 11 08:17:59.645489 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:17:59.645454 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" event={"ID":"6e4fd94d-f169-4ca1-9609-738c4dbe2a42","Type":"ContainerStarted","Data":"2b6727370ecfe74b732a3a7b7a06aa142f65bcdbf8e3f7b82e527bcfebd98f97"} Sep 11 08:18:06.675913 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:06.675881 2566 generic.go:356] "Generic (PLEG): container finished" podID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerID="2b6727370ecfe74b732a3a7b7a06aa142f65bcdbf8e3f7b82e527bcfebd98f97" exitCode=0 Sep 11 08:18:06.676353 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:06.675966 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" event={"ID":"6e4fd94d-f169-4ca1-9609-738c4dbe2a42","Type":"ContainerDied","Data":"2b6727370ecfe74b732a3a7b7a06aa142f65bcdbf8e3f7b82e527bcfebd98f97"} Sep 11 08:18:07.682576 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:07.682534 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" event={"ID":"6e4fd94d-f169-4ca1-9609-738c4dbe2a42","Type":"ContainerStarted","Data":"97fa883341f59cb21dca12690d73df9e5b7fa3c9d18685da2b2e6702516a0051"} Sep 11 08:18:07.682990 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:07.682619 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" event={"ID":"6e4fd94d-f169-4ca1-9609-738c4dbe2a42","Type":"ContainerStarted","Data":"5df99bb9b3e967fb32552cbcc2bf6cd8affb32743ded336f09b455a8ebb8d5a5"} Sep 11 08:18:07.720726 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:07.720670 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" podStartSLOduration=11.720650967 podStartE2EDuration="11.720650967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:17:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:18:07.716642985 +0000 UTC m=+1116.410008111" watchObservedRunningTime="2026-09-11 08:18:07.720650967 +0000 UTC m=+1116.414016071" Sep 11 08:18:08.800486 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:08.800442 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:18:08.800972 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:08.800535 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:18:08.802084 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:08.802047 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Sep 11 08:18:08.802181 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:08.802056 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused" Sep 11 08:18:11.800494 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:11.800455 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused" Sep 11 08:18:11.800494 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:11.800473 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Sep 11 08:18:14.800754 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:14.800695 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused" Sep 11 08:18:14.806584 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:14.806556 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:18:14.806957 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:14.806920 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:18:14.809620 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:14.809595 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:18:16.799844 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:16.799792 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:18:17.800247 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:17.800211 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused" Sep 11 08:18:20.800712 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:20.800679 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:18:20.801466 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:20.801448 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:18:22.267605 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.267571 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k"] Sep 11 08:18:22.270736 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.270713 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:22.272811 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.272791 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-jlrpm\"" Sep 11 08:18:22.273098 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.273082 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\"" Sep 11 08:18:22.273457 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.273441 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Sep 11 08:18:22.273705 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.273689 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\"" Sep 11 08:18:22.286042 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.286019 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k"] Sep 11 08:18:22.342451 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.342421 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/11972679-d6d6-4f47-8376-9da8be98045a-feast-data\") pod \"feast-driver-ranking-8447b878db-8jm7k\" (UID: \"11972679-d6d6-4f47-8376-9da8be98045a\") " pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:22.342646 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.342469 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/11972679-d6d6-4f47-8376-9da8be98045a-registry-tls\") pod \"feast-driver-ranking-8447b878db-8jm7k\" (UID: \"11972679-d6d6-4f47-8376-9da8be98045a\") " pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:22.342646 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.342526 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdj2k\" (UniqueName: \"kubernetes.io/projected/11972679-d6d6-4f47-8376-9da8be98045a-kube-api-access-vdj2k\") pod \"feast-driver-ranking-8447b878db-8jm7k\" (UID: \"11972679-d6d6-4f47-8376-9da8be98045a\") " pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:22.342646 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.342584 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/11972679-d6d6-4f47-8376-9da8be98045a-online-tls\") pod \"feast-driver-ranking-8447b878db-8jm7k\" (UID: \"11972679-d6d6-4f47-8376-9da8be98045a\") " pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:22.443064 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.443017 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/11972679-d6d6-4f47-8376-9da8be98045a-registry-tls\") pod \"feast-driver-ranking-8447b878db-8jm7k\" (UID: \"11972679-d6d6-4f47-8376-9da8be98045a\") " pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:22.443271 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.443079 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdj2k\" (UniqueName: \"kubernetes.io/projected/11972679-d6d6-4f47-8376-9da8be98045a-kube-api-access-vdj2k\") pod \"feast-driver-ranking-8447b878db-8jm7k\" (UID: \"11972679-d6d6-4f47-8376-9da8be98045a\") " pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:22.443271 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.443127 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/11972679-d6d6-4f47-8376-9da8be98045a-online-tls\") pod \"feast-driver-ranking-8447b878db-8jm7k\" (UID: \"11972679-d6d6-4f47-8376-9da8be98045a\") " pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:22.443271 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.443162 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/11972679-d6d6-4f47-8376-9da8be98045a-feast-data\") pod \"feast-driver-ranking-8447b878db-8jm7k\" (UID: \"11972679-d6d6-4f47-8376-9da8be98045a\") " pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:22.443566 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.443545 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/11972679-d6d6-4f47-8376-9da8be98045a-feast-data\") pod \"feast-driver-ranking-8447b878db-8jm7k\" (UID: \"11972679-d6d6-4f47-8376-9da8be98045a\") " pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:22.445689 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.445668 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/11972679-d6d6-4f47-8376-9da8be98045a-registry-tls\") pod \"feast-driver-ranking-8447b878db-8jm7k\" (UID: \"11972679-d6d6-4f47-8376-9da8be98045a\") " pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:22.445764 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.445689 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/11972679-d6d6-4f47-8376-9da8be98045a-online-tls\") pod \"feast-driver-ranking-8447b878db-8jm7k\" (UID: \"11972679-d6d6-4f47-8376-9da8be98045a\") " pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:22.452135 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.452096 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdj2k\" (UniqueName: \"kubernetes.io/projected/11972679-d6d6-4f47-8376-9da8be98045a-kube-api-access-vdj2k\") pod \"feast-driver-ranking-8447b878db-8jm7k\" (UID: \"11972679-d6d6-4f47-8376-9da8be98045a\") " pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:22.579334 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.579246 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:22.863118 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:22.863038 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k"] Sep 11 08:18:22.866481 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:18:22.866454 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11972679_d6d6_4f47_8376_9da8be98045a.slice/crio-a437263ffa9bd3c86ff9df5855b7435365e30e0d659bb353b022b4a6da649201 WatchSource:0}: Error finding container a437263ffa9bd3c86ff9df5855b7435365e30e0d659bb353b022b4a6da649201: Status 404 returned error can't find the container with id a437263ffa9bd3c86ff9df5855b7435365e30e0d659bb353b022b4a6da649201 Sep 11 08:18:23.762809 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:23.762773 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" event={"ID":"11972679-d6d6-4f47-8376-9da8be98045a","Type":"ContainerStarted","Data":"54191b7f53f7be2f27cffac116fa69a365f9bae084a3b2b119ff7061f7578576"} Sep 11 08:18:23.763232 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:23.762825 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" event={"ID":"11972679-d6d6-4f47-8376-9da8be98045a","Type":"ContainerStarted","Data":"a437263ffa9bd3c86ff9df5855b7435365e30e0d659bb353b022b4a6da649201"} Sep 11 08:18:27.781965 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:27.781913 2566 generic.go:356] "Generic (PLEG): container finished" podID="11972679-d6d6-4f47-8376-9da8be98045a" containerID="54191b7f53f7be2f27cffac116fa69a365f9bae084a3b2b119ff7061f7578576" exitCode=0 Sep 11 08:18:27.786214 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:27.786189 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" event={"ID":"11972679-d6d6-4f47-8376-9da8be98045a","Type":"ContainerDied","Data":"54191b7f53f7be2f27cffac116fa69a365f9bae084a3b2b119ff7061f7578576"} Sep 11 08:18:28.787588 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:28.787555 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" event={"ID":"11972679-d6d6-4f47-8376-9da8be98045a","Type":"ContainerStarted","Data":"f2a9f0f352f515311a4075d63e91c5d080de9cc15f12fa9bf23c59438704111f"} Sep 11 08:18:35.821226 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:35.821194 2566 generic.go:356] "Generic (PLEG): container finished" podID="11972679-d6d6-4f47-8376-9da8be98045a" containerID="f2a9f0f352f515311a4075d63e91c5d080de9cc15f12fa9bf23c59438704111f" exitCode=0 Sep 11 08:18:35.821606 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:35.821260 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" event={"ID":"11972679-d6d6-4f47-8376-9da8be98045a","Type":"ContainerDied","Data":"f2a9f0f352f515311a4075d63e91c5d080de9cc15f12fa9bf23c59438704111f"} Sep 11 08:18:35.824376 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:35.824358 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Sep 11 08:18:36.829224 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:36.829182 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" event={"ID":"11972679-d6d6-4f47-8376-9da8be98045a","Type":"ContainerStarted","Data":"4e154b3ad0ac594e12d14309102bcd4dfef82743668c314c61ff628a34f1350e"} Sep 11 08:18:36.829734 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:36.829251 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" event={"ID":"11972679-d6d6-4f47-8376-9da8be98045a","Type":"ContainerStarted","Data":"19c4e6b3382311ffa9849bef24e5097e0ff99fb8cb1210cd52d9ccc4d21eec50"} Sep 11 08:18:36.858499 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:36.858438 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" podStartSLOduration=14.858421018 podStartE2EDuration="14.858421018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:18:36.857513953 +0000 UTC m=+1145.550879085" watchObservedRunningTime="2026-09-11 08:18:36.858421018 +0000 UTC m=+1145.551786123" Sep 11 08:18:37.579892 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:37.579855 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:37.580114 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:37.579930 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:37.581693 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:37.581655 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Sep 11 08:18:37.581829 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:37.581655 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused" Sep 11 08:18:40.580540 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:40.580494 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused" Sep 11 08:18:40.581028 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:40.580574 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Sep 11 08:18:42.579792 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:42.579747 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:42.580208 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:42.579829 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:43.580418 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:43.580368 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused" Sep 11 08:18:43.586223 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:43.586194 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:43.589785 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:43.589758 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:46.580320 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:46.580269 2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused" Sep 11 08:18:49.580194 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:49.580158 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:18:49.580883 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:18:49.580866 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:19:31.844135 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:19:31.844105 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 08:19:31.845048 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:19:31.845029 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 08:20:11.343966 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:11.343915 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff"] Sep 11 08:20:11.344451 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:11.344179 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="registry" containerID="cri-o://5df99bb9b3e967fb32552cbcc2bf6cd8affb32743ded336f09b455a8ebb8d5a5" gracePeriod=30 Sep 11 08:20:11.344451 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:11.344200 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="online" containerID="cri-o://97fa883341f59cb21dca12690d73df9e5b7fa3c9d18685da2b2e6702516a0051" gracePeriod=30 Sep 11 08:20:11.354682 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:11.354655 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k"] Sep 11 08:20:11.354903 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:11.354877 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="registry" containerID="cri-o://19c4e6b3382311ffa9849bef24e5097e0ff99fb8cb1210cd52d9ccc4d21eec50" gracePeriod=30 Sep 11 08:20:11.354979 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:11.354906 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="online" containerID="cri-o://4e154b3ad0ac594e12d14309102bcd4dfef82743668c314c61ff628a34f1350e" gracePeriod=30 Sep 11 08:20:13.259551 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:13.259520 2566 generic.go:356] "Generic (PLEG): container finished" podID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerID="97fa883341f59cb21dca12690d73df9e5b7fa3c9d18685da2b2e6702516a0051" exitCode=0 Sep 11 08:20:13.259969 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:13.259593 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" event={"ID":"6e4fd94d-f169-4ca1-9609-738c4dbe2a42","Type":"ContainerDied","Data":"97fa883341f59cb21dca12690d73df9e5b7fa3c9d18685da2b2e6702516a0051"} Sep 11 08:20:13.261838 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:13.261819 2566 generic.go:356] "Generic (PLEG): container finished" podID="11972679-d6d6-4f47-8376-9da8be98045a" containerID="4e154b3ad0ac594e12d14309102bcd4dfef82743668c314c61ff628a34f1350e" exitCode=0 Sep 11 08:20:13.261900 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:13.261863 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" event={"ID":"11972679-d6d6-4f47-8376-9da8be98045a","Type":"ContainerDied","Data":"4e154b3ad0ac594e12d14309102bcd4dfef82743668c314c61ff628a34f1350e"} Sep 11 08:20:13.440341 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:13.440265 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-zmpm5"] Sep 11 08:20:13.440545 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:13.440517 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-zmpm5" podUID="97faa1d8-837a-4631-905f-ece0d638de4c" containerName="redis" containerID="cri-o://7abeeb860664f678c2dbef45fe83a03c9a6e2164fd7663378b72d6de2973a6b3" gracePeriod=30 Sep 11 08:20:13.586851 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:13.586811 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Sep 11 08:20:13.681800 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:13.681776 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-zmpm5" Sep 11 08:20:13.790956 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:13.790863 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smclt\" (UniqueName: \"kubernetes.io/projected/97faa1d8-837a-4631-905f-ece0d638de4c-kube-api-access-smclt\") pod \"97faa1d8-837a-4631-905f-ece0d638de4c\" (UID: \"97faa1d8-837a-4631-905f-ece0d638de4c\") " Sep 11 08:20:13.793137 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:13.793110 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97faa1d8-837a-4631-905f-ece0d638de4c-kube-api-access-smclt" (OuterVolumeSpecName: "kube-api-access-smclt") pod "97faa1d8-837a-4631-905f-ece0d638de4c" (UID: "97faa1d8-837a-4631-905f-ece0d638de4c"). InnerVolumeSpecName "kube-api-access-smclt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:20:13.892327 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:13.892293 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smclt\" (UniqueName: \"kubernetes.io/projected/97faa1d8-837a-4631-905f-ece0d638de4c-kube-api-access-smclt\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:20:14.267212 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:14.267178 2566 generic.go:356] "Generic (PLEG): container finished" podID="97faa1d8-837a-4631-905f-ece0d638de4c" containerID="7abeeb860664f678c2dbef45fe83a03c9a6e2164fd7663378b72d6de2973a6b3" exitCode=0 Sep 11 08:20:14.267615 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:14.267221 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-zmpm5" Sep 11 08:20:14.267615 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:14.267262 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-zmpm5" event={"ID":"97faa1d8-837a-4631-905f-ece0d638de4c","Type":"ContainerDied","Data":"7abeeb860664f678c2dbef45fe83a03c9a6e2164fd7663378b72d6de2973a6b3"} Sep 11 08:20:14.267615 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:14.267301 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-zmpm5" event={"ID":"97faa1d8-837a-4631-905f-ece0d638de4c","Type":"ContainerDied","Data":"0ea3d3486301cc22087ecb272f3240524ca842702afc16379e3045aa7c04ab4c"} Sep 11 08:20:14.267615 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:14.267318 2566 scope.go:117] "RemoveContainer" containerID="7abeeb860664f678c2dbef45fe83a03c9a6e2164fd7663378b72d6de2973a6b3" Sep 11 08:20:14.275587 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:14.275572 2566 scope.go:117] "RemoveContainer" containerID="7abeeb860664f678c2dbef45fe83a03c9a6e2164fd7663378b72d6de2973a6b3" Sep 11 08:20:14.275872 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:20:14.275853 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7abeeb860664f678c2dbef45fe83a03c9a6e2164fd7663378b72d6de2973a6b3\": container with ID starting with 7abeeb860664f678c2dbef45fe83a03c9a6e2164fd7663378b72d6de2973a6b3 not found: ID does not exist" containerID="7abeeb860664f678c2dbef45fe83a03c9a6e2164fd7663378b72d6de2973a6b3" Sep 11 08:20:14.275921 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:14.275880 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7abeeb860664f678c2dbef45fe83a03c9a6e2164fd7663378b72d6de2973a6b3"} err="failed to get container status \"7abeeb860664f678c2dbef45fe83a03c9a6e2164fd7663378b72d6de2973a6b3\": rpc error: code = NotFound desc = could not find container \"7abeeb860664f678c2dbef45fe83a03c9a6e2164fd7663378b72d6de2973a6b3\": container with ID starting with 7abeeb860664f678c2dbef45fe83a03c9a6e2164fd7663378b72d6de2973a6b3 not found: ID does not exist" Sep 11 08:20:14.288280 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:14.288259 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-zmpm5"] Sep 11 08:20:14.290659 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:14.290640 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-zmpm5"] Sep 11 08:20:14.807604 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:14.807568 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Sep 11 08:20:15.787502 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:15.787469 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97faa1d8-837a-4631-905f-ece0d638de4c" path="/var/lib/kubelet/pods/97faa1d8-837a-4631-905f-ece0d638de4c/volumes" Sep 11 08:20:23.587508 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:23.587409 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Sep 11 08:20:24.807406 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:24.807365 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Sep 11 08:20:33.587224 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:33.587182 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Sep 11 08:20:33.587620 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:33.587334 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:20:34.807553 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:34.807518 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Sep 11 08:20:34.807921 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:34.807631 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:20:42.012722 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.012700 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:20:42.018000 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.016121 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:20:42.120283 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.120191 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-registry-tls\") pod \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\" (UID: \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\") " Sep 11 08:20:42.120283 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.120224 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/11972679-d6d6-4f47-8376-9da8be98045a-registry-tls\") pod \"11972679-d6d6-4f47-8376-9da8be98045a\" (UID: \"11972679-d6d6-4f47-8376-9da8be98045a\") " Sep 11 08:20:42.120283 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.120259 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-online-tls\") pod \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\" (UID: \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\") " Sep 11 08:20:42.120556 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.120320 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcs8k\" (UniqueName: \"kubernetes.io/projected/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-kube-api-access-kcs8k\") pod \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\" (UID: \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\") " Sep 11 08:20:42.120556 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.120345 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/11972679-d6d6-4f47-8376-9da8be98045a-online-tls\") pod \"11972679-d6d6-4f47-8376-9da8be98045a\" (UID: \"11972679-d6d6-4f47-8376-9da8be98045a\") " Sep 11 08:20:42.120556 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.120375 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/11972679-d6d6-4f47-8376-9da8be98045a-feast-data\") pod \"11972679-d6d6-4f47-8376-9da8be98045a\" (UID: \"11972679-d6d6-4f47-8376-9da8be98045a\") " Sep 11 08:20:42.120556 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.120426 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-feast-data\") pod \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\" (UID: \"6e4fd94d-f169-4ca1-9609-738c4dbe2a42\") " Sep 11 08:20:42.120556 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.120447 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdj2k\" (UniqueName: \"kubernetes.io/projected/11972679-d6d6-4f47-8376-9da8be98045a-kube-api-access-vdj2k\") pod \"11972679-d6d6-4f47-8376-9da8be98045a\" (UID: \"11972679-d6d6-4f47-8376-9da8be98045a\") " Sep 11 08:20:42.120985 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.120906 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11972679-d6d6-4f47-8376-9da8be98045a-feast-data" (OuterVolumeSpecName: "feast-data") pod "11972679-d6d6-4f47-8376-9da8be98045a" (UID: "11972679-d6d6-4f47-8376-9da8be98045a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 08:20:42.122977 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.122928 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6e4fd94d-f169-4ca1-9609-738c4dbe2a42" (UID: "6e4fd94d-f169-4ca1-9609-738c4dbe2a42"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:20:42.122977 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.122957 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11972679-d6d6-4f47-8376-9da8be98045a-online-tls" (OuterVolumeSpecName: "online-tls") pod "11972679-d6d6-4f47-8376-9da8be98045a" (UID: "11972679-d6d6-4f47-8376-9da8be98045a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:20:42.123122 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.122973 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-kube-api-access-kcs8k" (OuterVolumeSpecName: "kube-api-access-kcs8k") pod "6e4fd94d-f169-4ca1-9609-738c4dbe2a42" (UID: "6e4fd94d-f169-4ca1-9609-738c4dbe2a42"). InnerVolumeSpecName "kube-api-access-kcs8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:20:42.123122 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.123074 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-online-tls" (OuterVolumeSpecName: "online-tls") pod "6e4fd94d-f169-4ca1-9609-738c4dbe2a42" (UID: "6e4fd94d-f169-4ca1-9609-738c4dbe2a42"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:20:42.123122 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.123084 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11972679-d6d6-4f47-8376-9da8be98045a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "11972679-d6d6-4f47-8376-9da8be98045a" (UID: "11972679-d6d6-4f47-8376-9da8be98045a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:20:42.123276 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.123260 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11972679-d6d6-4f47-8376-9da8be98045a-kube-api-access-vdj2k" (OuterVolumeSpecName: "kube-api-access-vdj2k") pod "11972679-d6d6-4f47-8376-9da8be98045a" (UID: "11972679-d6d6-4f47-8376-9da8be98045a"). InnerVolumeSpecName "kube-api-access-vdj2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:20:42.130398 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.130373 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-feast-data" (OuterVolumeSpecName: "feast-data") pod "6e4fd94d-f169-4ca1-9609-738c4dbe2a42" (UID: "6e4fd94d-f169-4ca1-9609-738c4dbe2a42"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 08:20:42.221174 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.221149 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-online-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:20:42.221174 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.221172 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcs8k\" (UniqueName: \"kubernetes.io/projected/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-kube-api-access-kcs8k\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:20:42.221303 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.221182 2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/11972679-d6d6-4f47-8376-9da8be98045a-online-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:20:42.221303 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.221191 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/11972679-d6d6-4f47-8376-9da8be98045a-feast-data\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:20:42.221303 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.221198 2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-feast-data\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:20:42.221303 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.221205 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdj2k\" (UniqueName: \"kubernetes.io/projected/11972679-d6d6-4f47-8376-9da8be98045a-kube-api-access-vdj2k\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:20:42.221303 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.221213 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6e4fd94d-f169-4ca1-9609-738c4dbe2a42-registry-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:20:42.221303 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.221229 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/11972679-d6d6-4f47-8376-9da8be98045a-registry-tls\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:20:42.383369 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.383294 2566 generic.go:356] "Generic (PLEG): container finished" podID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerID="5df99bb9b3e967fb32552cbcc2bf6cd8affb32743ded336f09b455a8ebb8d5a5" exitCode=137 Sep 11 08:20:42.383498 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.383369 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" Sep 11 08:20:42.383498 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.383377 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" event={"ID":"6e4fd94d-f169-4ca1-9609-738c4dbe2a42","Type":"ContainerDied","Data":"5df99bb9b3e967fb32552cbcc2bf6cd8affb32743ded336f09b455a8ebb8d5a5"} Sep 11 08:20:42.383498 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.383464 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff" event={"ID":"6e4fd94d-f169-4ca1-9609-738c4dbe2a42","Type":"ContainerDied","Data":"803a6d175e650c1cb79dd6a79d829a8848d13ed47b443f5b64c33d3d1a22f3f1"} Sep 11 08:20:42.383498 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.383493 2566 scope.go:117] "RemoveContainer" containerID="97fa883341f59cb21dca12690d73df9e5b7fa3c9d18685da2b2e6702516a0051" Sep 11 08:20:42.385874 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.385852 2566 generic.go:356] "Generic (PLEG): container finished" podID="11972679-d6d6-4f47-8376-9da8be98045a" containerID="19c4e6b3382311ffa9849bef24e5097e0ff99fb8cb1210cd52d9ccc4d21eec50" exitCode=137 Sep 11 08:20:42.385993 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.385894 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" event={"ID":"11972679-d6d6-4f47-8376-9da8be98045a","Type":"ContainerDied","Data":"19c4e6b3382311ffa9849bef24e5097e0ff99fb8cb1210cd52d9ccc4d21eec50"} Sep 11 08:20:42.385993 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.385909 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" Sep 11 08:20:42.385993 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.385933 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k" event={"ID":"11972679-d6d6-4f47-8376-9da8be98045a","Type":"ContainerDied","Data":"a437263ffa9bd3c86ff9df5855b7435365e30e0d659bb353b022b4a6da649201"} Sep 11 08:20:42.392555 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.392538 2566 scope.go:117] "RemoveContainer" containerID="5df99bb9b3e967fb32552cbcc2bf6cd8affb32743ded336f09b455a8ebb8d5a5" Sep 11 08:20:42.401116 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.401078 2566 scope.go:117] "RemoveContainer" containerID="2b6727370ecfe74b732a3a7b7a06aa142f65bcdbf8e3f7b82e527bcfebd98f97" Sep 11 08:20:42.408127 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.408111 2566 scope.go:117] "RemoveContainer" containerID="bec2e1df5d837630ec888cf0bae8cb5c8fe57d3d88830ea5a9f1f686f97e69d6" Sep 11 08:20:42.413258 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.413235 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff"] Sep 11 08:20:42.415837 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.415821 2566 scope.go:117] "RemoveContainer" containerID="97fa883341f59cb21dca12690d73df9e5b7fa3c9d18685da2b2e6702516a0051" Sep 11 08:20:42.416179 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:20:42.416152 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97fa883341f59cb21dca12690d73df9e5b7fa3c9d18685da2b2e6702516a0051\": container with ID starting with 97fa883341f59cb21dca12690d73df9e5b7fa3c9d18685da2b2e6702516a0051 not found: ID does not exist" containerID="97fa883341f59cb21dca12690d73df9e5b7fa3c9d18685da2b2e6702516a0051" Sep 11 08:20:42.416275 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.416188 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97fa883341f59cb21dca12690d73df9e5b7fa3c9d18685da2b2e6702516a0051"} err="failed to get container status \"97fa883341f59cb21dca12690d73df9e5b7fa3c9d18685da2b2e6702516a0051\": rpc error: code = NotFound desc = could not find container \"97fa883341f59cb21dca12690d73df9e5b7fa3c9d18685da2b2e6702516a0051\": container with ID starting with 97fa883341f59cb21dca12690d73df9e5b7fa3c9d18685da2b2e6702516a0051 not found: ID does not exist" Sep 11 08:20:42.416275 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.416221 2566 scope.go:117] "RemoveContainer" containerID="5df99bb9b3e967fb32552cbcc2bf6cd8affb32743ded336f09b455a8ebb8d5a5" Sep 11 08:20:42.416605 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:20:42.416575 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5df99bb9b3e967fb32552cbcc2bf6cd8affb32743ded336f09b455a8ebb8d5a5\": container with ID starting with 5df99bb9b3e967fb32552cbcc2bf6cd8affb32743ded336f09b455a8ebb8d5a5 not found: ID does not exist" containerID="5df99bb9b3e967fb32552cbcc2bf6cd8affb32743ded336f09b455a8ebb8d5a5" Sep 11 08:20:42.416742 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.416620 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5df99bb9b3e967fb32552cbcc2bf6cd8affb32743ded336f09b455a8ebb8d5a5"} err="failed to get container status \"5df99bb9b3e967fb32552cbcc2bf6cd8affb32743ded336f09b455a8ebb8d5a5\": rpc error: code = NotFound desc = could not find container \"5df99bb9b3e967fb32552cbcc2bf6cd8affb32743ded336f09b455a8ebb8d5a5\": container with ID starting with 5df99bb9b3e967fb32552cbcc2bf6cd8affb32743ded336f09b455a8ebb8d5a5 not found: ID does not exist" Sep 11 08:20:42.416742 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.416660 2566 scope.go:117] "RemoveContainer" containerID="2b6727370ecfe74b732a3a7b7a06aa142f65bcdbf8e3f7b82e527bcfebd98f97" Sep 11 08:20:42.417453 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:20:42.417378 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b6727370ecfe74b732a3a7b7a06aa142f65bcdbf8e3f7b82e527bcfebd98f97\": container with ID starting with 2b6727370ecfe74b732a3a7b7a06aa142f65bcdbf8e3f7b82e527bcfebd98f97 not found: ID does not exist" containerID="2b6727370ecfe74b732a3a7b7a06aa142f65bcdbf8e3f7b82e527bcfebd98f97" Sep 11 08:20:42.417453 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.417407 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b6727370ecfe74b732a3a7b7a06aa142f65bcdbf8e3f7b82e527bcfebd98f97"} err="failed to get container status \"2b6727370ecfe74b732a3a7b7a06aa142f65bcdbf8e3f7b82e527bcfebd98f97\": rpc error: code = NotFound desc = could not find container \"2b6727370ecfe74b732a3a7b7a06aa142f65bcdbf8e3f7b82e527bcfebd98f97\": container with ID starting with 2b6727370ecfe74b732a3a7b7a06aa142f65bcdbf8e3f7b82e527bcfebd98f97 not found: ID does not exist" Sep 11 08:20:42.417453 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.417426 2566 scope.go:117] "RemoveContainer" containerID="bec2e1df5d837630ec888cf0bae8cb5c8fe57d3d88830ea5a9f1f686f97e69d6" Sep 11 08:20:42.417720 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:20:42.417702 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bec2e1df5d837630ec888cf0bae8cb5c8fe57d3d88830ea5a9f1f686f97e69d6\": container with ID starting with bec2e1df5d837630ec888cf0bae8cb5c8fe57d3d88830ea5a9f1f686f97e69d6 not found: ID does not exist" containerID="bec2e1df5d837630ec888cf0bae8cb5c8fe57d3d88830ea5a9f1f686f97e69d6" Sep 11 08:20:42.417785 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.417730 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bec2e1df5d837630ec888cf0bae8cb5c8fe57d3d88830ea5a9f1f686f97e69d6"} err="failed to get container status \"bec2e1df5d837630ec888cf0bae8cb5c8fe57d3d88830ea5a9f1f686f97e69d6\": rpc error: code = NotFound desc = could not find container \"bec2e1df5d837630ec888cf0bae8cb5c8fe57d3d88830ea5a9f1f686f97e69d6\": container with ID starting with bec2e1df5d837630ec888cf0bae8cb5c8fe57d3d88830ea5a9f1f686f97e69d6 not found: ID does not exist" Sep 11 08:20:42.417785 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.417751 2566 scope.go:117] "RemoveContainer" containerID="4e154b3ad0ac594e12d14309102bcd4dfef82743668c314c61ff628a34f1350e" Sep 11 08:20:42.418714 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.418702 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5477c4978f-fwbff"] Sep 11 08:20:42.425646 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.425632 2566 scope.go:117] "RemoveContainer" containerID="19c4e6b3382311ffa9849bef24e5097e0ff99fb8cb1210cd52d9ccc4d21eec50" Sep 11 08:20:42.432690 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.432667 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k"] Sep 11 08:20:42.434061 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.434040 2566 scope.go:117] "RemoveContainer" containerID="f2a9f0f352f515311a4075d63e91c5d080de9cc15f12fa9bf23c59438704111f" Sep 11 08:20:42.437483 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.437459 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-8447b878db-8jm7k"] Sep 11 08:20:42.441756 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.441741 2566 scope.go:117] "RemoveContainer" containerID="54191b7f53f7be2f27cffac116fa69a365f9bae084a3b2b119ff7061f7578576" Sep 11 08:20:42.448861 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.448845 2566 scope.go:117] "RemoveContainer" containerID="4e154b3ad0ac594e12d14309102bcd4dfef82743668c314c61ff628a34f1350e" Sep 11 08:20:42.449157 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:20:42.449136 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e154b3ad0ac594e12d14309102bcd4dfef82743668c314c61ff628a34f1350e\": container with ID starting with 4e154b3ad0ac594e12d14309102bcd4dfef82743668c314c61ff628a34f1350e not found: ID does not exist" containerID="4e154b3ad0ac594e12d14309102bcd4dfef82743668c314c61ff628a34f1350e" Sep 11 08:20:42.449242 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.449161 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e154b3ad0ac594e12d14309102bcd4dfef82743668c314c61ff628a34f1350e"} err="failed to get container status \"4e154b3ad0ac594e12d14309102bcd4dfef82743668c314c61ff628a34f1350e\": rpc error: code = NotFound desc = could not find container \"4e154b3ad0ac594e12d14309102bcd4dfef82743668c314c61ff628a34f1350e\": container with ID starting with 4e154b3ad0ac594e12d14309102bcd4dfef82743668c314c61ff628a34f1350e not found: ID does not exist" Sep 11 08:20:42.449242 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.449178 2566 scope.go:117] "RemoveContainer" containerID="19c4e6b3382311ffa9849bef24e5097e0ff99fb8cb1210cd52d9ccc4d21eec50" Sep 11 08:20:42.449441 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:20:42.449424 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19c4e6b3382311ffa9849bef24e5097e0ff99fb8cb1210cd52d9ccc4d21eec50\": container with ID starting with 19c4e6b3382311ffa9849bef24e5097e0ff99fb8cb1210cd52d9ccc4d21eec50 not found: ID does not exist" containerID="19c4e6b3382311ffa9849bef24e5097e0ff99fb8cb1210cd52d9ccc4d21eec50" Sep 11 08:20:42.449504 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.449450 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c4e6b3382311ffa9849bef24e5097e0ff99fb8cb1210cd52d9ccc4d21eec50"} err="failed to get container status \"19c4e6b3382311ffa9849bef24e5097e0ff99fb8cb1210cd52d9ccc4d21eec50\": rpc error: code = NotFound desc = could not find container \"19c4e6b3382311ffa9849bef24e5097e0ff99fb8cb1210cd52d9ccc4d21eec50\": container with ID starting with 19c4e6b3382311ffa9849bef24e5097e0ff99fb8cb1210cd52d9ccc4d21eec50 not found: ID does not exist" Sep 11 08:20:42.449504 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.449472 2566 scope.go:117] "RemoveContainer" containerID="f2a9f0f352f515311a4075d63e91c5d080de9cc15f12fa9bf23c59438704111f" Sep 11 08:20:42.449734 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:20:42.449718 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2a9f0f352f515311a4075d63e91c5d080de9cc15f12fa9bf23c59438704111f\": container with ID starting with f2a9f0f352f515311a4075d63e91c5d080de9cc15f12fa9bf23c59438704111f not found: ID does not exist" containerID="f2a9f0f352f515311a4075d63e91c5d080de9cc15f12fa9bf23c59438704111f" Sep 11 08:20:42.449792 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.449741 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2a9f0f352f515311a4075d63e91c5d080de9cc15f12fa9bf23c59438704111f"} err="failed to get container status \"f2a9f0f352f515311a4075d63e91c5d080de9cc15f12fa9bf23c59438704111f\": rpc error: code = NotFound desc = could not find container \"f2a9f0f352f515311a4075d63e91c5d080de9cc15f12fa9bf23c59438704111f\": container with ID starting with f2a9f0f352f515311a4075d63e91c5d080de9cc15f12fa9bf23c59438704111f not found: ID does not exist" Sep 11 08:20:42.449792 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.449755 2566 scope.go:117] "RemoveContainer" containerID="54191b7f53f7be2f27cffac116fa69a365f9bae084a3b2b119ff7061f7578576" Sep 11 08:20:42.450022 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:20:42.450005 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54191b7f53f7be2f27cffac116fa69a365f9bae084a3b2b119ff7061f7578576\": container with ID starting with 54191b7f53f7be2f27cffac116fa69a365f9bae084a3b2b119ff7061f7578576 not found: ID does not exist" containerID="54191b7f53f7be2f27cffac116fa69a365f9bae084a3b2b119ff7061f7578576" Sep 11 08:20:42.450094 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:42.450026 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54191b7f53f7be2f27cffac116fa69a365f9bae084a3b2b119ff7061f7578576"} err="failed to get container status \"54191b7f53f7be2f27cffac116fa69a365f9bae084a3b2b119ff7061f7578576\": rpc error: code = NotFound desc = could not find container \"54191b7f53f7be2f27cffac116fa69a365f9bae084a3b2b119ff7061f7578576\": container with ID starting with 54191b7f53f7be2f27cffac116fa69a365f9bae084a3b2b119ff7061f7578576 not found: ID does not exist" Sep 11 08:20:43.786509 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:43.786482 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11972679-d6d6-4f47-8376-9da8be98045a" path="/var/lib/kubelet/pods/11972679-d6d6-4f47-8376-9da8be98045a/volumes" Sep 11 08:20:43.787118 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:20:43.786961 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" path="/var/lib/kubelet/pods/6e4fd94d-f169-4ca1-9609-738c4dbe2a42/volumes" Sep 11 08:24:31.870369 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:24:31.870336 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 08:24:31.871293 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:24:31.871272 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 08:29:31.896480 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:29:31.896454 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 08:29:31.897609 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:29:31.897591 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 08:32:37.498654 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.498572 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rjtsw/must-gather-7f4kl"] Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.498934 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="feast-init" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.498967 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="feast-init" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.498982 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97faa1d8-837a-4631-905f-ece0d638de4c" containerName="redis" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.498987 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="97faa1d8-837a-4631-905f-ece0d638de4c" containerName="redis" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.498996 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="registry" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499000 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="registry" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499008 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="feast-init" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499013 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="feast-init" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499019 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="online" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499024 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="online" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499030 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="registry" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499035 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="registry" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499039 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="online" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499043 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="online" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499049 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="feast-apply" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499053 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="feast-apply" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499066 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="feast-apply" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499070 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="feast-apply" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499117 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="online" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499125 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="11972679-d6d6-4f47-8376-9da8be98045a" containerName="registry" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499131 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="online" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499138 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="97faa1d8-837a-4631-905f-ece0d638de4c" containerName="redis" Sep 11 08:32:37.499130 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.499143 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e4fd94d-f169-4ca1-9609-738c4dbe2a42" containerName="registry" Sep 11 08:32:37.502167 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.502152 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rjtsw/must-gather-7f4kl" Sep 11 08:32:37.504278 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.504248 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rjtsw\"/\"kube-root-ca.crt\"" Sep 11 08:32:37.504403 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.504382 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rjtsw\"/\"default-dockercfg-8wm8k\"" Sep 11 08:32:37.504779 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.504761 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rjtsw\"/\"openshift-service-ca.crt\"" Sep 11 08:32:37.510453 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.510424 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rjtsw/must-gather-7f4kl"] Sep 11 08:32:37.576420 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.576372 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/33fde114-e3a6-400a-91d6-cdf80714ea82-must-gather-output\") pod \"must-gather-7f4kl\" (UID: \"33fde114-e3a6-400a-91d6-cdf80714ea82\") " pod="openshift-must-gather-rjtsw/must-gather-7f4kl" Sep 11 08:32:37.576616 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.576504 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj9jr\" (UniqueName: \"kubernetes.io/projected/33fde114-e3a6-400a-91d6-cdf80714ea82-kube-api-access-mj9jr\") pod \"must-gather-7f4kl\" (UID: \"33fde114-e3a6-400a-91d6-cdf80714ea82\") " pod="openshift-must-gather-rjtsw/must-gather-7f4kl" Sep 11 08:32:37.677814 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.677780 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj9jr\" (UniqueName: \"kubernetes.io/projected/33fde114-e3a6-400a-91d6-cdf80714ea82-kube-api-access-mj9jr\") pod \"must-gather-7f4kl\" (UID: \"33fde114-e3a6-400a-91d6-cdf80714ea82\") " pod="openshift-must-gather-rjtsw/must-gather-7f4kl" Sep 11 08:32:37.678052 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.677838 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/33fde114-e3a6-400a-91d6-cdf80714ea82-must-gather-output\") pod \"must-gather-7f4kl\" (UID: \"33fde114-e3a6-400a-91d6-cdf80714ea82\") " pod="openshift-must-gather-rjtsw/must-gather-7f4kl" Sep 11 08:32:37.678237 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.678216 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/33fde114-e3a6-400a-91d6-cdf80714ea82-must-gather-output\") pod \"must-gather-7f4kl\" (UID: \"33fde114-e3a6-400a-91d6-cdf80714ea82\") " pod="openshift-must-gather-rjtsw/must-gather-7f4kl" Sep 11 08:32:37.687794 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.687768 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj9jr\" (UniqueName: \"kubernetes.io/projected/33fde114-e3a6-400a-91d6-cdf80714ea82-kube-api-access-mj9jr\") pod \"must-gather-7f4kl\" (UID: \"33fde114-e3a6-400a-91d6-cdf80714ea82\") " pod="openshift-must-gather-rjtsw/must-gather-7f4kl" Sep 11 08:32:37.810968 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:37.810871 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rjtsw/must-gather-7f4kl" Sep 11 08:32:38.083306 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:38.083150 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rjtsw/must-gather-7f4kl"] Sep 11 08:32:38.085825 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:32:38.085792 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33fde114_e3a6_400a_91d6_cdf80714ea82.slice/crio-85b90c98f1e13a76f1364796df1037dd11d1c4cbf2030fa086587e59e1554a86 WatchSource:0}: Error finding container 85b90c98f1e13a76f1364796df1037dd11d1c4cbf2030fa086587e59e1554a86: Status 404 returned error can't find the container with id 85b90c98f1e13a76f1364796df1037dd11d1c4cbf2030fa086587e59e1554a86 Sep 11 08:32:38.087669 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:38.087653 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 08:32:38.143021 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:38.142991 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rjtsw/must-gather-7f4kl" event={"ID":"33fde114-e3a6-400a-91d6-cdf80714ea82","Type":"ContainerStarted","Data":"85b90c98f1e13a76f1364796df1037dd11d1c4cbf2030fa086587e59e1554a86"} Sep 11 08:32:45.181535 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:45.181498 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rjtsw/must-gather-7f4kl" event={"ID":"33fde114-e3a6-400a-91d6-cdf80714ea82","Type":"ContainerStarted","Data":"436022f00bd9b5596a1847e9002a0eb80a63ad17e3cd1d0710ea6f499a1c472c"} Sep 11 08:32:45.182004 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:45.181549 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rjtsw/must-gather-7f4kl" event={"ID":"33fde114-e3a6-400a-91d6-cdf80714ea82","Type":"ContainerStarted","Data":"b04613202c85978b33f5e9972561dc0d62d013c24d3668c4c8da181c93ccb514"} Sep 11 08:32:45.203239 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:45.203180 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rjtsw/must-gather-7f4kl" podStartSLOduration=2.057122835 podStartE2EDuration="8.203164615s" totalImagesPullingTime="6.14604178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:32:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:32:45.201982794 +0000 UTC m=+1993.895347900" watchObservedRunningTime="2026-09-11 08:32:45.203164615 +0000 UTC m=+1993.896529720" Sep 11 08:32:54.220860 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:54.220828 2566 generic.go:356] "Generic (PLEG): container finished" podID="33fde114-e3a6-400a-91d6-cdf80714ea82" containerID="b04613202c85978b33f5e9972561dc0d62d013c24d3668c4c8da181c93ccb514" exitCode=0 Sep 11 08:32:54.221334 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:54.220902 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rjtsw/must-gather-7f4kl" event={"ID":"33fde114-e3a6-400a-91d6-cdf80714ea82","Type":"ContainerDied","Data":"b04613202c85978b33f5e9972561dc0d62d013c24d3668c4c8da181c93ccb514"} Sep 11 08:32:54.221334 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:54.221204 2566 scope.go:117] "RemoveContainer" containerID="b04613202c85978b33f5e9972561dc0d62d013c24d3668c4c8da181c93ccb514" Sep 11 08:32:54.902196 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:54.902165 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-rjtsw_must-gather-7f4kl_33fde114-e3a6-400a-91d6-cdf80714ea82/gather/0.log" Sep 11 08:32:58.371133 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:58.371099 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bn9jv_52fa5833-1275-4b8c-a8d7-74ad6fee8531/global-pull-secret-syncer/0.log" Sep 11 08:32:58.639703 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:58.639633 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cwt9j_f5f8e54c-7423-45c3-ac35-955837d2b94f/konnectivity-agent/0.log" Sep 11 08:32:58.768048 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:32:58.768009 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-13.ec2.internal_ccad160e38c411773147acccf0c917ed/haproxy/0.log" Sep 11 08:33:00.222596 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:00.222553 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-rjtsw/must-gather-7f4kl"] Sep 11 08:33:00.223076 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:00.222775 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-rjtsw/must-gather-7f4kl" podUID="33fde114-e3a6-400a-91d6-cdf80714ea82" containerName="copy" containerID="cri-o://436022f00bd9b5596a1847e9002a0eb80a63ad17e3cd1d0710ea6f499a1c472c" gracePeriod=2 Sep 11 08:33:00.227334 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:00.227306 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-rjtsw/must-gather-7f4kl"] Sep 11 08:33:00.449912 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:00.449890 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-rjtsw_must-gather-7f4kl_33fde114-e3a6-400a-91d6-cdf80714ea82/copy/0.log" Sep 11 08:33:00.451356 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:00.451334 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rjtsw/must-gather-7f4kl" Sep 11 08:33:00.453928 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:33:00.453903 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-7f4kl\" is forbidden: User \"system:node:ip-10-0-142-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rjtsw\": no relationship found between node 'ip-10-0-142-13.ec2.internal' and this object" podUID="33fde114-e3a6-400a-91d6-cdf80714ea82" pod="openshift-must-gather-rjtsw/must-gather-7f4kl" Sep 11 08:33:00.469319 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:00.469297 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/33fde114-e3a6-400a-91d6-cdf80714ea82-must-gather-output\") pod \"33fde114-e3a6-400a-91d6-cdf80714ea82\" (UID: \"33fde114-e3a6-400a-91d6-cdf80714ea82\") " Sep 11 08:33:00.469406 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:00.469344 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mj9jr\" (UniqueName: \"kubernetes.io/projected/33fde114-e3a6-400a-91d6-cdf80714ea82-kube-api-access-mj9jr\") pod \"33fde114-e3a6-400a-91d6-cdf80714ea82\" (UID: \"33fde114-e3a6-400a-91d6-cdf80714ea82\") " Sep 11 08:33:00.469605 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:00.469584 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33fde114-e3a6-400a-91d6-cdf80714ea82-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "33fde114-e3a6-400a-91d6-cdf80714ea82" (UID: "33fde114-e3a6-400a-91d6-cdf80714ea82"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 08:33:00.471501 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:00.471477 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33fde114-e3a6-400a-91d6-cdf80714ea82-kube-api-access-mj9jr" (OuterVolumeSpecName: "kube-api-access-mj9jr") pod "33fde114-e3a6-400a-91d6-cdf80714ea82" (UID: "33fde114-e3a6-400a-91d6-cdf80714ea82"). InnerVolumeSpecName "kube-api-access-mj9jr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:33:00.570014 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:00.569991 2566 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/33fde114-e3a6-400a-91d6-cdf80714ea82-must-gather-output\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:33:00.570014 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:00.570011 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mj9jr\" (UniqueName: \"kubernetes.io/projected/33fde114-e3a6-400a-91d6-cdf80714ea82-kube-api-access-mj9jr\") on node \"ip-10-0-142-13.ec2.internal\" DevicePath \"\"" Sep 11 08:33:01.250992 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:01.250965 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-rjtsw_must-gather-7f4kl_33fde114-e3a6-400a-91d6-cdf80714ea82/copy/0.log" Sep 11 08:33:01.251422 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:01.251343 2566 generic.go:356] "Generic (PLEG): container finished" podID="33fde114-e3a6-400a-91d6-cdf80714ea82" containerID="436022f00bd9b5596a1847e9002a0eb80a63ad17e3cd1d0710ea6f499a1c472c" exitCode=143 Sep 11 08:33:01.251422 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:01.251383 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rjtsw/must-gather-7f4kl" Sep 11 08:33:01.251513 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:01.251440 2566 scope.go:117] "RemoveContainer" containerID="436022f00bd9b5596a1847e9002a0eb80a63ad17e3cd1d0710ea6f499a1c472c" Sep 11 08:33:01.253499 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:33:01.253469 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-7f4kl\" is forbidden: User \"system:node:ip-10-0-142-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rjtsw\": no relationship found between node 'ip-10-0-142-13.ec2.internal' and this object" podUID="33fde114-e3a6-400a-91d6-cdf80714ea82" pod="openshift-must-gather-rjtsw/must-gather-7f4kl" Sep 11 08:33:01.259365 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:01.259344 2566 scope.go:117] "RemoveContainer" containerID="b04613202c85978b33f5e9972561dc0d62d013c24d3668c4c8da181c93ccb514" Sep 11 08:33:01.261228 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:33:01.261208 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-7f4kl\" is forbidden: User \"system:node:ip-10-0-142-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rjtsw\": no relationship found between node 'ip-10-0-142-13.ec2.internal' and this object" podUID="33fde114-e3a6-400a-91d6-cdf80714ea82" pod="openshift-must-gather-rjtsw/must-gather-7f4kl" Sep 11 08:33:01.270566 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:01.270550 2566 scope.go:117] "RemoveContainer" containerID="436022f00bd9b5596a1847e9002a0eb80a63ad17e3cd1d0710ea6f499a1c472c" Sep 11 08:33:01.270832 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:33:01.270816 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"436022f00bd9b5596a1847e9002a0eb80a63ad17e3cd1d0710ea6f499a1c472c\": container with ID starting with 436022f00bd9b5596a1847e9002a0eb80a63ad17e3cd1d0710ea6f499a1c472c not found: ID does not exist" containerID="436022f00bd9b5596a1847e9002a0eb80a63ad17e3cd1d0710ea6f499a1c472c" Sep 11 08:33:01.270882 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:01.270841 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"436022f00bd9b5596a1847e9002a0eb80a63ad17e3cd1d0710ea6f499a1c472c"} err="failed to get container status \"436022f00bd9b5596a1847e9002a0eb80a63ad17e3cd1d0710ea6f499a1c472c\": rpc error: code = NotFound desc = could not find container \"436022f00bd9b5596a1847e9002a0eb80a63ad17e3cd1d0710ea6f499a1c472c\": container with ID starting with 436022f00bd9b5596a1847e9002a0eb80a63ad17e3cd1d0710ea6f499a1c472c not found: ID does not exist" Sep 11 08:33:01.270882 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:01.270858 2566 scope.go:117] "RemoveContainer" containerID="b04613202c85978b33f5e9972561dc0d62d013c24d3668c4c8da181c93ccb514" Sep 11 08:33:01.271132 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:33:01.271117 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b04613202c85978b33f5e9972561dc0d62d013c24d3668c4c8da181c93ccb514\": container with ID starting with b04613202c85978b33f5e9972561dc0d62d013c24d3668c4c8da181c93ccb514 not found: ID does not exist" containerID="b04613202c85978b33f5e9972561dc0d62d013c24d3668c4c8da181c93ccb514" Sep 11 08:33:01.271181 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:01.271136 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b04613202c85978b33f5e9972561dc0d62d013c24d3668c4c8da181c93ccb514"} err="failed to get container status \"b04613202c85978b33f5e9972561dc0d62d013c24d3668c4c8da181c93ccb514\": rpc error: code = NotFound desc = could not find container \"b04613202c85978b33f5e9972561dc0d62d013c24d3668c4c8da181c93ccb514\": container with ID starting with b04613202c85978b33f5e9972561dc0d62d013c24d3668c4c8da181c93ccb514 not found: ID does not exist" Sep 11 08:33:01.718531 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:01.718496 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8480ca0d-41f3-45a3-8c90-9c721d235206/alertmanager/0.log" Sep 11 08:33:01.762307 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:01.762284 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8480ca0d-41f3-45a3-8c90-9c721d235206/config-reloader/0.log" Sep 11 08:33:01.789576 ip-10-0-142-13 kubenswrapper[2566]: E0911 08:33:01.789539 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-7f4kl\" is forbidden: User \"system:node:ip-10-0-142-13.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rjtsw\": no relationship found between node 'ip-10-0-142-13.ec2.internal' and this object" podUID="33fde114-e3a6-400a-91d6-cdf80714ea82" pod="openshift-must-gather-rjtsw/must-gather-7f4kl" Sep 11 08:33:01.792047 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:01.792025 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33fde114-e3a6-400a-91d6-cdf80714ea82" path="/var/lib/kubelet/pods/33fde114-e3a6-400a-91d6-cdf80714ea82/volumes" Sep 11 08:33:01.816064 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:01.816040 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8480ca0d-41f3-45a3-8c90-9c721d235206/kube-rbac-proxy-web/0.log" Sep 11 08:33:01.856081 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:01.856055 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8480ca0d-41f3-45a3-8c90-9c721d235206/kube-rbac-proxy/0.log" Sep 11 08:33:01.899115 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:01.899096 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8480ca0d-41f3-45a3-8c90-9c721d235206/kube-rbac-proxy-metric/0.log" Sep 11 08:33:01.938028 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:01.938004 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8480ca0d-41f3-45a3-8c90-9c721d235206/prom-label-proxy/0.log" Sep 11 08:33:01.966254 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:01.966232 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8480ca0d-41f3-45a3-8c90-9c721d235206/init-config-reloader/0.log" Sep 11 08:33:02.063829 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:02.063764 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-kdnrz_540c9aba-acc3-49ba-9972-09dd84125f98/kube-state-metrics/0.log" Sep 11 08:33:02.100830 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:02.100811 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-kdnrz_540c9aba-acc3-49ba-9972-09dd84125f98/kube-rbac-proxy-main/0.log" Sep 11 08:33:02.142065 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:02.142042 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-kdnrz_540c9aba-acc3-49ba-9972-09dd84125f98/kube-rbac-proxy-self/0.log" Sep 11 08:33:02.575769 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:02.575743 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8mqg_75601bf7-1576-41a7-80d0-c627a1f9e23a/node-exporter/0.log" Sep 11 08:33:02.613747 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:02.613723 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8mqg_75601bf7-1576-41a7-80d0-c627a1f9e23a/kube-rbac-proxy/0.log" Sep 11 08:33:02.649402 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:02.649380 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8mqg_75601bf7-1576-41a7-80d0-c627a1f9e23a/init-textfile/0.log" Sep 11 08:33:03.153260 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:03.153230 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7688d866bc-87d2z_0447e0f9-6bfa-4195-ba3a-8fa394afc32d/telemeter-client/0.log" Sep 11 08:33:03.192863 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:03.192841 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7688d866bc-87d2z_0447e0f9-6bfa-4195-ba3a-8fa394afc32d/reload/0.log" Sep 11 08:33:03.242843 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:03.242815 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7688d866bc-87d2z_0447e0f9-6bfa-4195-ba3a-8fa394afc32d/kube-rbac-proxy/0.log" Sep 11 08:33:03.292867 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:03.292834 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8bc5b84-zzhtn_4b3027a9-b301-4689-95e3-4f2f2d4e2bc1/thanos-query/0.log" Sep 11 08:33:03.379336 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:03.379314 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8bc5b84-zzhtn_4b3027a9-b301-4689-95e3-4f2f2d4e2bc1/kube-rbac-proxy-web/0.log" Sep 11 08:33:03.454741 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:03.454673 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8bc5b84-zzhtn_4b3027a9-b301-4689-95e3-4f2f2d4e2bc1/kube-rbac-proxy/0.log" Sep 11 08:33:03.492271 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:03.492252 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8bc5b84-zzhtn_4b3027a9-b301-4689-95e3-4f2f2d4e2bc1/prom-label-proxy/0.log" Sep 11 08:33:03.539591 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:03.539564 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8bc5b84-zzhtn_4b3027a9-b301-4689-95e3-4f2f2d4e2bc1/kube-rbac-proxy-rules/0.log" Sep 11 08:33:03.610773 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:03.610747 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8bc5b84-zzhtn_4b3027a9-b301-4689-95e3-4f2f2d4e2bc1/kube-rbac-proxy-metrics/0.log" Sep 11 08:33:05.304428 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.304393 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8"] Sep 11 08:33:05.304880 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.304704 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33fde114-e3a6-400a-91d6-cdf80714ea82" containerName="gather" Sep 11 08:33:05.304880 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.304714 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="33fde114-e3a6-400a-91d6-cdf80714ea82" containerName="gather" Sep 11 08:33:05.304880 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.304723 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33fde114-e3a6-400a-91d6-cdf80714ea82" containerName="copy" Sep 11 08:33:05.304880 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.304728 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="33fde114-e3a6-400a-91d6-cdf80714ea82" containerName="copy" Sep 11 08:33:05.304880 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.304780 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="33fde114-e3a6-400a-91d6-cdf80714ea82" containerName="gather" Sep 11 08:33:05.304880 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.304789 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="33fde114-e3a6-400a-91d6-cdf80714ea82" containerName="copy" Sep 11 08:33:05.306556 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.306531 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:05.308881 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.308859 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9dvm5\"/\"kube-root-ca.crt\"" Sep 11 08:33:05.309019 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.308862 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9dvm5\"/\"default-dockercfg-mt8rk\"" Sep 11 08:33:05.309427 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.309403 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9dvm5\"/\"openshift-service-ca.crt\"" Sep 11 08:33:05.309817 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.309800 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8"] Sep 11 08:33:05.407049 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.407022 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71f8ab62-632c-4168-bf75-990418ea2c4c-lib-modules\") pod \"perf-node-gather-daemonset-pkqh8\" (UID: \"71f8ab62-632c-4168-bf75-990418ea2c4c\") " pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:05.407049 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.407049 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71f8ab62-632c-4168-bf75-990418ea2c4c-sys\") pod \"perf-node-gather-daemonset-pkqh8\" (UID: \"71f8ab62-632c-4168-bf75-990418ea2c4c\") " pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:05.407262 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.407066 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/71f8ab62-632c-4168-bf75-990418ea2c4c-proc\") pod \"perf-node-gather-daemonset-pkqh8\" (UID: \"71f8ab62-632c-4168-bf75-990418ea2c4c\") " pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:05.407262 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.407096 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/71f8ab62-632c-4168-bf75-990418ea2c4c-podres\") pod \"perf-node-gather-daemonset-pkqh8\" (UID: \"71f8ab62-632c-4168-bf75-990418ea2c4c\") " pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:05.407262 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.407146 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-985gx\" (UniqueName: \"kubernetes.io/projected/71f8ab62-632c-4168-bf75-990418ea2c4c-kube-api-access-985gx\") pod \"perf-node-gather-daemonset-pkqh8\" (UID: \"71f8ab62-632c-4168-bf75-990418ea2c4c\") " pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:05.508161 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.508130 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71f8ab62-632c-4168-bf75-990418ea2c4c-lib-modules\") pod \"perf-node-gather-daemonset-pkqh8\" (UID: \"71f8ab62-632c-4168-bf75-990418ea2c4c\") " pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:05.508323 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.508163 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71f8ab62-632c-4168-bf75-990418ea2c4c-sys\") pod \"perf-node-gather-daemonset-pkqh8\" (UID: \"71f8ab62-632c-4168-bf75-990418ea2c4c\") " pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:05.508323 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.508188 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/71f8ab62-632c-4168-bf75-990418ea2c4c-proc\") pod \"perf-node-gather-daemonset-pkqh8\" (UID: \"71f8ab62-632c-4168-bf75-990418ea2c4c\") " pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:05.508323 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.508229 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/71f8ab62-632c-4168-bf75-990418ea2c4c-podres\") pod \"perf-node-gather-daemonset-pkqh8\" (UID: \"71f8ab62-632c-4168-bf75-990418ea2c4c\") " pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:05.508323 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.508257 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71f8ab62-632c-4168-bf75-990418ea2c4c-sys\") pod \"perf-node-gather-daemonset-pkqh8\" (UID: \"71f8ab62-632c-4168-bf75-990418ea2c4c\") " pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:05.508323 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.508273 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-985gx\" (UniqueName: \"kubernetes.io/projected/71f8ab62-632c-4168-bf75-990418ea2c4c-kube-api-access-985gx\") pod \"perf-node-gather-daemonset-pkqh8\" (UID: \"71f8ab62-632c-4168-bf75-990418ea2c4c\") " pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:05.508323 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.508297 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71f8ab62-632c-4168-bf75-990418ea2c4c-lib-modules\") pod \"perf-node-gather-daemonset-pkqh8\" (UID: \"71f8ab62-632c-4168-bf75-990418ea2c4c\") " pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:05.508667 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.508327 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/71f8ab62-632c-4168-bf75-990418ea2c4c-proc\") pod \"perf-node-gather-daemonset-pkqh8\" (UID: \"71f8ab62-632c-4168-bf75-990418ea2c4c\") " pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:05.508667 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.508343 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/71f8ab62-632c-4168-bf75-990418ea2c4c-podres\") pod \"perf-node-gather-daemonset-pkqh8\" (UID: \"71f8ab62-632c-4168-bf75-990418ea2c4c\") " pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:05.518446 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.518424 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-985gx\" (UniqueName: \"kubernetes.io/projected/71f8ab62-632c-4168-bf75-990418ea2c4c-kube-api-access-985gx\") pod \"perf-node-gather-daemonset-pkqh8\" (UID: \"71f8ab62-632c-4168-bf75-990418ea2c4c\") " pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:05.617042 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.616959 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:05.743099 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.743072 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-bl6hb_96d1bce2-bfd5-4f80-9b61-a2bdf0f7ff56/download-server/0.log" Sep 11 08:33:05.887708 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:05.887683 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8"] Sep 11 08:33:05.890121 ip-10-0-142-13 kubenswrapper[2566]: W0911 08:33:05.890094 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod71f8ab62_632c_4168_bf75_990418ea2c4c.slice/crio-39e6ca8c928b7a3fd6c0f92e2ab8d67e775d5f0e64a745013650682d9952b3ac WatchSource:0}: Error finding container 39e6ca8c928b7a3fd6c0f92e2ab8d67e775d5f0e64a745013650682d9952b3ac: Status 404 returned error can't find the container with id 39e6ca8c928b7a3fd6c0f92e2ab8d67e775d5f0e64a745013650682d9952b3ac Sep 11 08:33:06.240930 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:06.240900 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-zhgrq_61532458-6095-4fb3-bc2f-5a0a16902be6/volume-data-source-validator/0.log" Sep 11 08:33:06.272490 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:06.272459 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" event={"ID":"71f8ab62-632c-4168-bf75-990418ea2c4c","Type":"ContainerStarted","Data":"9bab33749a4c8d9747d2a836f1a2015b0c77b0ead6e9c8e9c6f3a36b29f397ec"} Sep 11 08:33:06.272660 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:06.272506 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" event={"ID":"71f8ab62-632c-4168-bf75-990418ea2c4c","Type":"ContainerStarted","Data":"39e6ca8c928b7a3fd6c0f92e2ab8d67e775d5f0e64a745013650682d9952b3ac"} Sep 11 08:33:06.272660 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:06.272569 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:06.293601 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:06.293555 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" podStartSLOduration=1.29354085 podStartE2EDuration="1.29354085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 08:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:33:06.29209891 +0000 UTC m=+2014.985464016" watchObservedRunningTime="2026-09-11 08:33:06.29354085 +0000 UTC m=+2014.986905956" Sep 11 08:33:07.239915 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:07.239891 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hcwhz_1f34985f-637a-4d5e-a0a9-67181090b361/dns/0.log" Sep 11 08:33:07.265263 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:07.265232 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hcwhz_1f34985f-637a-4d5e-a0a9-67181090b361/kube-rbac-proxy/0.log" Sep 11 08:33:07.372739 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:07.372713 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kxv89_ab5b4e73-cc00-407a-a103-9bdb0721cd6e/dns-node-resolver/0.log" Sep 11 08:33:07.875438 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:07.875403 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75668786cb-bvcks_ed1d0bec-274f-4377-947e-93d17a5430c6/registry/0.log" Sep 11 08:33:07.899588 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:07.899562 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5jmtt_3027cbb6-dcdd-4888-ad76-6f7304468c90/node-ca/0.log" Sep 11 08:33:09.215431 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:09.215407 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-996qn_829c494b-8597-4f21-b062-ddaf585c527c/serve-healthcheck-canary/0.log" Sep 11 08:33:09.686346 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:09.686317 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-dfbs4_fb46297f-c9c2-4169-8d9f-128b7af240b3/insights-operator/0.log" Sep 11 08:33:09.686807 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:09.686789 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-dfbs4_fb46297f-c9c2-4169-8d9f-128b7af240b3/insights-operator/1.log" Sep 11 08:33:09.709868 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:09.709847 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ckf7k_7507a76c-ad19-44ab-a11d-2a026642a18f/kube-rbac-proxy/0.log" Sep 11 08:33:09.736132 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:09.736102 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ckf7k_7507a76c-ad19-44ab-a11d-2a026642a18f/exporter/0.log" Sep 11 08:33:09.766658 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:09.766636 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ckf7k_7507a76c-ad19-44ab-a11d-2a026642a18f/extractor/0.log" Sep 11 08:33:12.286258 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:12.286234 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9dvm5/perf-node-gather-daemonset-pkqh8" Sep 11 08:33:15.585627 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:15.585594 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-l42k9_355f2490-ff55-4f47-a7fc-c51d26eed56f/kube-storage-version-migrator-operator/1.log" Sep 11 08:33:15.586362 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:15.586343 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-l42k9_355f2490-ff55-4f47-a7fc-c51d26eed56f/kube-storage-version-migrator-operator/0.log" Sep 11 08:33:17.157088 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:17.157057 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpk9z_ce19aa94-ccc3-4aac-94b4-0c830c4d20c9/kube-multus-additional-cni-plugins/0.log" Sep 11 08:33:17.219649 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:17.219608 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpk9z_ce19aa94-ccc3-4aac-94b4-0c830c4d20c9/egress-router-binary-copy/0.log" Sep 11 08:33:17.272380 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:17.272355 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpk9z_ce19aa94-ccc3-4aac-94b4-0c830c4d20c9/cni-plugins/0.log" Sep 11 08:33:17.308917 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:17.308889 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpk9z_ce19aa94-ccc3-4aac-94b4-0c830c4d20c9/bond-cni-plugin/0.log" Sep 11 08:33:17.340763 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:17.340741 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpk9z_ce19aa94-ccc3-4aac-94b4-0c830c4d20c9/routeoverride-cni/0.log" Sep 11 08:33:17.380331 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:17.380306 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpk9z_ce19aa94-ccc3-4aac-94b4-0c830c4d20c9/whereabouts-cni-bincopy/0.log" Sep 11 08:33:17.418824 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:17.418768 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpk9z_ce19aa94-ccc3-4aac-94b4-0c830c4d20c9/whereabouts-cni/0.log" Sep 11 08:33:17.837236 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:17.837164 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lg5vk_b2c44f58-c837-4e3f-bf32-b3ec7f789118/kube-multus/0.log" Sep 11 08:33:18.003490 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:18.003462 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t6dx2_67dde785-fd0c-4213-81d9-bfb6374f6f13/network-metrics-daemon/0.log" Sep 11 08:33:18.033903 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:18.033871 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t6dx2_67dde785-fd0c-4213-81d9-bfb6374f6f13/kube-rbac-proxy/0.log" Sep 11 08:33:19.731136 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:19.731111 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-controller/0.log" Sep 11 08:33:19.761361 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:19.761341 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/0.log" Sep 11 08:33:19.761539 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:19.761523 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovn-acl-logging/1.log" Sep 11 08:33:19.795344 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:19.795326 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/kube-rbac-proxy-node/0.log" Sep 11 08:33:19.876124 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:19.876099 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/kube-rbac-proxy-ovn-metrics/0.log" Sep 11 08:33:19.941538 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:19.941513 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/northd/0.log" Sep 11 08:33:19.974536 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:19.974514 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/nbdb/0.log" Sep 11 08:33:20.009627 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:20.009571 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/sbdb/0.log" Sep 11 08:33:20.047327 ip-10-0-142-13 kubenswrapper[2566]: I0911 08:33:20.047303 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9ljvr_ca7290a6-e3c2-46ca-a76f-15a2c63e8b97/ovnkube-controller/0.log"