Sep 10 15:55:50.330504 ip-10-0-131-28 systemd[1]: Starting Kubernetes Kubelet... Sep 10 15:55:50.741100 ip-10-0-131-28 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 15:55:50.741100 ip-10-0-131-28 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 15:55:50.741100 ip-10-0-131-28 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 15:55:50.741100 ip-10-0-131-28 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 15:55:50.741100 ip-10-0-131-28 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 15:55:50.742770 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.741222 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 15:55:50.745873 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745857 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 15:55:50.745873 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745873 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745876 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745880 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745883 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745886 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745889 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745892 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745894 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745897 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745899 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745902 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745905 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745908 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745911 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745913 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745916 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745918 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745921 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745923 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745926 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 15:55:50.745954 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745929 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745932 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745935 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745938 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745941 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745943 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745946 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745948 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745951 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745953 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745956 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745959 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745962 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745965 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745967 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745977 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745979 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745982 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745986 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 15:55:50.746461 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745990 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745993 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745996 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.745999 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746002 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746004 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746007 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746012 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746015 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746018 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746021 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746023 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746026 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746029 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746033 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746037 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746041 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746044 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746048 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 15:55:50.746924 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746051 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746053 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746056 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746058 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746061 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746063 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746066 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746068 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746071 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746073 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746076 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746078 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746081 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746083 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746086 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746088 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746091 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746094 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746096 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746098 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 15:55:50.747402 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746101 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746104 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746107 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746110 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746112 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746115 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746118 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746121 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746124 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746126 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746129 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746132 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746134 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746137 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746139 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746142 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746144 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746146 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746149 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746151 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 15:55:50.747889 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746828 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746835 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746838 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746841 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746844 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746846 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746849 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746851 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746854 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746857 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746859 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746862 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746864 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746866 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746870 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746874 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746878 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746882 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746884 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 15:55:50.748392 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746887 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746891 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746893 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746896 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746899 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746901 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746904 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746907 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746910 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746912 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746915 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746917 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746920 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746923 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746926 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746928 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746931 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746933 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746937 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 15:55:50.748867 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746939 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746942 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746944 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746948 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746951 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746954 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746958 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746961 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746963 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746966 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746970 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746974 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746977 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746980 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746983 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746986 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746989 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746992 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746994 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 15:55:50.749348 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746997 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.746999 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747002 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747004 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747007 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747010 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747012 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747015 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747017 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747020 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747022 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747025 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747029 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747031 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747034 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747036 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747039 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747042 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747044 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 15:55:50.749812 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747047 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747049 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747051 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747055 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747058 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747060 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747063 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747066 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747068 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747071 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747073 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747076 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747078 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747081 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747083 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747086 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747088 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747091 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747093 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747096 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 15:55:50.750298 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747098 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747101 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747103 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747524 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747530 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747533 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747537 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747539 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747542 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747545 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747548 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747551 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747554 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747556 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747559 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747562 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747565 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747568 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747571 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 15:55:50.750808 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747574 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747576 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747579 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747581 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747584 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747586 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747589 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747591 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747594 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747596 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747599 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747602 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747604 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747607 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747609 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747611 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747614 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747617 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747619 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747622 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 15:55:50.751312 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747625 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747627 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747630 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747632 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747635 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747637 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747640 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747642 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747645 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747648 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747651 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747653 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747656 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747658 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747661 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747663 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747666 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747669 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747672 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 15:55:50.751779 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747675 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747679 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747682 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747685 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747687 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747689 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747692 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747694 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747697 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747700 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747703 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747705 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747708 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747710 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747713 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747715 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747718 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747720 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747722 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747725 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 15:55:50.752258 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747727 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747730 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747733 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747735 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747738 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747741 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747743 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747746 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747748 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747751 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747753 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747759 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747762 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747765 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747769 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747772 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747775 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747778 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747781 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 15:55:50.752775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747783 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747790 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747792 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747795 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.747797 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747858 2574 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747899 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747908 2574 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747913 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747917 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747920 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747924 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747929 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747933 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747936 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747940 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747943 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747946 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747951 2574 flags.go:64] FLAG: --cgroup-root="" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747954 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747957 2574 flags.go:64] FLAG: --client-ca-file="" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747959 2574 flags.go:64] FLAG: --cloud-provider="external" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747962 2574 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747967 2574 flags.go:64] FLAG: --cluster-domain="" Sep 10 15:55:50.753249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747969 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747973 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747976 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747979 2574 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747983 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747985 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747988 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747991 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747994 2574 flags.go:64] FLAG: --contention-profiling="false" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.747998 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748001 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748004 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748007 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748011 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748014 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748017 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748020 2574 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748023 2574 flags.go:64] FLAG: --enable-server="true" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748026 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748031 2574 flags.go:64] FLAG: --event-burst="100" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748034 2574 flags.go:64] FLAG: --event-qps="50" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748038 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748041 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748044 2574 flags.go:64] FLAG: --eviction-hard="" Sep 10 15:55:50.753813 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748047 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748050 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748053 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748057 2574 flags.go:64] FLAG: --eviction-soft="" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748060 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748063 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748066 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748068 2574 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748071 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748074 2574 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748077 2574 flags.go:64] FLAG: --feature-gates="" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748081 2574 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748083 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748086 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748089 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748092 2574 flags.go:64] FLAG: --healthz-port="10248" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748095 2574 flags.go:64] FLAG: --help="false" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748098 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-131-28.ec2.internal" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748101 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748104 2574 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748107 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748110 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748115 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748117 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 15:55:50.754440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748120 2574 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748123 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748126 2574 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748129 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748132 2574 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748135 2574 flags.go:64] FLAG: --kube-reserved="" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748138 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748141 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748144 2574 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748147 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748149 2574 flags.go:64] FLAG: --lock-file="" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748152 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748155 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748158 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748164 2574 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748167 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748169 2574 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748172 2574 flags.go:64] FLAG: --logging-format="text" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748175 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748178 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748181 2574 flags.go:64] FLAG: --manifest-url="" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748184 2574 flags.go:64] FLAG: --manifest-url-header="" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748188 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748191 2574 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748207 2574 flags.go:64] FLAG: --max-pods="110" Sep 10 15:55:50.755044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748210 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748213 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748216 2574 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748219 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748222 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748225 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748228 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748235 2574 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748238 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748241 2574 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748244 2574 flags.go:64] FLAG: --pod-cidr="" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748247 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748252 2574 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748257 2574 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748260 2574 flags.go:64] FLAG: --pods-per-core="0" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748263 2574 flags.go:64] FLAG: --port="10250" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748265 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748268 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c5a23c3ba9cc2f95" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748272 2574 flags.go:64] FLAG: --qos-reserved="" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748275 2574 flags.go:64] FLAG: --read-only-port="10255" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748278 2574 flags.go:64] FLAG: --register-node="true" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748281 2574 flags.go:64] FLAG: --register-with-taints="" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748285 2574 flags.go:64] FLAG: --registry-burst="10" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748287 2574 flags.go:64] FLAG: --registry-qps="5" Sep 10 15:55:50.755659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748290 2574 flags.go:64] FLAG: --reserved-cpus="" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748293 2574 flags.go:64] FLAG: --reserved-memory="" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748297 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748300 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748303 2574 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748305 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748308 2574 flags.go:64] FLAG: --runonce="false" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748311 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748314 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748318 2574 flags.go:64] FLAG: --seccomp-default="false" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748321 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748324 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748326 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748330 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748333 2574 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748336 2574 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748339 2574 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748341 2574 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748344 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748347 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748350 2574 flags.go:64] FLAG: --system-cgroups="" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748353 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748359 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748361 2574 flags.go:64] FLAG: --tls-cert-file="" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748364 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 15:55:50.756353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748368 2574 flags.go:64] FLAG: --tls-min-version="" Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748371 2574 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748374 2574 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748377 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748380 2574 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748383 2574 flags.go:64] FLAG: --v="2" Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748387 2574 flags.go:64] FLAG: --version="false" Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748391 2574 flags.go:64] FLAG: --vmodule="" Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748394 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.748398 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748526 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748530 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748535 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748538 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748541 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748546 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748549 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748551 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748554 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748556 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748559 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 15:55:50.756973 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748562 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748564 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748567 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748569 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748572 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748575 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748578 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748581 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748584 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748586 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748589 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748592 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748594 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748597 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748599 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748602 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748605 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748608 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748610 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748613 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 15:55:50.757529 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748615 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748618 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748620 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748623 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748625 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748628 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748631 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748634 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748637 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748639 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748642 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748644 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748647 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748649 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748652 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748654 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748657 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748659 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748662 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748665 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 15:55:50.758037 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748668 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748671 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748673 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748676 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748679 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748681 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748684 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748687 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748689 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748692 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748695 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748697 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748702 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748705 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748708 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748711 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748714 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748718 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748723 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 15:55:50.758542 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748726 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748728 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748731 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748733 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748736 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748739 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748741 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748744 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748746 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748749 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748751 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748754 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748758 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748760 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748763 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748765 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748768 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748770 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748773 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748775 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 15:55:50.759019 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748778 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 15:55:50.759606 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748781 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 15:55:50.759606 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748783 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 15:55:50.759606 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748787 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 15:55:50.759606 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748790 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 15:55:50.759606 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748792 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 15:55:50.759606 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748795 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 15:55:50.759606 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748797 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 15:55:50.759606 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.748800 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 15:55:50.759606 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.749558 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 15:55:50.759606 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.756591 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 15:55:50.759606 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.756605 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 15:55:50.759606 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.758360 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 15:55:50.759606 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.758368 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 15:55:50.759606 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758429 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 15:55:50.759606 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758434 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758437 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758440 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758443 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758446 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758448 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758451 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758454 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758457 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758459 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758462 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758464 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758467 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758470 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758472 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758475 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758478 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758480 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758483 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758485 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 15:55:50.759974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758488 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758490 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758493 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758495 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758498 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758500 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758503 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758506 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758510 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758512 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758515 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758518 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758520 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758523 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758526 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758529 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758531 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758534 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758536 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 15:55:50.760487 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758539 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758541 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758544 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758547 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758549 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758552 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758555 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758557 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758560 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758563 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758566 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758568 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758571 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758573 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758576 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758579 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758581 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758584 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758586 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758590 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 15:55:50.760974 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758593 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758595 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758599 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758602 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758604 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758607 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758609 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758612 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758616 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758620 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758623 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758626 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758629 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758631 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758635 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758637 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758640 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758643 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758646 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758649 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 15:55:50.761471 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758651 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758655 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758659 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758662 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758665 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758669 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758673 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758675 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758678 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758680 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758683 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758686 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758689 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758692 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758695 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758698 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758701 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758703 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 15:55:50.761952 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758706 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 15:55:50.762410 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.758711 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 15:55:50.762410 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758822 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 15:55:50.762410 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758827 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 15:55:50.762410 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758831 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 15:55:50.762410 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758834 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 15:55:50.762410 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758837 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 15:55:50.762410 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758840 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 15:55:50.762410 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758842 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 15:55:50.762410 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758845 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 15:55:50.762410 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758848 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 15:55:50.762410 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758851 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 15:55:50.762410 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758854 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 15:55:50.762410 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758857 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 15:55:50.762410 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758859 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 15:55:50.762410 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758862 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758865 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758867 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758870 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758872 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758874 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758877 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758879 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758883 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758887 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758889 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758892 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758895 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758898 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758901 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758904 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758907 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758909 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758912 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 15:55:50.762775 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758914 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758917 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758919 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758922 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758926 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758928 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758931 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758934 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758936 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758939 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758941 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758944 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758946 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758949 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758951 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758954 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758956 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758960 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758963 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 15:55:50.763304 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758966 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758969 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758971 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758974 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758977 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758980 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758983 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758986 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758988 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758991 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758994 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758997 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.758999 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759002 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759005 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759007 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759010 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759012 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759015 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759017 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 15:55:50.763770 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759019 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759022 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759025 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759028 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759030 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759033 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759035 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759038 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759040 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759043 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759045 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759048 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759050 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759053 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759055 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759058 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759060 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759063 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759065 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759068 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 15:55:50.764269 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759070 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 15:55:50.764744 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759073 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 15:55:50.764744 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759075 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 15:55:50.764744 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759078 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 15:55:50.764744 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759081 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 15:55:50.764744 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759083 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 15:55:50.764744 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759085 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 15:55:50.764744 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:50.759088 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 15:55:50.764744 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.759093 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 15:55:50.764744 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.759225 2574 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 15:55:50.764744 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.761250 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 15:55:50.764744 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.762334 2574 server.go:1019] "Starting client certificate rotation" Sep 10 15:55:50.764744 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.762435 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 15:55:50.764744 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.762469 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 15:55:50.767699 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.767680 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 15:55:50.771024 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.771011 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 15:55:50.778766 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.778746 2574 log.go:25] "Validated CRI v1 runtime API" Sep 10 15:55:50.781424 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.781408 2574 log.go:25] "Validated CRI v1 image API" Sep 10 15:55:50.782182 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.782169 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 15:55:50.786150 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.786131 2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7d03555b-52bc-4fd7-a47f-63579c44318f:/dev/nvme0n1p3 c726be6f-8894-4c9c-8a7c-cb6efb649513:/dev/nvme0n1p4] Sep 10 15:55:50.786232 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.786148 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 15:55:50.792144 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.791931 2574 manager.go:216] Machine: {Timestamp:2026-09-10 15:55:50.789677085 +0000 UTC m=+0.343672966 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098416 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f43be3833ac7d3e6eb38db4b46b59 SystemUUID:ec2f43be-3833-ac7d-3e6e-b38db4b46b59 BootID:6b5bcd9f-7bf2-4ccb-b670-2a09ba6d865e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ef:95:c5:14:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ef:95:c5:14:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:c3:79:f5:f3:7a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 15:55:50.792144 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.792140 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 15:55:50.792286 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.792226 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 15:55:50.795897 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.795872 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 15:55:50.796051 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.795901 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-28.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 15:55:50.796680 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.796668 2574 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 15:55:50.796733 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.796683 2574 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 15:55:50.796733 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.796694 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 15:55:50.797533 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.797521 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 15:55:50.798433 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.798421 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 15:55:50.802269 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.802254 2574 state_mem.go:36] "Initialized new in-memory state store" Sep 10 15:55:50.802419 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.802408 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 15:55:50.802476 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.802449 2574 kubelet.go:486] "Attempting to sync node with API server" Sep 10 15:55:50.802476 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.802468 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 15:55:50.802570 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.802488 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 15:55:50.802570 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.802501 2574 kubelet.go:398] "Adding apiserver pod source" Sep 10 15:55:50.802570 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.802513 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 15:55:50.802886 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.802872 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 15:55:50.802956 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.802896 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 15:55:50.805098 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.805083 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 15:55:50.807427 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.807414 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 15:55:50.807471 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.807444 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 15:55:50.808603 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.808590 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 15:55:50.808645 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.808614 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 15:55:50.808645 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.808623 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 15:55:50.808645 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.808628 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 15:55:50.808645 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.808637 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 15:55:50.808645 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.808642 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 15:55:50.808773 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.808656 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 15:55:50.808773 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.808661 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 15:55:50.808773 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.808667 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 15:55:50.808773 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.808673 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 15:55:50.808773 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.808686 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 15:55:50.808773 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.808692 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 15:55:50.809549 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.809535 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 15:55:50.809549 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.809550 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 15:55:50.811823 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.811808 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 15:55:50.813353 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.813341 2574 server.go:1268] "Started kubelet" Sep 10 15:55:50.813458 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.813400 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 15:55:50.813510 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.813433 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 15:55:50.813510 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.813501 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 15:55:50.814190 ip-10-0-131-28 systemd[1]: Started Kubernetes Kubelet. Sep 10 15:55:50.814676 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.814648 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 15:55:50.819133 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.819110 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-28.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 15:55:50.819266 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:50.819241 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 15:55:50.819746 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:50.819720 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 15:55:50.820052 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:50.820028 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 15:55:50.821942 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.821923 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 15:55:50.821942 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.821928 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 15:55:50.822209 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:50.822183 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found" Sep 10 15:55:50.822528 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.822513 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 15:55:50.822605 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.822514 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 15:55:50.822605 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.822540 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 15:55:50.822704 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.822638 2574 reconstruct.go:97] "Volume reconstruction finished" Sep 10 15:55:50.822704 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.822644 2574 reconciler.go:29] "Reconciler: start to sync state" Sep 10 15:55:50.823002 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.822987 2574 factory.go:55] Registering systemd factory Sep 10 15:55:50.823002 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.823004 2574 factory.go:223] Registration of the systemd container factory successfully Sep 10 15:55:50.823246 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.823234 2574 factory.go:153] Registering CRI-O factory Sep 10 15:55:50.823246 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.823248 2574 factory.go:223] Registration of the crio container factory successfully Sep 10 15:55:50.823331 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.823298 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 15:55:50.823331 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.823316 2574 factory.go:103] Registering Raw factory Sep 10 15:55:50.823331 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.823328 2574 manager.go:1196] Started watching for new ooms in manager Sep 10 15:55:50.823716 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.823698 2574 manager.go:349] Starting recovery of all containers Sep 10 15:55:50.823835 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.823707 2574 server.go:310] "Adding debug handlers to kubelet server" Sep 10 15:55:50.824225 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:50.819702 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-28.ec2.internal.18d400b9fe98ee8e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-28.ec2.internal,UID:ip-10-0-131-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-28.ec2.internal,},FirstTimestamp:2026-09-10 15:55:50.813314702 +0000 UTC m=+0.367310584,LastTimestamp:2026-09-10 15:55:50.813314702 +0000 UTC m=+0.367310584,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-28.ec2.internal,}" Sep 10 15:55:50.825741 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:50.825713 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 15:55:50.826212 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:50.826173 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 15:55:50.835093 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.835077 2574 manager.go:354] Recovery completed Sep 10 15:55:50.841368 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.841355 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 15:55:50.843145 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.843115 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientMemory" Sep 10 15:55:50.843278 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.843158 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 15:55:50.843278 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.843169 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientPID" Sep 10 15:55:50.843844 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.843822 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 15:55:50.843844 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.843843 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 15:55:50.843960 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.843851 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 15:55:50.843960 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.843863 2574 state_mem.go:36] "Initialized new in-memory state store" Sep 10 15:55:50.844571 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.844556 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientMemory" Sep 10 15:55:50.844654 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.844586 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 15:55:50.844654 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.844600 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientPID" Sep 10 15:55:50.845495 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.845482 2574 policy_none.go:49] "None policy: Start" Sep 10 15:55:50.845495 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.845497 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 15:55:50.845576 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.845509 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 15:55:50.846636 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.846626 2574 policy_none.go:47] "Start" Sep 10 15:55:50.858874 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:50.858792 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-28.ec2.internal.18d400ba006016a3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-28.ec2.internal,UID:ip-10-0-131-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-28.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-28.ec2.internal,},FirstTimestamp:2026-09-10 15:55:50.843143843 +0000 UTC m=+0.397139725,LastTimestamp:2026-09-10 15:55:50.843143843 +0000 UTC m=+0.397139725,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-28.ec2.internal,}" Sep 10 15:55:50.869792 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.869777 2574 manager.go:337] "Starting Device Plugin manager" Sep 10 15:55:50.888725 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:50.869820 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 15:55:50.888725 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.869832 2574 server.go:87] "Starting device plugin registration server" Sep 10 15:55:50.888725 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.870128 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 15:55:50.888725 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.870140 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 15:55:50.888725 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.870244 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 15:55:50.888725 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.870334 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 15:55:50.888725 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.870345 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 15:55:50.888725 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:50.870865 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 15:55:50.888725 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:50.870914 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-28.ec2.internal\" not found" Sep 10 15:55:50.888725 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.871724 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4zqpl" Sep 10 15:55:50.888725 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:50.874335 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-28.ec2.internal.18d400ba0060623a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-28.ec2.internal,UID:ip-10-0-131-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-28.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-28.ec2.internal,},FirstTimestamp:2026-09-10 15:55:50.843163194 +0000 UTC m=+0.397159076,LastTimestamp:2026-09-10 15:55:50.843163194 +0000 UTC m=+0.397159076,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-28.ec2.internal,}" Sep 10 15:55:50.888725 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.880301 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4zqpl" Sep 10 15:55:50.948870 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.948822 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 15:55:50.950125 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.950108 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 15:55:50.950252 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.950167 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 15:55:50.950252 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.950211 2574 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 15:55:50.950367 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:50.950259 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 15:55:50.952248 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.952225 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 15:55:50.970830 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.970801 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 15:55:50.971782 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.971764 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientMemory" Sep 10 15:55:50.971876 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.971793 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 15:55:50.971876 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.971803 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientPID" Sep 10 15:55:50.971876 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.971824 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-28.ec2.internal" Sep 10 15:55:50.984426 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:50.984403 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-28.ec2.internal" Sep 10 15:55:50.984426 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:50.984428 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-28.ec2.internal\": node \"ip-10-0-131-28.ec2.internal\" not found" Sep 10 15:55:51.033153 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:51.033058 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found" Sep 10 15:55:51.050950 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.050914 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal"] Sep 10 15:55:51.051055 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.051015 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 15:55:51.052089 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.052059 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientMemory" Sep 10 15:55:51.052225 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.052098 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 15:55:51.052225 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.052113 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientPID" Sep 10 15:55:51.054428 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.054416 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 15:55:51.054541 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.054519 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal" Sep 10 15:55:51.054577 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.054552 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 15:55:51.055299 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.055283 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientMemory" Sep 10 15:55:51.055387 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.055314 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 15:55:51.055387 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.055327 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientPID" Sep 10 15:55:51.055980 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.055960 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientMemory" Sep 10 15:55:51.056074 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.055991 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 15:55:51.056074 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.056007 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientPID" Sep 10 15:55:51.057568 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.057553 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal" Sep 10 15:55:51.057641 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.057581 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 15:55:51.058490 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.058474 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientMemory" Sep 10 15:55:51.058557 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.058505 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 15:55:51.058557 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.058520 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeHasSufficientPID" Sep 10 15:55:51.084026 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:51.083998 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-28.ec2.internal\" not found" node="ip-10-0-131-28.ec2.internal" Sep 10 15:55:51.088479 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:51.088463 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-28.ec2.internal\" not found" node="ip-10-0-131-28.ec2.internal" Sep 10 15:55:51.124252 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.124219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d77bdb88bdde64701cb8de72170bcf6-config\") pod \"kube-apiserver-proxy-ip-10-0-131-28.ec2.internal\" (UID: \"4d77bdb88bdde64701cb8de72170bcf6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal" Sep 10 15:55:51.124252 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.124253 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a141fc0eff22046ffabf6dbfb8969156-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal\" (UID: \"a141fc0eff22046ffabf6dbfb8969156\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal" Sep 10 15:55:51.124442 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.124277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a141fc0eff22046ffabf6dbfb8969156-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal\" (UID: \"a141fc0eff22046ffabf6dbfb8969156\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal" Sep 10 15:55:51.134109 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:51.134085 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found" Sep 10 15:55:51.225170 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.225133 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a141fc0eff22046ffabf6dbfb8969156-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal\" (UID: \"a141fc0eff22046ffabf6dbfb8969156\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal" Sep 10 15:55:51.225170 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.225166 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d77bdb88bdde64701cb8de72170bcf6-config\") pod \"kube-apiserver-proxy-ip-10-0-131-28.ec2.internal\" (UID: \"4d77bdb88bdde64701cb8de72170bcf6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal" Sep 10 15:55:51.225399 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.225183 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a141fc0eff22046ffabf6dbfb8969156-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal\" (UID: \"a141fc0eff22046ffabf6dbfb8969156\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal" Sep 10 15:55:51.225399 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.225269 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a141fc0eff22046ffabf6dbfb8969156-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal\" (UID: \"a141fc0eff22046ffabf6dbfb8969156\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal" Sep 10 15:55:51.225399 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.225279 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d77bdb88bdde64701cb8de72170bcf6-config\") pod \"kube-apiserver-proxy-ip-10-0-131-28.ec2.internal\" (UID: \"4d77bdb88bdde64701cb8de72170bcf6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal" Sep 10 15:55:51.225399 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.225339 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a141fc0eff22046ffabf6dbfb8969156-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal\" (UID: \"a141fc0eff22046ffabf6dbfb8969156\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal" Sep 10 15:55:51.234204 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:51.234172 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found" Sep 10 15:55:51.334599 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:51.334533 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found" Sep 10 15:55:51.387495 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.387446 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal" Sep 10 15:55:51.391540 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.391524 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal" Sep 10 15:55:51.434975 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:51.434948 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found" Sep 10 15:55:51.535329 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:51.535284 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found" Sep 10 15:55:51.636371 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:51.636312 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found" Sep 10 15:55:51.737295 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:51.737271 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found" Sep 10 15:55:51.762578 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.762549 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 15:55:51.763019 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.762698 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 15:55:51.837387 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:51.837363 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-28.ec2.internal\" not found" Sep 10 15:55:51.884967 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.884905 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 15:50:51 +0000 UTC" deadline="2028-05-14 14:28:27.32356925 +0000 UTC" Sep 10 15:55:51.884967 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.884960 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14686h32m35.438614016s" Sep 10 15:55:51.930689 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:51.930615 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 15:55:52.023302 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.023264 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal" Sep 10 15:55:52.045144 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.044962 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 15:55:52.047339 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.047318 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal" Sep 10 15:55:52.060766 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.060745 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 15:55:52.099322 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.099301 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 15:55:52.156806 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.156776 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 15:55:52.176607 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:52.176565 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d77bdb88bdde64701cb8de72170bcf6.slice/crio-e14ab6713d75f81d44ee9bdb4c5a4a10306fff4969c53627c927443fe03f2e69 WatchSource:0}: Error finding container e14ab6713d75f81d44ee9bdb4c5a4a10306fff4969c53627c927443fe03f2e69: Status 404 returned error can't find the container with id e14ab6713d75f81d44ee9bdb4c5a4a10306fff4969c53627c927443fe03f2e69 Sep 10 15:55:52.177070 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:52.177050 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda141fc0eff22046ffabf6dbfb8969156.slice/crio-57aaacff887a8f1c97f65f33c787f9e57c6d131b714cd0b3aa83dd3918b56689 WatchSource:0}: Error finding container 57aaacff887a8f1c97f65f33c787f9e57c6d131b714cd0b3aa83dd3918b56689: Status 404 returned error can't find the container with id 57aaacff887a8f1c97f65f33c787f9e57c6d131b714cd0b3aa83dd3918b56689 Sep 10 15:55:52.181559 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.181543 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 15:55:52.744490 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.744454 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 15:55:52.804676 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.804650 2574 apiserver.go:52] "Watching apiserver" Sep 10 15:55:52.816542 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.816512 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 15:55:52.816895 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.816872 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-rlx6p","openshift-network-operator/iptables-alerter-wfj7v","openshift-ovn-kubernetes/ovnkube-node-2r27m","kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8","openshift-cluster-node-tuning-operator/tuned-g8ckx","openshift-dns/node-resolver-28np2","openshift-image-registry/node-ca-qdj56","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal","openshift-multus/multus-additional-cni-plugins-ltdqc","openshift-multus/multus-jxd26","kube-system/global-pull-secret-syncer-fhhc7","kube-system/konnectivity-agent-rq6n2","openshift-multus/network-metrics-daemon-gj8vg"] Sep 10 15:55:52.820857 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.820837 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.822739 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.822715 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 15:55:52.823089 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.823065 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rq6n2" Sep 10 15:55:52.825565 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.825549 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.827902 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.827886 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:55:52.827991 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:52.827968 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gj8vg" podUID="885055da-965e-4c0d-915d-b2a2c078b5f4" Sep 10 15:55:52.828213 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.828196 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 15:55:52.828402 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.828387 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 15:55:52.828488 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.828402 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 15:55:52.828488 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.828402 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 15:55:52.828598 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.828493 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rgvq9\"" Sep 10 15:55:52.828598 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.828496 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 15:55:52.830589 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.830573 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:52.833088 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.833073 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:52.834880 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.834861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-system-cni-dir\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.834967 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.834891 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-cnibin\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.834967 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.834922 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-cni-binary-copy\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.834967 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.834947 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.835134 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.834974 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.835134 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.834998 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b33761b3-5ecd-4b98-b888-08eee34b615b-agent-certs\") pod \"konnectivity-agent-rq6n2\" (UID: \"b33761b3-5ecd-4b98-b888-08eee34b615b\") " pod="kube-system/konnectivity-agent-rq6n2" Sep 10 15:55:52.835134 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.835026 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.835134 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.835051 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbpb9\" (UniqueName: \"kubernetes.io/projected/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-kube-api-access-qbpb9\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.835134 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.835086 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b33761b3-5ecd-4b98-b888-08eee34b615b-konnectivity-ca\") pod \"konnectivity-agent-rq6n2\" (UID: \"b33761b3-5ecd-4b98-b888-08eee34b615b\") " pod="kube-system/konnectivity-agent-rq6n2" Sep 10 15:55:52.835716 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.835703 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qdj56" Sep 10 15:55:52.835858 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.835837 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 15:55:52.836139 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.836109 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 15:55:52.836235 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.836136 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 15:55:52.837443 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.837422 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4zddg\"" Sep 10 15:55:52.837528 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.837452 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 15:55:52.837528 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.837481 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l9fl6\"" Sep 10 15:55:52.837639 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.837430 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 15:55:52.837639 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.837422 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 15:55:52.837759 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.837683 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 15:55:52.837817 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.837781 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 15:55:52.837817 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.837794 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 15:55:52.837922 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.837886 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hftbp\"" Sep 10 15:55:52.838013 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.837998 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xpddk\"" Sep 10 15:55:52.838104 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.838089 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 15:55:52.838152 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.838121 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 15:55:52.838240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.838225 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 15:55:52.838355 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.838340 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-28np2" Sep 10 15:55:52.839417 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.839398 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 15:55:52.840958 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.840845 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wfj7v" Sep 10 15:55:52.843670 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.843649 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:55:52.844213 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:52.844121 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlx6p" podUID="4e63901b-f7d1-4957-a13c-24bc96170b41" Sep 10 15:55:52.846789 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.846750 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4v8sd\"" Sep 10 15:55:52.847364 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.847343 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 15:55:52.847465 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.847425 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 15:55:52.847465 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.847456 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jxd26" Sep 10 15:55:52.847579 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.847463 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 15:55:52.849984 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.849964 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:55:52.850076 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:52.850053 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fhhc7" podUID="66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1" Sep 10 15:55:52.850886 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.850870 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 15:55:52.851006 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.850992 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 15:55:52.854143 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.854121 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 15:55:52.854236 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.854144 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 15:55:52.854236 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.854159 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 15:55:52.854405 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.854388 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gmdxz\"" Sep 10 15:55:52.854500 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.854433 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pt7ns\"" Sep 10 15:55:52.854569 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.854542 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 15:55:52.855628 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.855614 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nnjv8\"" Sep 10 15:55:52.865541 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.865523 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 15:55:52.912703 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.912671 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vzrwp" Sep 10 15:55:52.924145 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.924125 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 15:55:52.925927 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.925905 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vzrwp" Sep 10 15:55:52.935868 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.935846 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-sysconfig\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:52.935963 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.935881 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-sys\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:52.935963 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.935913 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-system-cni-dir\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.936061 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.935962 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.936061 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936027 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-system-cni-dir\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.936061 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936030 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-registration-dir\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:52.936207 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936061 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-modprobe-d\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:52.936207 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936100 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-lib-modules\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:52.936207 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936124 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdc42f1b-99c9-49f3-b881-7afa9362478c-tmp\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:52.936207 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936149 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs\") pod \"network-metrics-daemon-gj8vg\" (UID: \"885055da-965e-4c0d-915d-b2a2c078b5f4\") " pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:55:52.936207 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-system-cni-dir\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:52.936207 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936187 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.936524 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936244 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-var-lib-cni-bin\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:52.936524 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936275 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-sysctl-conf\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:52.936524 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936304 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-cni-binary-copy\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.936524 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936400 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-run-systemd\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.936524 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936436 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9feb0e61-fa46-4164-9ab2-cbfdd536205b-ovnkube-config\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.936524 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9feb0e61-fa46-4164-9ab2-cbfdd536205b-ovnkube-script-lib\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.936524 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936511 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-sys-fs\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:52.936869 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936536 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtlcw\" (UniqueName: \"kubernetes.io/projected/37eddcd1-35de-421b-9b6b-381ce996b6e0-kube-api-access-wtlcw\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:52.936869 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936561 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-cnibin\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:52.936869 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-cni-binary-copy\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:52.936869 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936611 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-cni-bin\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.936869 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936656 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.936869 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936682 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-log-socket\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.936869 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:52.936869 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936739 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-multus-daemon-config\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:52.936869 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-systemd\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:52.936869 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936805 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret\") pod \"global-pull-secret-syncer-fhhc7\" (UID: \"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1\") " pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:55:52.936869 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936840 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.937427 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-run-openvswitch\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.937427 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936903 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.937427 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936929 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9feb0e61-fa46-4164-9ab2-cbfdd536205b-env-overrides\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.937427 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936953 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-var-lib-kubelet\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:52.937427 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936990 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-cni-binary-copy\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.937427 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.936999 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbpb9\" (UniqueName: \"kubernetes.io/projected/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-kube-api-access-qbpb9\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.937427 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937026 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-multus-conf-dir\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:52.937427 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937050 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv8zs\" (UniqueName: \"kubernetes.io/projected/e4beb35b-8f19-446b-8344-511819233a1f-kube-api-access-zv8zs\") pod \"node-ca-qdj56\" (UID: \"e4beb35b-8f19-446b-8344-511819233a1f\") " pod="openshift-image-registry/node-ca-qdj56" Sep 10 15:55:52.937427 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937079 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-dbus\") pod \"global-pull-secret-syncer-fhhc7\" (UID: \"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1\") " pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:55:52.937427 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937120 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-socket-dir\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:52.937427 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937163 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b33761b3-5ecd-4b98-b888-08eee34b615b-konnectivity-ca\") pod \"konnectivity-agent-rq6n2\" (UID: \"b33761b3-5ecd-4b98-b888-08eee34b615b\") " pod="kube-system/konnectivity-agent-rq6n2" Sep 10 15:55:52.937427 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937192 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-kubelet\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.937427 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937214 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.937427 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937230 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-run-netns\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.937427 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-run-k8s-cni-cncf-io\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:52.937427 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937403 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-var-lib-cni-multus\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:52.938240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937431 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-kubernetes\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:52.938240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937466 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-cni-netd\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.938240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937492 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r88hr\" (UniqueName: \"kubernetes.io/projected/023336c2-9df2-43ed-a744-b6d63753fc2a-kube-api-access-r88hr\") pod \"node-resolver-28np2\" (UID: \"023336c2-9df2-43ed-a744-b6d63753fc2a\") " pod="openshift-dns/node-resolver-28np2" Sep 10 15:55:52.938240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937515 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-hostroot\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:52.938240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937551 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.938240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-node-log\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.938240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.938240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937651 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-host\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:52.938240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937699 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/482144a9-16e2-4b5f-b11e-90e7120f5aa0-iptables-alerter-script\") pod \"iptables-alerter-wfj7v\" (UID: \"482144a9-16e2-4b5f-b11e-90e7120f5aa0\") " pod="openshift-network-operator/iptables-alerter-wfj7v" Sep 10 15:55:52.938240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937722 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-kubelet-config\") pod \"global-pull-secret-syncer-fhhc7\" (UID: \"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1\") " pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:55:52.938240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937746 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-slash\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.938240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937769 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/023336c2-9df2-43ed-a744-b6d63753fc2a-hosts-file\") pod \"node-resolver-28np2\" (UID: \"023336c2-9df2-43ed-a744-b6d63753fc2a\") " pod="openshift-dns/node-resolver-28np2" Sep 10 15:55:52.938240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/023336c2-9df2-43ed-a744-b6d63753fc2a-tmp-dir\") pod \"node-resolver-28np2\" (UID: \"023336c2-9df2-43ed-a744-b6d63753fc2a\") " pod="openshift-dns/node-resolver-28np2" Sep 10 15:55:52.938240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937814 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b33761b3-5ecd-4b98-b888-08eee34b615b-konnectivity-ca\") pod \"konnectivity-agent-rq6n2\" (UID: \"b33761b3-5ecd-4b98-b888-08eee34b615b\") " pod="kube-system/konnectivity-agent-rq6n2" Sep 10 15:55:52.938240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937818 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-etc-kubernetes\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:52.938240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937873 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-tuned\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:52.938240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937901 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4beb35b-8f19-446b-8344-511819233a1f-host\") pod \"node-ca-qdj56\" (UID: \"e4beb35b-8f19-446b-8344-511819233a1f\") " pod="openshift-image-registry/node-ca-qdj56" Sep 10 15:55:52.939060 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937926 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-var-lib-openvswitch\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.939060 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937952 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c66z7\" (UniqueName: \"kubernetes.io/projected/9feb0e61-fa46-4164-9ab2-cbfdd536205b-kube-api-access-c66z7\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.939060 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.937978 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-etc-selinux\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:52.939060 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938001 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-multus-cni-dir\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:52.939060 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938027 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb44s\" (UniqueName: \"kubernetes.io/projected/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-kube-api-access-fb44s\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:52.939060 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938073 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/482144a9-16e2-4b5f-b11e-90e7120f5aa0-host-slash\") pod \"iptables-alerter-wfj7v\" (UID: \"482144a9-16e2-4b5f-b11e-90e7120f5aa0\") " pod="openshift-network-operator/iptables-alerter-wfj7v" Sep 10 15:55:52.939060 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938121 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-cnibin\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.939060 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938150 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b33761b3-5ecd-4b98-b888-08eee34b615b-agent-certs\") pod \"konnectivity-agent-rq6n2\" (UID: \"b33761b3-5ecd-4b98-b888-08eee34b615b\") " pod="kube-system/konnectivity-agent-rq6n2" Sep 10 15:55:52.939060 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938181 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-cnibin\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:52.939060 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-multus-socket-dir-parent\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:52.939060 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938256 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-run-multus-certs\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:52.939060 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938295 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxj52\" (UniqueName: \"kubernetes.io/projected/cdc42f1b-99c9-49f3-b881-7afa9362478c-kube-api-access-wxj52\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:52.939060 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938323 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj2vw\" (UniqueName: \"kubernetes.io/projected/482144a9-16e2-4b5f-b11e-90e7120f5aa0-kube-api-access-cj2vw\") pod \"iptables-alerter-wfj7v\" (UID: \"482144a9-16e2-4b5f-b11e-90e7120f5aa0\") " pod="openshift-network-operator/iptables-alerter-wfj7v" Sep 10 15:55:52.939060 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938347 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-etc-openvswitch\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.939060 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938389 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwc9r\" (UniqueName: \"kubernetes.io/projected/885055da-965e-4c0d-915d-b2a2c078b5f4-kube-api-access-qwc9r\") pod \"network-metrics-daemon-gj8vg\" (UID: \"885055da-965e-4c0d-915d-b2a2c078b5f4\") " pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:55:52.939060 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938413 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-sysctl-d\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:52.939600 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938476 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-systemd-units\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.939600 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938511 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9feb0e61-fa46-4164-9ab2-cbfdd536205b-ovn-node-metrics-cert\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.939600 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938539 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-run-netns\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:52.939600 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938564 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-run\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:52.939600 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938579 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-var-lib-kubelet\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:52.939600 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938602 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4beb35b-8f19-446b-8344-511819233a1f-serviceca\") pod \"node-ca-qdj56\" (UID: \"e4beb35b-8f19-446b-8344-511819233a1f\") " pod="openshift-image-registry/node-ca-qdj56" Sep 10 15:55:52.939600 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938622 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-run-ovn\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:52.939600 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938671 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-device-dir\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:52.939600 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938699 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnmhf\" (UniqueName: \"kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf\") pod \"network-check-target-rlx6p\" (UID: \"4e63901b-f7d1-4957-a13c-24bc96170b41\") " pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:55:52.939600 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.938881 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 15:55:52.943582 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.943561 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b33761b3-5ecd-4b98-b888-08eee34b615b-agent-certs\") pod \"konnectivity-agent-rq6n2\" (UID: \"b33761b3-5ecd-4b98-b888-08eee34b615b\") " pod="kube-system/konnectivity-agent-rq6n2" Sep 10 15:55:52.955164 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.955090 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal" event={"ID":"4d77bdb88bdde64701cb8de72170bcf6","Type":"ContainerStarted","Data":"e14ab6713d75f81d44ee9bdb4c5a4a10306fff4969c53627c927443fe03f2e69"} Sep 10 15:55:52.956613 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.956584 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal" event={"ID":"a141fc0eff22046ffabf6dbfb8969156","Type":"ContainerStarted","Data":"57aaacff887a8f1c97f65f33c787f9e57c6d131b714cd0b3aa83dd3918b56689"} Sep 10 15:55:52.958254 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:52.958215 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbpb9\" (UniqueName: \"kubernetes.io/projected/a1c164f8-7f7a-46da-9b51-3b43f80aae6c-kube-api-access-qbpb9\") pod \"multus-additional-cni-plugins-ltdqc\" (UID: \"a1c164f8-7f7a-46da-9b51-3b43f80aae6c\") " pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:53.039517 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039434 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-systemd-units\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.039517 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039481 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9feb0e61-fa46-4164-9ab2-cbfdd536205b-ovn-node-metrics-cert\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.039517 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039508 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-run-netns\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.039798 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039531 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-run\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.039798 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039555 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-var-lib-kubelet\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.039798 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039578 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4beb35b-8f19-446b-8344-511819233a1f-serviceca\") pod \"node-ca-qdj56\" (UID: \"e4beb35b-8f19-446b-8344-511819233a1f\") " pod="openshift-image-registry/node-ca-qdj56" Sep 10 15:55:53.039798 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-run-ovn\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.039798 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039631 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-device-dir\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:53.039798 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039656 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnmhf\" (UniqueName: \"kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf\") pod \"network-check-target-rlx6p\" (UID: \"4e63901b-f7d1-4957-a13c-24bc96170b41\") " pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:55:53.039798 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039680 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-sysconfig\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.039798 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039701 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-sys\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.039798 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039727 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-registration-dir\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:53.039798 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039750 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-modprobe-d\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.039798 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039773 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-lib-modules\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.039798 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039798 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdc42f1b-99c9-49f3-b881-7afa9362478c-tmp\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.040480 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039823 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs\") pod \"network-metrics-daemon-gj8vg\" (UID: \"885055da-965e-4c0d-915d-b2a2c078b5f4\") " pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:55:53.040480 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039871 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-system-cni-dir\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.040480 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039899 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-var-lib-cni-bin\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.040480 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039924 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-sysctl-conf\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.040480 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039955 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-run-systemd\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.040480 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.039979 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9feb0e61-fa46-4164-9ab2-cbfdd536205b-ovnkube-config\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.040480 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040006 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9feb0e61-fa46-4164-9ab2-cbfdd536205b-ovnkube-script-lib\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.040480 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040044 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-sys-fs\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:53.040480 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtlcw\" (UniqueName: \"kubernetes.io/projected/37eddcd1-35de-421b-9b6b-381ce996b6e0-kube-api-access-wtlcw\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:53.040480 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040093 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-cnibin\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.040480 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040116 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-cni-binary-copy\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.040480 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:53.040131 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 15:55:53.040480 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040140 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-cni-bin\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.040480 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040184 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-log-socket\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.040480 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040210 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:53.040480 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:53.040247 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs podName:885055da-965e-4c0d-915d-b2a2c078b5f4 nodeName:}" failed. No retries permitted until 2026-09-10 15:55:53.540207473 +0000 UTC m=+3.094203374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs") pod "network-metrics-daemon-gj8vg" (UID: "885055da-965e-4c0d-915d-b2a2c078b5f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 15:55:53.040480 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040287 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-multus-daemon-config\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.041375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040293 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:53.041375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040317 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-systemd\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.041375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret\") pod \"global-pull-secret-syncer-fhhc7\" (UID: \"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1\") " pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:55:53.041375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040352 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-run-systemd\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.041375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040375 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-run-openvswitch\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.041375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040404 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.041375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040433 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9feb0e61-fa46-4164-9ab2-cbfdd536205b-env-overrides\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.041375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040449 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-registration-dir\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:53.041375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040460 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-var-lib-kubelet\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.041375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040501 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-multus-conf-dir\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.041375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040511 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-var-lib-kubelet\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.041375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040534 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv8zs\" (UniqueName: \"kubernetes.io/projected/e4beb35b-8f19-446b-8344-511819233a1f-kube-api-access-zv8zs\") pod \"node-ca-qdj56\" (UID: \"e4beb35b-8f19-446b-8344-511819233a1f\") " pod="openshift-image-registry/node-ca-qdj56" Sep 10 15:55:53.041375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040558 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-systemd-units\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.041375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040562 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-dbus\") pod \"global-pull-secret-syncer-fhhc7\" (UID: \"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1\") " pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:55:53.041375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040591 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-socket-dir\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:53.041375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040619 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-kubelet\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.041375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040663 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-run-netns\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040689 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-run-k8s-cni-cncf-io\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040706 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-system-cni-dir\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040715 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-var-lib-cni-multus\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-kubernetes\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040760 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-var-lib-cni-bin\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040769 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-cni-netd\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040795 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r88hr\" (UniqueName: \"kubernetes.io/projected/023336c2-9df2-43ed-a744-b6d63753fc2a-kube-api-access-r88hr\") pod \"node-resolver-28np2\" (UID: \"023336c2-9df2-43ed-a744-b6d63753fc2a\") " pod="openshift-dns/node-resolver-28np2" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-hostroot\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040851 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-node-log\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040877 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040904 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-host\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040931 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/482144a9-16e2-4b5f-b11e-90e7120f5aa0-iptables-alerter-script\") pod \"iptables-alerter-wfj7v\" (UID: \"482144a9-16e2-4b5f-b11e-90e7120f5aa0\") " pod="openshift-network-operator/iptables-alerter-wfj7v" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040936 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9feb0e61-fa46-4164-9ab2-cbfdd536205b-ovnkube-config\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040958 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-kubelet-config\") pod \"global-pull-secret-syncer-fhhc7\" (UID: \"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1\") " pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.040985 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-slash\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041011 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/023336c2-9df2-43ed-a744-b6d63753fc2a-hosts-file\") pod \"node-resolver-28np2\" (UID: \"023336c2-9df2-43ed-a744-b6d63753fc2a\") " pod="openshift-dns/node-resolver-28np2" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041037 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/023336c2-9df2-43ed-a744-b6d63753fc2a-tmp-dir\") pod \"node-resolver-28np2\" (UID: \"023336c2-9df2-43ed-a744-b6d63753fc2a\") " pod="openshift-dns/node-resolver-28np2" Sep 10 15:55:53.042238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041061 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-etc-kubernetes\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041086 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-tuned\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041109 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4beb35b-8f19-446b-8344-511819233a1f-host\") pod \"node-ca-qdj56\" (UID: \"e4beb35b-8f19-446b-8344-511819233a1f\") " pod="openshift-image-registry/node-ca-qdj56" Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041134 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-var-lib-openvswitch\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041164 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c66z7\" (UniqueName: \"kubernetes.io/projected/9feb0e61-fa46-4164-9ab2-cbfdd536205b-kube-api-access-c66z7\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041191 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-etc-selinux\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041216 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-multus-cni-dir\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041252 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb44s\" (UniqueName: \"kubernetes.io/projected/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-kube-api-access-fb44s\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041301 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/482144a9-16e2-4b5f-b11e-90e7120f5aa0-host-slash\") pod \"iptables-alerter-wfj7v\" (UID: \"482144a9-16e2-4b5f-b11e-90e7120f5aa0\") " pod="openshift-network-operator/iptables-alerter-wfj7v" Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041335 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-multus-socket-dir-parent\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-run-multus-certs\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxj52\" (UniqueName: \"kubernetes.io/projected/cdc42f1b-99c9-49f3-b881-7afa9362478c-kube-api-access-wxj52\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041420 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj2vw\" (UniqueName: \"kubernetes.io/projected/482144a9-16e2-4b5f-b11e-90e7120f5aa0-kube-api-access-cj2vw\") pod \"iptables-alerter-wfj7v\" (UID: \"482144a9-16e2-4b5f-b11e-90e7120f5aa0\") " pod="openshift-network-operator/iptables-alerter-wfj7v" Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041447 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-etc-openvswitch\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041478 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwc9r\" (UniqueName: \"kubernetes.io/projected/885055da-965e-4c0d-915d-b2a2c078b5f4-kube-api-access-qwc9r\") pod \"network-metrics-daemon-gj8vg\" (UID: \"885055da-965e-4c0d-915d-b2a2c078b5f4\") " pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041506 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-sysctl-d\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041541 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-multus-daemon-config\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:53.041643 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 15:55:53.043240 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041680 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-sysctl-d\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.044183 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041663 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9feb0e61-fa46-4164-9ab2-cbfdd536205b-ovnkube-script-lib\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.044183 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:53.041698 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret podName:66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1 nodeName:}" failed. No retries permitted until 2026-09-10 15:55:53.54167643 +0000 UTC m=+3.095672346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret") pod "global-pull-secret-syncer-fhhc7" (UID: "66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1") : object "kube-system"/"original-pull-secret" not registered Sep 10 15:55:53.044183 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041736 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-systemd\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.044183 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041745 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-run-openvswitch\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.044183 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041775 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-sysconfig\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.044183 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041800 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.044183 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041818 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-sysctl-conf\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.044183 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041820 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-sys\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.044183 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041890 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-cnibin\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.044183 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041965 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-run\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.044183 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.041989 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-dbus\") pod \"global-pull-secret-syncer-fhhc7\" (UID: \"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1\") " pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:55:53.044183 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042037 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-sys-fs\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:53.044183 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042038 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-run-netns\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.044183 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042100 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-var-lib-kubelet\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.044183 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042136 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-socket-dir\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:53.044183 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042187 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-kubelet\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.044183 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042205 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9feb0e61-fa46-4164-9ab2-cbfdd536205b-env-overrides\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042230 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-run-netns\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042298 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-run-k8s-cni-cncf-io\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042338 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-modprobe-d\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042347 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-var-lib-cni-multus\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042373 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-cni-binary-copy\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042389 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-run-ovn\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042400 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-kubernetes\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042426 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-cni-bin\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042448 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-var-lib-openvswitch\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042457 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-cni-netd\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042470 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-log-socket\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042467 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-multus-conf-dir\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042484 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4beb35b-8f19-446b-8344-511819233a1f-host\") pod \"node-ca-qdj56\" (UID: \"e4beb35b-8f19-446b-8344-511819233a1f\") " pod="openshift-image-registry/node-ca-qdj56" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042511 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-hostroot\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042540 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-host-run-multus-certs\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042539 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4beb35b-8f19-446b-8344-511819233a1f-serviceca\") pod \"node-ca-qdj56\" (UID: \"e4beb35b-8f19-446b-8344-511819233a1f\") " pod="openshift-image-registry/node-ca-qdj56" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042563 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-slash\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.045148 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042589 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.045804 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042638 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-etc-selinux\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:53.045804 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042647 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-node-log\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.045804 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042700 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-kubelet-config\") pod \"global-pull-secret-syncer-fhhc7\" (UID: \"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1\") " pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:55:53.045804 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042722 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-host\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.045804 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042728 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9feb0e61-fa46-4164-9ab2-cbfdd536205b-etc-openvswitch\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.045804 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042762 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-multus-cni-dir\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.045804 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042790 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/37eddcd1-35de-421b-9b6b-381ce996b6e0-device-dir\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:53.045804 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042829 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-etc-kubernetes\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.045804 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042915 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/023336c2-9df2-43ed-a744-b6d63753fc2a-tmp-dir\") pod \"node-resolver-28np2\" (UID: \"023336c2-9df2-43ed-a744-b6d63753fc2a\") " pod="openshift-dns/node-resolver-28np2" Sep 10 15:55:53.045804 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.042917 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/482144a9-16e2-4b5f-b11e-90e7120f5aa0-host-slash\") pod \"iptables-alerter-wfj7v\" (UID: \"482144a9-16e2-4b5f-b11e-90e7120f5aa0\") " pod="openshift-network-operator/iptables-alerter-wfj7v" Sep 10 15:55:53.045804 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.043000 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdc42f1b-99c9-49f3-b881-7afa9362478c-lib-modules\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.045804 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.043036 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/023336c2-9df2-43ed-a744-b6d63753fc2a-hosts-file\") pod \"node-resolver-28np2\" (UID: \"023336c2-9df2-43ed-a744-b6d63753fc2a\") " pod="openshift-dns/node-resolver-28np2" Sep 10 15:55:53.045804 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.043072 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-multus-socket-dir-parent\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.045804 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.044338 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/482144a9-16e2-4b5f-b11e-90e7120f5aa0-iptables-alerter-script\") pod \"iptables-alerter-wfj7v\" (UID: \"482144a9-16e2-4b5f-b11e-90e7120f5aa0\") " pod="openshift-network-operator/iptables-alerter-wfj7v" Sep 10 15:55:53.045804 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.045556 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdc42f1b-99c9-49f3-b881-7afa9362478c-tmp\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.045804 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.045653 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9feb0e61-fa46-4164-9ab2-cbfdd536205b-ovn-node-metrics-cert\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.046456 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.046434 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cdc42f1b-99c9-49f3-b881-7afa9362478c-etc-tuned\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.085413 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.085383 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c66z7\" (UniqueName: \"kubernetes.io/projected/9feb0e61-fa46-4164-9ab2-cbfdd536205b-kube-api-access-c66z7\") pod \"ovnkube-node-2r27m\" (UID: \"9feb0e61-fa46-4164-9ab2-cbfdd536205b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.086034 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.086005 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r88hr\" (UniqueName: \"kubernetes.io/projected/023336c2-9df2-43ed-a744-b6d63753fc2a-kube-api-access-r88hr\") pod \"node-resolver-28np2\" (UID: \"023336c2-9df2-43ed-a744-b6d63753fc2a\") " pod="openshift-dns/node-resolver-28np2" Sep 10 15:55:53.086152 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:53.086009 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 15:55:53.086152 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:53.086075 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 15:55:53.086152 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:53.086091 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vnmhf for pod openshift-network-diagnostics/network-check-target-rlx6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 15:55:53.086152 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:53.086150 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf podName:4e63901b-f7d1-4957-a13c-24bc96170b41 nodeName:}" failed. No retries permitted until 2026-09-10 15:55:53.586136123 +0000 UTC m=+3.140131994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vnmhf" (UniqueName: "kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf") pod "network-check-target-rlx6p" (UID: "4e63901b-f7d1-4957-a13c-24bc96170b41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 15:55:53.088663 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.088639 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj2vw\" (UniqueName: \"kubernetes.io/projected/482144a9-16e2-4b5f-b11e-90e7120f5aa0-kube-api-access-cj2vw\") pod \"iptables-alerter-wfj7v\" (UID: \"482144a9-16e2-4b5f-b11e-90e7120f5aa0\") " pod="openshift-network-operator/iptables-alerter-wfj7v" Sep 10 15:55:53.089856 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.089830 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv8zs\" (UniqueName: \"kubernetes.io/projected/e4beb35b-8f19-446b-8344-511819233a1f-kube-api-access-zv8zs\") pod \"node-ca-qdj56\" (UID: \"e4beb35b-8f19-446b-8344-511819233a1f\") " pod="openshift-image-registry/node-ca-qdj56" Sep 10 15:55:53.092138 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.092094 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb44s\" (UniqueName: \"kubernetes.io/projected/253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc-kube-api-access-fb44s\") pod \"multus-jxd26\" (UID: \"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc\") " pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.092318 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.092264 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwc9r\" (UniqueName: \"kubernetes.io/projected/885055da-965e-4c0d-915d-b2a2c078b5f4-kube-api-access-qwc9r\") pod \"network-metrics-daemon-gj8vg\" (UID: \"885055da-965e-4c0d-915d-b2a2c078b5f4\") " pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:55:53.093927 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.093904 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxj52\" (UniqueName: \"kubernetes.io/projected/cdc42f1b-99c9-49f3-b881-7afa9362478c-kube-api-access-wxj52\") pod \"tuned-g8ckx\" (UID: \"cdc42f1b-99c9-49f3-b881-7afa9362478c\") " pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.096546 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.096517 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtlcw\" (UniqueName: \"kubernetes.io/projected/37eddcd1-35de-421b-9b6b-381ce996b6e0-kube-api-access-wtlcw\") pod \"aws-ebs-csi-driver-node-jsrm8\" (UID: \"37eddcd1-35de-421b-9b6b-381ce996b6e0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:53.130501 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.130481 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ltdqc" Sep 10 15:55:53.137499 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.137478 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rq6n2" Sep 10 15:55:53.145688 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.145667 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:55:53.152007 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:53.151983 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c164f8_7f7a_46da_9b51_3b43f80aae6c.slice/crio-b4dd6623ca7202fbf82203f11472d12f1d5a95c65f1d6474fb02e252d9280cde WatchSource:0}: Error finding container b4dd6623ca7202fbf82203f11472d12f1d5a95c65f1d6474fb02e252d9280cde: Status 404 returned error can't find the container with id b4dd6623ca7202fbf82203f11472d12f1d5a95c65f1d6474fb02e252d9280cde Sep 10 15:55:53.152114 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.152027 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" Sep 10 15:55:53.158959 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.158938 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" Sep 10 15:55:53.159763 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:53.159738 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33761b3_5ecd_4b98_b888_08eee34b615b.slice/crio-93a80a86f3de43a009cfb7f92680d611e6293e2c91dc7c250b8d1297511f79a4 WatchSource:0}: Error finding container 93a80a86f3de43a009cfb7f92680d611e6293e2c91dc7c250b8d1297511f79a4: Status 404 returned error can't find the container with id 93a80a86f3de43a009cfb7f92680d611e6293e2c91dc7c250b8d1297511f79a4 Sep 10 15:55:53.164383 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.164362 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qdj56" Sep 10 15:55:53.171356 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.171338 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-28np2" Sep 10 15:55:53.172755 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:53.172560 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37eddcd1_35de_421b_9b6b_381ce996b6e0.slice/crio-1a8badb5d8f6af07b3239c5e994d7a6e6424dfc150f71fd41cda26136a696735 WatchSource:0}: Error finding container 1a8badb5d8f6af07b3239c5e994d7a6e6424dfc150f71fd41cda26136a696735: Status 404 returned error can't find the container with id 1a8badb5d8f6af07b3239c5e994d7a6e6424dfc150f71fd41cda26136a696735 Sep 10 15:55:53.174643 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:53.174622 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc42f1b_99c9_49f3_b881_7afa9362478c.slice/crio-74d822bb7de64122ebeab6eb01a797fd2e202eaf624bc55646b23e1836a26c18 WatchSource:0}: Error finding container 74d822bb7de64122ebeab6eb01a797fd2e202eaf624bc55646b23e1836a26c18: Status 404 returned error can't find the container with id 74d822bb7de64122ebeab6eb01a797fd2e202eaf624bc55646b23e1836a26c18 Sep 10 15:55:53.177001 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.176982 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wfj7v" Sep 10 15:55:53.182683 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.182652 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jxd26" Sep 10 15:55:53.197692 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:53.197666 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023336c2_9df2_43ed_a744_b6d63753fc2a.slice/crio-fa92873118a46c89b687e9855c5c606e0df74f0f0ab142b646736ca94f03ab6e WatchSource:0}: Error finding container fa92873118a46c89b687e9855c5c606e0df74f0f0ab142b646736ca94f03ab6e: Status 404 returned error can't find the container with id fa92873118a46c89b687e9855c5c606e0df74f0f0ab142b646736ca94f03ab6e Sep 10 15:55:53.207256 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:55:53.207187 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod253c9d6a_9b3a_4fee_bce7_0b9f4b1d05cc.slice/crio-dbbf962170461dcd1079a61585fe206696ab1db4f44f144a3bb2bd98a89615af WatchSource:0}: Error finding container dbbf962170461dcd1079a61585fe206696ab1db4f44f144a3bb2bd98a89615af: Status 404 returned error can't find the container with id dbbf962170461dcd1079a61585fe206696ab1db4f44f144a3bb2bd98a89615af Sep 10 15:55:53.546017 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.545975 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs\") pod \"network-metrics-daemon-gj8vg\" (UID: \"885055da-965e-4c0d-915d-b2a2c078b5f4\") " pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:55:53.546017 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.546023 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret\") pod \"global-pull-secret-syncer-fhhc7\" (UID: \"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1\") " pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:55:53.546289 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:53.546123 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 15:55:53.546289 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:53.546147 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 15:55:53.546289 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:53.546178 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret podName:66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1 nodeName:}" failed. No retries permitted until 2026-09-10 15:55:54.546164469 +0000 UTC m=+4.100160339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret") pod "global-pull-secret-syncer-fhhc7" (UID: "66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1") : object "kube-system"/"original-pull-secret" not registered Sep 10 15:55:53.546289 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:53.546236 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs podName:885055da-965e-4c0d-915d-b2a2c078b5f4 nodeName:}" failed. No retries permitted until 2026-09-10 15:55:54.54619944 +0000 UTC m=+4.100195324 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs") pod "network-metrics-daemon-gj8vg" (UID: "885055da-965e-4c0d-915d-b2a2c078b5f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 15:55:53.646664 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.646623 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnmhf\" (UniqueName: \"kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf\") pod \"network-check-target-rlx6p\" (UID: \"4e63901b-f7d1-4957-a13c-24bc96170b41\") " pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:55:53.646856 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:53.646838 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 15:55:53.646913 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:53.646862 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 15:55:53.646913 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:53.646876 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vnmhf for pod openshift-network-diagnostics/network-check-target-rlx6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 15:55:53.647002 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:53.646943 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf podName:4e63901b-f7d1-4957-a13c-24bc96170b41 nodeName:}" failed. No retries permitted until 2026-09-10 15:55:54.646923639 +0000 UTC m=+4.200919509 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnmhf" (UniqueName: "kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf") pod "network-check-target-rlx6p" (UID: "4e63901b-f7d1-4957-a13c-24bc96170b41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 15:55:53.929035 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.928965 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 15:50:53 +0000 UTC" deadline="2028-03-16 14:45:59.698435614 +0000 UTC" Sep 10 15:55:53.929035 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.929026 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13270h50m5.76941437s" Sep 10 15:55:53.959337 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.959299 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jxd26" event={"ID":"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc","Type":"ContainerStarted","Data":"dbbf962170461dcd1079a61585fe206696ab1db4f44f144a3bb2bd98a89615af"} Sep 10 15:55:53.960496 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.960472 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qdj56" event={"ID":"e4beb35b-8f19-446b-8344-511819233a1f","Type":"ContainerStarted","Data":"b5acc17617ffa98b8aaf9986dec93721c43602051b3feddee4c580ca732d15c3"} Sep 10 15:55:53.961803 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.961775 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" event={"ID":"cdc42f1b-99c9-49f3-b881-7afa9362478c","Type":"ContainerStarted","Data":"74d822bb7de64122ebeab6eb01a797fd2e202eaf624bc55646b23e1836a26c18"} Sep 10 15:55:53.963098 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.963075 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" event={"ID":"37eddcd1-35de-421b-9b6b-381ce996b6e0","Type":"ContainerStarted","Data":"1a8badb5d8f6af07b3239c5e994d7a6e6424dfc150f71fd41cda26136a696735"} Sep 10 15:55:53.964401 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.964380 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltdqc" event={"ID":"a1c164f8-7f7a-46da-9b51-3b43f80aae6c","Type":"ContainerStarted","Data":"b4dd6623ca7202fbf82203f11472d12f1d5a95c65f1d6474fb02e252d9280cde"} Sep 10 15:55:53.965738 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.965711 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wfj7v" event={"ID":"482144a9-16e2-4b5f-b11e-90e7120f5aa0","Type":"ContainerStarted","Data":"ca36ab62983ea68c0938cf2275e96469d8a9b2ef355beab20809baeddfe85b6d"} Sep 10 15:55:53.966985 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.966957 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-28np2" event={"ID":"023336c2-9df2-43ed-a744-b6d63753fc2a","Type":"ContainerStarted","Data":"fa92873118a46c89b687e9855c5c606e0df74f0f0ab142b646736ca94f03ab6e"} Sep 10 15:55:53.968352 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.968319 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" event={"ID":"9feb0e61-fa46-4164-9ab2-cbfdd536205b","Type":"ContainerStarted","Data":"ddecd16770ff2b6c7e1e0e54d6e2407bbcb8a5abe81b52f354b96b45cf1b3554"} Sep 10 15:55:53.969670 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:53.969650 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rq6n2" event={"ID":"b33761b3-5ecd-4b98-b888-08eee34b615b","Type":"ContainerStarted","Data":"93a80a86f3de43a009cfb7f92680d611e6293e2c91dc7c250b8d1297511f79a4"} Sep 10 15:55:54.554606 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:54.554567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret\") pod \"global-pull-secret-syncer-fhhc7\" (UID: \"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1\") " pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:55:54.554797 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:54.554660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs\") pod \"network-metrics-daemon-gj8vg\" (UID: \"885055da-965e-4c0d-915d-b2a2c078b5f4\") " pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:55:54.554797 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:54.554783 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 15:55:54.554922 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:54.554850 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs podName:885055da-965e-4c0d-915d-b2a2c078b5f4 nodeName:}" failed. No retries permitted until 2026-09-10 15:55:56.554829578 +0000 UTC m=+6.108825475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs") pod "network-metrics-daemon-gj8vg" (UID: "885055da-965e-4c0d-915d-b2a2c078b5f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 15:55:54.555332 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:54.555310 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 15:55:54.555444 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:54.555370 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret podName:66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1 nodeName:}" failed. No retries permitted until 2026-09-10 15:55:56.555354384 +0000 UTC m=+6.109350270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret") pod "global-pull-secret-syncer-fhhc7" (UID: "66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1") : object "kube-system"/"original-pull-secret" not registered Sep 10 15:55:54.655625 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:54.655586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnmhf\" (UniqueName: \"kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf\") pod \"network-check-target-rlx6p\" (UID: \"4e63901b-f7d1-4957-a13c-24bc96170b41\") " pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:55:54.655846 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:54.655824 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 15:55:54.655914 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:54.655854 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 15:55:54.655914 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:54.655868 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vnmhf for pod openshift-network-diagnostics/network-check-target-rlx6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 15:55:54.656021 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:54.655937 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf podName:4e63901b-f7d1-4957-a13c-24bc96170b41 nodeName:}" failed. No retries permitted until 2026-09-10 15:55:56.655915013 +0000 UTC m=+6.209910914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnmhf" (UniqueName: "kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf") pod "network-check-target-rlx6p" (UID: "4e63901b-f7d1-4957-a13c-24bc96170b41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 15:55:54.929863 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:54.929819 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 15:50:53 +0000 UTC" deadline="2028-03-16 23:05:15.268947635 +0000 UTC" Sep 10 15:55:54.929863 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:54.929862 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13279h9m20.339091191s" Sep 10 15:55:54.951066 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:54.951036 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:55:54.951260 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:54.951196 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gj8vg" podUID="885055da-965e-4c0d-915d-b2a2c078b5f4" Sep 10 15:55:54.951260 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:54.951034 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:55:54.951384 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:54.951323 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fhhc7" podUID="66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1" Sep 10 15:55:54.951384 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:54.951034 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:55:54.951505 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:54.951408 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlx6p" podUID="4e63901b-f7d1-4957-a13c-24bc96170b41" Sep 10 15:55:55.991180 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:55.990422 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal" event={"ID":"4d77bdb88bdde64701cb8de72170bcf6","Type":"ContainerStarted","Data":"5a2c52b139ab28c566c5859d5c032e7ad8c3d007c24616119445397a60636f16"} Sep 10 15:55:56.575940 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:56.575644 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs\") pod \"network-metrics-daemon-gj8vg\" (UID: \"885055da-965e-4c0d-915d-b2a2c078b5f4\") " pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:55:56.575940 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:56.575939 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret\") pod \"global-pull-secret-syncer-fhhc7\" (UID: \"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1\") " pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:55:56.576214 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:56.575868 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 15:55:56.576279 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:56.576216 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs podName:885055da-965e-4c0d-915d-b2a2c078b5f4 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:00.57618236 +0000 UTC m=+10.130178246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs") pod "network-metrics-daemon-gj8vg" (UID: "885055da-965e-4c0d-915d-b2a2c078b5f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 15:55:56.576630 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:56.576138 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 15:55:56.576630 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:56.576583 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret podName:66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:00.576565943 +0000 UTC m=+10.130561811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret") pod "global-pull-secret-syncer-fhhc7" (UID: "66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1") : object "kube-system"/"original-pull-secret" not registered Sep 10 15:55:56.677049 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:56.677014 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnmhf\" (UniqueName: \"kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf\") pod \"network-check-target-rlx6p\" (UID: \"4e63901b-f7d1-4957-a13c-24bc96170b41\") " pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:55:56.677297 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:56.677259 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 15:55:56.677297 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:56.677286 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 15:55:56.677297 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:56.677299 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vnmhf for pod openshift-network-diagnostics/network-check-target-rlx6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 15:55:56.677468 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:56.677374 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf podName:4e63901b-f7d1-4957-a13c-24bc96170b41 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:00.677355312 +0000 UTC m=+10.231351184 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnmhf" (UniqueName: "kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf") pod "network-check-target-rlx6p" (UID: "4e63901b-f7d1-4957-a13c-24bc96170b41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 15:55:56.951926 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:56.951383 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:55:56.951926 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:56.951526 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gj8vg" podUID="885055da-965e-4c0d-915d-b2a2c078b5f4" Sep 10 15:55:56.951926 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:56.951721 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:55:56.951926 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:56.951824 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlx6p" podUID="4e63901b-f7d1-4957-a13c-24bc96170b41" Sep 10 15:55:56.952256 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:56.951937 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:55:56.952256 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:56.952022 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fhhc7" podUID="66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1" Sep 10 15:55:56.995482 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:56.995447 2574 generic.go:356] "Generic (PLEG): container finished" podID="a141fc0eff22046ffabf6dbfb8969156" containerID="47131c5ab8fe2cbb61f628971b0bf8fac58f863b7e181f8709cbbfa240187739" exitCode=0 Sep 10 15:55:56.996038 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:56.996014 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal" event={"ID":"a141fc0eff22046ffabf6dbfb8969156","Type":"ContainerDied","Data":"47131c5ab8fe2cbb61f628971b0bf8fac58f863b7e181f8709cbbfa240187739"} Sep 10 15:55:57.015105 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:57.014501 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-28.ec2.internal" podStartSLOduration=5.01448301 podStartE2EDuration="5.01448301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:55:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:55:56.012412631 +0000 UTC m=+5.566408540" watchObservedRunningTime="2026-09-10 15:55:57.01448301 +0000 UTC m=+6.568478903" Sep 10 15:55:58.952316 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:58.951312 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:55:58.952316 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:58.951311 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:55:58.952316 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:58.951447 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gj8vg" podUID="885055da-965e-4c0d-915d-b2a2c078b5f4" Sep 10 15:55:58.952316 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:58.951598 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fhhc7" podUID="66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1" Sep 10 15:55:58.952316 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:55:58.951651 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:55:58.952316 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:55:58.951718 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlx6p" podUID="4e63901b-f7d1-4957-a13c-24bc96170b41" Sep 10 15:56:00.612415 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:00.612381 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs\") pod \"network-metrics-daemon-gj8vg\" (UID: \"885055da-965e-4c0d-915d-b2a2c078b5f4\") " pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:00.612880 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:00.612436 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret\") pod \"global-pull-secret-syncer-fhhc7\" (UID: \"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1\") " pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:00.612880 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:00.612589 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 15:56:00.612880 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:00.612648 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret podName:66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:08.612629976 +0000 UTC m=+18.166625847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret") pod "global-pull-secret-syncer-fhhc7" (UID: "66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1") : object "kube-system"/"original-pull-secret" not registered Sep 10 15:56:00.613055 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:00.613003 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 15:56:00.613108 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:00.613066 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs podName:885055da-965e-4c0d-915d-b2a2c078b5f4 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:08.613052178 +0000 UTC m=+18.167048053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs") pod "network-metrics-daemon-gj8vg" (UID: "885055da-965e-4c0d-915d-b2a2c078b5f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 15:56:00.713032 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:00.712994 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnmhf\" (UniqueName: \"kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf\") pod \"network-check-target-rlx6p\" (UID: \"4e63901b-f7d1-4957-a13c-24bc96170b41\") " pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:00.713223 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:00.713172 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 15:56:00.713304 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:00.713238 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 15:56:00.713304 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:00.713257 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vnmhf for pod openshift-network-diagnostics/network-check-target-rlx6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 15:56:00.713413 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:00.713324 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf podName:4e63901b-f7d1-4957-a13c-24bc96170b41 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:08.713305183 +0000 UTC m=+18.267301063 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnmhf" (UniqueName: "kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf") pod "network-check-target-rlx6p" (UID: "4e63901b-f7d1-4957-a13c-24bc96170b41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 15:56:00.952493 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:00.952403 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:00.952662 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:00.952526 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fhhc7" podUID="66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1" Sep 10 15:56:00.952988 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:00.952943 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:00.953114 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:00.953049 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gj8vg" podUID="885055da-965e-4c0d-915d-b2a2c078b5f4" Sep 10 15:56:00.953178 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:00.953148 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:00.953288 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:00.953249 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlx6p" podUID="4e63901b-f7d1-4957-a13c-24bc96170b41" Sep 10 15:56:02.951347 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:02.951312 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:02.951347 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:02.951345 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:02.951871 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:02.951312 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:02.951871 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:02.951453 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fhhc7" podUID="66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1" Sep 10 15:56:02.951871 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:02.951565 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlx6p" podUID="4e63901b-f7d1-4957-a13c-24bc96170b41" Sep 10 15:56:02.951871 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:02.951630 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gj8vg" podUID="885055da-965e-4c0d-915d-b2a2c078b5f4" Sep 10 15:56:04.950953 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:04.950913 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:04.951424 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:04.950913 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:04.951424 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:04.951045 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fhhc7" podUID="66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1" Sep 10 15:56:04.951424 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:04.951122 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gj8vg" podUID="885055da-965e-4c0d-915d-b2a2c078b5f4" Sep 10 15:56:04.951424 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:04.950913 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:04.951424 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:04.951235 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlx6p" podUID="4e63901b-f7d1-4957-a13c-24bc96170b41" Sep 10 15:56:06.950831 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:06.950751 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:06.951319 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:06.950758 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:06.951319 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:06.950879 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlx6p" podUID="4e63901b-f7d1-4957-a13c-24bc96170b41" Sep 10 15:56:06.951319 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:06.950912 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:06.951319 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:06.951005 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gj8vg" podUID="885055da-965e-4c0d-915d-b2a2c078b5f4" Sep 10 15:56:06.951319 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:06.951115 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fhhc7" podUID="66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1" Sep 10 15:56:08.666428 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:08.666382 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret\") pod \"global-pull-secret-syncer-fhhc7\" (UID: \"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1\") " pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:08.666898 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:08.666481 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs\") pod \"network-metrics-daemon-gj8vg\" (UID: \"885055da-965e-4c0d-915d-b2a2c078b5f4\") " pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:08.666898 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:08.666556 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 15:56:08.666898 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:08.666585 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 15:56:08.666898 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:08.666631 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs podName:885055da-965e-4c0d-915d-b2a2c078b5f4 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:24.666616965 +0000 UTC m=+34.220612846 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs") pod "network-metrics-daemon-gj8vg" (UID: "885055da-965e-4c0d-915d-b2a2c078b5f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 15:56:08.666898 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:08.666643 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret podName:66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:24.666637469 +0000 UTC m=+34.220633338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret") pod "global-pull-secret-syncer-fhhc7" (UID: "66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1") : object "kube-system"/"original-pull-secret" not registered Sep 10 15:56:08.767593 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:08.767556 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnmhf\" (UniqueName: \"kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf\") pod \"network-check-target-rlx6p\" (UID: \"4e63901b-f7d1-4957-a13c-24bc96170b41\") " pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:08.767785 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:08.767687 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 15:56:08.767785 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:08.767709 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 15:56:08.767785 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:08.767722 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vnmhf for pod openshift-network-diagnostics/network-check-target-rlx6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 15:56:08.767785 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:08.767785 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf podName:4e63901b-f7d1-4957-a13c-24bc96170b41 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:24.767765827 +0000 UTC m=+34.321761728 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnmhf" (UniqueName: "kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf") pod "network-check-target-rlx6p" (UID: "4e63901b-f7d1-4957-a13c-24bc96170b41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 15:56:08.951064 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:08.950983 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:08.951064 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:08.951019 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:08.951275 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:08.950983 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:08.951275 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:08.951110 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gj8vg" podUID="885055da-965e-4c0d-915d-b2a2c078b5f4" Sep 10 15:56:08.951275 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:08.951167 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlx6p" podUID="4e63901b-f7d1-4957-a13c-24bc96170b41" Sep 10 15:56:08.951275 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:08.951245 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fhhc7" podUID="66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1" Sep 10 15:56:10.951958 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:10.951915 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:10.951958 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:10.951947 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:10.952456 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:10.952015 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:10.952456 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:10.952026 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gj8vg" podUID="885055da-965e-4c0d-915d-b2a2c078b5f4" Sep 10 15:56:10.952456 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:10.952075 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlx6p" podUID="4e63901b-f7d1-4957-a13c-24bc96170b41" Sep 10 15:56:10.952456 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:10.952147 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fhhc7" podUID="66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1" Sep 10 15:56:12.025064 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.025018 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal" event={"ID":"a141fc0eff22046ffabf6dbfb8969156","Type":"ContainerStarted","Data":"fd8ac684388c99a849850bea2d98ec5d4dde77b42ff246d42f84af0173bca21f"} Sep 10 15:56:12.027001 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.026800 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-28np2" event={"ID":"023336c2-9df2-43ed-a744-b6d63753fc2a","Type":"ContainerStarted","Data":"c1402b3f59d3141edfdb9e6f1a468bb452573899e9f0d5b8be2e1a7db2cb020a"} Sep 10 15:56:12.028848 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.028831 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2r27m_9feb0e61-fa46-4164-9ab2-cbfdd536205b/ovn-acl-logging/0.log" Sep 10 15:56:12.029429 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.029399 2574 generic.go:356] "Generic (PLEG): container finished" podID="9feb0e61-fa46-4164-9ab2-cbfdd536205b" containerID="ee4001c9e417da79875dd292900181bf2462adeb023823fe9ed3c50ab526060f" exitCode=1 Sep 10 15:56:12.029512 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.029428 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" event={"ID":"9feb0e61-fa46-4164-9ab2-cbfdd536205b","Type":"ContainerStarted","Data":"a23a14c81a1baea589a64e9535d3081bbf14927e0e89fd280ceee42b74189dd9"} Sep 10 15:56:12.029577 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.029551 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" event={"ID":"9feb0e61-fa46-4164-9ab2-cbfdd536205b","Type":"ContainerDied","Data":"ee4001c9e417da79875dd292900181bf2462adeb023823fe9ed3c50ab526060f"} Sep 10 15:56:12.029636 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.029607 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" event={"ID":"9feb0e61-fa46-4164-9ab2-cbfdd536205b","Type":"ContainerStarted","Data":"2f0b781b972f16747154aca12a329fac1399b1412aebf94f2b712053ca539b5a"} Sep 10 15:56:12.031505 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.031482 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rq6n2" event={"ID":"b33761b3-5ecd-4b98-b888-08eee34b615b","Type":"ContainerStarted","Data":"548a543acc9a9063b03a2a15775d6df2f826ad46f1313a95b63251acba2f833a"} Sep 10 15:56:12.032938 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.032919 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jxd26" event={"ID":"253c9d6a-9b3a-4fee-bce7-0b9f4b1d05cc","Type":"ContainerStarted","Data":"6a1a8606a04f60c83fc4385dcf687f5f70ae3b5e114eeb64819a7d5611d5795a"} Sep 10 15:56:12.034351 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.034330 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qdj56" event={"ID":"e4beb35b-8f19-446b-8344-511819233a1f","Type":"ContainerStarted","Data":"2228b47fadec28ddd1e192ea9f325d469afbf72cdff75409cbaf44ef2f80e2f8"} Sep 10 15:56:12.035828 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.035806 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" event={"ID":"cdc42f1b-99c9-49f3-b881-7afa9362478c","Type":"ContainerStarted","Data":"d8eea14ce005bfe5501467db25a3d15f183ded5bcdb40308551e65db934735be"} Sep 10 15:56:12.037108 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.037091 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" event={"ID":"37eddcd1-35de-421b-9b6b-381ce996b6e0","Type":"ContainerStarted","Data":"339e7576e69f3b428df3777602d88fb941a37558caeeeb5c9a911f9ffad72d3b"} Sep 10 15:56:12.038524 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.038499 2574 generic.go:356] "Generic (PLEG): container finished" podID="a1c164f8-7f7a-46da-9b51-3b43f80aae6c" containerID="0cdbb48767adcd47c1a6f9b996ce69b2fa1b85f7aaab788ae1157609116558d2" exitCode=0 Sep 10 15:56:12.038623 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.038537 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltdqc" event={"ID":"a1c164f8-7f7a-46da-9b51-3b43f80aae6c","Type":"ContainerDied","Data":"0cdbb48767adcd47c1a6f9b996ce69b2fa1b85f7aaab788ae1157609116558d2"} Sep 10 15:56:12.044983 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.044945 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-28.ec2.internal" podStartSLOduration=20.044934357 podStartE2EDuration="20.044934357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:55:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:56:12.044690979 +0000 UTC m=+21.598686870" watchObservedRunningTime="2026-09-10 15:56:12.044934357 +0000 UTC m=+21.598930248" Sep 10 15:56:12.067288 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.067242 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rq6n2" podStartSLOduration=6.376079413 podStartE2EDuration="21.067227801s" totalImagesPullingTime="14.691148388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:56:12.066818915 +0000 UTC m=+21.620814806" watchObservedRunningTime="2026-09-10 15:56:12.067227801 +0000 UTC m=+21.621223691" Sep 10 15:56:12.090814 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.090765 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qdj56" podStartSLOduration=2.793958425 podStartE2EDuration="21.090747573s" totalImagesPullingTime="18.296789148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:56:12.090626192 +0000 UTC m=+21.644622084" watchObservedRunningTime="2026-09-10 15:56:12.090747573 +0000 UTC m=+21.644743465" Sep 10 15:56:12.153669 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.153615 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g8ckx" podStartSLOduration=2.838268061 podStartE2EDuration="21.15359682s" totalImagesPullingTime="18.315328759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:56:12.123403749 +0000 UTC m=+21.677399641" watchObservedRunningTime="2026-09-10 15:56:12.15359682 +0000 UTC m=+21.707592713" Sep 10 15:56:12.153762 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.153726 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-28np2" podStartSLOduration=2.859122799 podStartE2EDuration="21.153719772s" totalImagesPullingTime="18.294596973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:56:12.153538714 +0000 UTC m=+21.707534606" watchObservedRunningTime="2026-09-10 15:56:12.153719772 +0000 UTC m=+21.707715666" Sep 10 15:56:12.206996 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.206690 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jxd26" podStartSLOduration=2.461418814 podStartE2EDuration="21.206670087s" totalImagesPullingTime="18.745251273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:56:12.177138332 +0000 UTC m=+21.731134224" watchObservedRunningTime="2026-09-10 15:56:12.206670087 +0000 UTC m=+21.760665980" Sep 10 15:56:12.950888 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.950860 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:12.951028 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:12.950982 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlx6p" podUID="4e63901b-f7d1-4957-a13c-24bc96170b41" Sep 10 15:56:12.951413 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.951343 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:12.951413 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:12.951374 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:12.951571 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:12.951473 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fhhc7" podUID="66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1" Sep 10 15:56:12.951624 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:12.951569 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gj8vg" podUID="885055da-965e-4c0d-915d-b2a2c078b5f4" Sep 10 15:56:13.027111 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:13.027088 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 15:56:13.042994 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:13.042977 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2r27m_9feb0e61-fa46-4164-9ab2-cbfdd536205b/ovn-acl-logging/0.log" Sep 10 15:56:13.043400 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:13.043380 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" event={"ID":"9feb0e61-fa46-4164-9ab2-cbfdd536205b","Type":"ContainerStarted","Data":"d84738a62cc041b212e19619e94941913c67b17dff29a3f3ab3f743e610e049d"} Sep 10 15:56:13.043464 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:13.043448 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" event={"ID":"9feb0e61-fa46-4164-9ab2-cbfdd536205b","Type":"ContainerStarted","Data":"7af3398af8c54614ec3e8839a14577529e53350f64a5b199c0d5a8d27ec409e6"} Sep 10 15:56:13.043509 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:13.043483 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" event={"ID":"9feb0e61-fa46-4164-9ab2-cbfdd536205b","Type":"ContainerStarted","Data":"e58f505424d3770d9b4d3b6b48af13994be0a9acdb5e0e8d21e292147309e009"} Sep 10 15:56:13.045167 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:13.045147 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" event={"ID":"37eddcd1-35de-421b-9b6b-381ce996b6e0","Type":"ContainerStarted","Data":"bb1efc0d00822e5b34ed9d97695c089d17341b7df80fd119ef18aa645ad79fe0"} Sep 10 15:56:13.046532 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:13.046513 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wfj7v" event={"ID":"482144a9-16e2-4b5f-b11e-90e7120f5aa0","Type":"ContainerStarted","Data":"4e631322df3cebeb12bb2f11c146293449364c19eb5e59a8b78545fd1d01ffe9"} Sep 10 15:56:13.066376 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:13.066340 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wfj7v" podStartSLOduration=3.764534995 podStartE2EDuration="22.06632495s" totalImagesPullingTime="18.301789955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:56:13.065933997 +0000 UTC m=+22.619929891" watchObservedRunningTime="2026-09-10 15:56:13.06632495 +0000 UTC m=+22.620320844" Sep 10 15:56:13.453701 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:13.453666 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rq6n2" Sep 10 15:56:13.882254 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:13.882079 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T15:56:13.027106952Z","UUID":"a00777e2-758e-4792-8f2c-44ce91d5f930","Handler":null,"Name":"","Endpoint":""} Sep 10 15:56:13.883885 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:13.883852 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 15:56:13.884023 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:13.883906 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 15:56:14.950898 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:14.950866 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:14.950898 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:14.950896 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:14.951491 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:14.950866 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:14.951491 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:14.950979 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fhhc7" podUID="66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1" Sep 10 15:56:14.951601 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:14.951522 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gj8vg" podUID="885055da-965e-4c0d-915d-b2a2c078b5f4" Sep 10 15:56:14.951682 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:14.951652 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlx6p" podUID="4e63901b-f7d1-4957-a13c-24bc96170b41" Sep 10 15:56:15.053057 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:15.053018 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" event={"ID":"37eddcd1-35de-421b-9b6b-381ce996b6e0","Type":"ContainerStarted","Data":"c9dc1f7ffd102f1836bdc81526489f9e45b68afa3f01d57ea28a877f327b2401"} Sep 10 15:56:15.056187 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:15.056168 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2r27m_9feb0e61-fa46-4164-9ab2-cbfdd536205b/ovn-acl-logging/0.log" Sep 10 15:56:15.056530 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:15.056511 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" event={"ID":"9feb0e61-fa46-4164-9ab2-cbfdd536205b","Type":"ContainerStarted","Data":"7d7e96e17ae3bfbb0aa8f0b9a584c6f7db0d2c8556d02d11409283cfec7e4797"} Sep 10 15:56:15.081063 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:15.081023 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jsrm8" podStartSLOduration=3.6069018 podStartE2EDuration="24.081011105s" totalImagesPullingTime="20.474109305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:55:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:56:15.080838541 +0000 UTC m=+24.634834433" watchObservedRunningTime="2026-09-10 15:56:15.081011105 +0000 UTC m=+24.635007018" Sep 10 15:56:16.676897 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:16.676861 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rq6n2" Sep 10 15:56:16.677615 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:16.677592 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rq6n2" Sep 10 15:56:16.951356 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:16.951156 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:16.951535 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:16.951156 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:16.951535 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:16.951460 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gj8vg" podUID="885055da-965e-4c0d-915d-b2a2c078b5f4" Sep 10 15:56:16.951535 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:16.951248 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:16.951535 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:16.951498 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fhhc7" podUID="66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1" Sep 10 15:56:16.951748 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:16.951577 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlx6p" podUID="4e63901b-f7d1-4957-a13c-24bc96170b41" Sep 10 15:56:17.061024 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:17.060993 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rq6n2" Sep 10 15:56:18.950880 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:18.950850 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:18.951591 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:18.950851 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:18.951591 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:18.950990 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gj8vg" podUID="885055da-965e-4c0d-915d-b2a2c078b5f4" Sep 10 15:56:18.951591 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:18.950860 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:18.951591 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:18.951053 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlx6p" podUID="4e63901b-f7d1-4957-a13c-24bc96170b41" Sep 10 15:56:18.951591 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:18.951118 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fhhc7" podUID="66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1" Sep 10 15:56:19.065717 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:19.065680 2574 generic.go:356] "Generic (PLEG): container finished" podID="a1c164f8-7f7a-46da-9b51-3b43f80aae6c" containerID="489f0209c8a24f3d6817e679d103824f467b13e43bce81feff85aced7da9417a" exitCode=0 Sep 10 15:56:19.065897 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:19.065759 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltdqc" event={"ID":"a1c164f8-7f7a-46da-9b51-3b43f80aae6c","Type":"ContainerDied","Data":"489f0209c8a24f3d6817e679d103824f467b13e43bce81feff85aced7da9417a"} Sep 10 15:56:19.069493 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:19.069477 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2r27m_9feb0e61-fa46-4164-9ab2-cbfdd536205b/ovn-acl-logging/0.log" Sep 10 15:56:19.069849 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:19.069830 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" event={"ID":"9feb0e61-fa46-4164-9ab2-cbfdd536205b","Type":"ContainerStarted","Data":"b05de7ed125cfddc3682aabb38eed33ee83bab4e0f5cfe7a00fd8a4492a2e2e6"} Sep 10 15:56:19.070126 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:19.070107 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:56:19.070267 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:19.070252 2574 scope.go:117] "RemoveContainer" containerID="ee4001c9e417da79875dd292900181bf2462adeb023823fe9ed3c50ab526060f" Sep 10 15:56:19.086059 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:19.086041 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:56:20.076137 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:20.075950 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2r27m_9feb0e61-fa46-4164-9ab2-cbfdd536205b/ovn-acl-logging/0.log" Sep 10 15:56:20.076543 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:20.076500 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" event={"ID":"9feb0e61-fa46-4164-9ab2-cbfdd536205b","Type":"ContainerStarted","Data":"08629ad03e996a5b3d597959aecb57c83469775e174686575da5c73363c80565"} Sep 10 15:56:20.076671 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:20.076656 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:56:20.076725 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:20.076707 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:56:20.092295 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:20.092273 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:56:20.113263 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:20.113221 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" podStartSLOduration=10.737115416 podStartE2EDuration="29.113185191s" totalImagesPullingTime="18.376069775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:56:20.112697398 +0000 UTC m=+29.666693289" watchObservedRunningTime="2026-09-10 15:56:20.113185191 +0000 UTC m=+29.667181082" Sep 10 15:56:20.143522 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:20.143491 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fhhc7"] Sep 10 15:56:20.143659 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:20.143629 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:20.143739 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:20.143714 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fhhc7" podUID="66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1" Sep 10 15:56:20.146748 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:20.146714 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rlx6p"] Sep 10 15:56:20.146911 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:20.146827 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:20.146975 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:20.146914 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlx6p" podUID="4e63901b-f7d1-4957-a13c-24bc96170b41" Sep 10 15:56:20.147421 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:20.147394 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gj8vg"] Sep 10 15:56:20.147532 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:20.147488 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:20.147589 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:20.147570 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gj8vg" podUID="885055da-965e-4c0d-915d-b2a2c078b5f4" Sep 10 15:56:21.080910 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:21.080880 2574 generic.go:356] "Generic (PLEG): container finished" podID="a1c164f8-7f7a-46da-9b51-3b43f80aae6c" containerID="24ba124ad5202da8a961e19de00100c79a87015ceebedc0d9bc4e5b18c85ff25" exitCode=0 Sep 10 15:56:21.081286 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:21.080949 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltdqc" event={"ID":"a1c164f8-7f7a-46da-9b51-3b43f80aae6c","Type":"ContainerDied","Data":"24ba124ad5202da8a961e19de00100c79a87015ceebedc0d9bc4e5b18c85ff25"} Sep 10 15:56:21.950854 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:21.950670 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:21.951002 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:21.950696 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:21.951002 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:21.950924 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlx6p" podUID="4e63901b-f7d1-4957-a13c-24bc96170b41" Sep 10 15:56:21.951002 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:21.950723 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:21.951002 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:21.950992 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fhhc7" podUID="66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1" Sep 10 15:56:21.951163 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:21.951084 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gj8vg" podUID="885055da-965e-4c0d-915d-b2a2c078b5f4" Sep 10 15:56:23.086873 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:23.086836 2574 generic.go:356] "Generic (PLEG): container finished" podID="a1c164f8-7f7a-46da-9b51-3b43f80aae6c" containerID="db74fa25223cb366f71ba9aeb18d96beaded28c2b67e9855dbb4345555a957eb" exitCode=0 Sep 10 15:56:23.087354 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:23.086920 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltdqc" event={"ID":"a1c164f8-7f7a-46da-9b51-3b43f80aae6c","Type":"ContainerDied","Data":"db74fa25223cb366f71ba9aeb18d96beaded28c2b67e9855dbb4345555a957eb"} Sep 10 15:56:23.950763 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:23.950727 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:23.950957 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:23.950727 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:23.950957 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:23.950840 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rlx6p" podUID="4e63901b-f7d1-4957-a13c-24bc96170b41" Sep 10 15:56:23.951096 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:23.950957 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gj8vg" podUID="885055da-965e-4c0d-915d-b2a2c078b5f4" Sep 10 15:56:23.951096 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:23.950727 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:23.951096 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:23.951055 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fhhc7" podUID="66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1" Sep 10 15:56:24.680895 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:24.680861 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs\") pod \"network-metrics-daemon-gj8vg\" (UID: \"885055da-965e-4c0d-915d-b2a2c078b5f4\") " pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:24.681410 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:24.680914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret\") pod \"global-pull-secret-syncer-fhhc7\" (UID: \"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1\") " pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:24.681410 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:24.681014 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 15:56:24.681410 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:24.681047 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 15:56:24.681410 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:24.681091 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs podName:885055da-965e-4c0d-915d-b2a2c078b5f4 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:56.681071203 +0000 UTC m=+66.235067093 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs") pod "network-metrics-daemon-gj8vg" (UID: "885055da-965e-4c0d-915d-b2a2c078b5f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 15:56:24.681410 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:24.681107 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret podName:66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:56.681101001 +0000 UTC m=+66.235096869 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret") pod "global-pull-secret-syncer-fhhc7" (UID: "66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1") : object "kube-system"/"original-pull-secret" not registered Sep 10 15:56:24.782063 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:24.782035 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnmhf\" (UniqueName: \"kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf\") pod \"network-check-target-rlx6p\" (UID: \"4e63901b-f7d1-4957-a13c-24bc96170b41\") " pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:24.782234 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:24.782168 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 15:56:24.782234 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:24.782184 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 15:56:24.782234 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:24.782192 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vnmhf for pod openshift-network-diagnostics/network-check-target-rlx6p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 15:56:24.782352 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:24.782254 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf podName:4e63901b-f7d1-4957-a13c-24bc96170b41 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:56.782237416 +0000 UTC m=+66.336233287 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vnmhf" (UniqueName: "kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf") pod "network-check-target-rlx6p" (UID: "4e63901b-f7d1-4957-a13c-24bc96170b41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 15:56:25.677592 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.677512 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-28.ec2.internal" event="NodeReady" Sep 10 15:56:25.677754 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.677661 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 15:56:25.714248 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.714207 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f66fdc88f-rgsts"] Sep 10 15:56:25.726845 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.726819 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bxxvm"] Sep 10 15:56:25.726965 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.726943 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.730067 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.730045 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7j7s9\"" Sep 10 15:56:25.730170 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.730072 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 15:56:25.730170 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.730051 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 15:56:25.730282 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.730082 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 15:56:25.736228 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.736046 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 15:56:25.742964 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.742942 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zvh9n"] Sep 10 15:56:25.743095 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.743079 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:25.746527 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.746506 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 15:56:25.746662 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.746558 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fvhfz\"" Sep 10 15:56:25.746799 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.746782 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 15:56:25.766494 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.766469 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f66fdc88f-rgsts"] Sep 10 15:56:25.766612 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.766509 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zvh9n"] Sep 10 15:56:25.766612 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.766530 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bxxvm"] Sep 10 15:56:25.766612 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.766587 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zvh9n" Sep 10 15:56:25.770321 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.770300 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 15:56:25.770585 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.770560 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 15:56:25.770685 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.770607 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 15:56:25.770742 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.770568 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xwnwk\"" Sep 10 15:56:25.789978 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.789958 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53e62862-b83f-4433-b07e-161e92e937d9-image-registry-private-configuration\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.790086 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.789999 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53e62862-b83f-4433-b07e-161e92e937d9-ca-trust-extracted\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.790086 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.790033 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53e62862-b83f-4433-b07e-161e92e937d9-registry-certificates\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.790184 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.790083 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.790254 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.790186 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53e62862-b83f-4433-b07e-161e92e937d9-trusted-ca\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.790254 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.790236 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53e62862-b83f-4433-b07e-161e92e937d9-installation-pull-secrets\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.790338 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.790268 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-bound-sa-token\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.790338 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.790294 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w97n4\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-kube-api-access-w97n4\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.891256 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.891220 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-tmp-dir\") pod \"dns-default-bxxvm\" (UID: \"c3c0436a-0d7f-4f5e-a82a-c688e37206dc\") " pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:25.891377 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.891278 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-config-volume\") pod \"dns-default-bxxvm\" (UID: \"c3c0436a-0d7f-4f5e-a82a-c688e37206dc\") " pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:25.891377 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.891303 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65mk8\" (UniqueName: \"kubernetes.io/projected/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-kube-api-access-65mk8\") pod \"dns-default-bxxvm\" (UID: \"c3c0436a-0d7f-4f5e-a82a-c688e37206dc\") " pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:25.891377 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.891332 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53e62862-b83f-4433-b07e-161e92e937d9-image-registry-private-configuration\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.891377 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.891365 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53e62862-b83f-4433-b07e-161e92e937d9-ca-trust-extracted\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.891585 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.891384 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53e62862-b83f-4433-b07e-161e92e937d9-registry-certificates\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.891585 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.891428 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxfsp\" (UniqueName: \"kubernetes.io/projected/4d6ca140-781c-47f6-8fba-c82e3f0dcb11-kube-api-access-lxfsp\") pod \"ingress-canary-zvh9n\" (UID: \"4d6ca140-781c-47f6-8fba-c82e3f0dcb11\") " pod="openshift-ingress-canary/ingress-canary-zvh9n" Sep 10 15:56:25.891585 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.891462 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.891585 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:25.891568 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 15:56:25.891585 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.891564 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53e62862-b83f-4433-b07e-161e92e937d9-trusted-ca\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.891830 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.891604 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53e62862-b83f-4433-b07e-161e92e937d9-installation-pull-secrets\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.891830 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.891628 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d6ca140-781c-47f6-8fba-c82e3f0dcb11-cert\") pod \"ingress-canary-zvh9n\" (UID: \"4d6ca140-781c-47f6-8fba-c82e3f0dcb11\") " pod="openshift-ingress-canary/ingress-canary-zvh9n" Sep 10 15:56:25.891830 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.891654 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-bound-sa-token\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.891830 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.891679 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w97n4\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-kube-api-access-w97n4\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.891830 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.891704 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls\") pod \"dns-default-bxxvm\" (UID: \"c3c0436a-0d7f-4f5e-a82a-c688e37206dc\") " pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:25.892045 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.891853 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53e62862-b83f-4433-b07e-161e92e937d9-ca-trust-extracted\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.892045 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:25.891582 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f66fdc88f-rgsts: secret "image-registry-tls" not found Sep 10 15:56:25.892286 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:25.892271 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls podName:53e62862-b83f-4433-b07e-161e92e937d9 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:26.392253093 +0000 UTC m=+35.946248963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls") pod "image-registry-5f66fdc88f-rgsts" (UID: "53e62862-b83f-4433-b07e-161e92e937d9") : secret "image-registry-tls" not found Sep 10 15:56:25.892368 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.892321 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53e62862-b83f-4433-b07e-161e92e937d9-registry-certificates\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.892945 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.892916 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53e62862-b83f-4433-b07e-161e92e937d9-trusted-ca\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.896421 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.896398 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53e62862-b83f-4433-b07e-161e92e937d9-image-registry-private-configuration\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.896523 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.896427 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53e62862-b83f-4433-b07e-161e92e937d9-installation-pull-secrets\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.901402 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.901381 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w97n4\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-kube-api-access-w97n4\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.901510 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.901494 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-bound-sa-token\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:25.950843 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.950769 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:25.950969 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.950769 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:25.950969 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.950770 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:25.955845 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.955738 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v658w\"" Sep 10 15:56:25.955845 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.955829 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 15:56:25.956089 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.955851 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 15:56:25.956089 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.955886 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 15:56:25.956715 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.956571 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 15:56:25.956841 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.956573 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k5znt\"" Sep 10 15:56:25.992541 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.992512 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-config-volume\") pod \"dns-default-bxxvm\" (UID: \"c3c0436a-0d7f-4f5e-a82a-c688e37206dc\") " pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:25.992670 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.992551 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65mk8\" (UniqueName: \"kubernetes.io/projected/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-kube-api-access-65mk8\") pod \"dns-default-bxxvm\" (UID: \"c3c0436a-0d7f-4f5e-a82a-c688e37206dc\") " pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:25.992761 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.992741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxfsp\" (UniqueName: \"kubernetes.io/projected/4d6ca140-781c-47f6-8fba-c82e3f0dcb11-kube-api-access-lxfsp\") pod \"ingress-canary-zvh9n\" (UID: \"4d6ca140-781c-47f6-8fba-c82e3f0dcb11\") " pod="openshift-ingress-canary/ingress-canary-zvh9n" Sep 10 15:56:25.992861 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.992842 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d6ca140-781c-47f6-8fba-c82e3f0dcb11-cert\") pod \"ingress-canary-zvh9n\" (UID: \"4d6ca140-781c-47f6-8fba-c82e3f0dcb11\") " pod="openshift-ingress-canary/ingress-canary-zvh9n" Sep 10 15:56:25.992920 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.992881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls\") pod \"dns-default-bxxvm\" (UID: \"c3c0436a-0d7f-4f5e-a82a-c688e37206dc\") " pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:25.992920 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.992907 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-tmp-dir\") pod \"dns-default-bxxvm\" (UID: \"c3c0436a-0d7f-4f5e-a82a-c688e37206dc\") " pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:25.993058 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:25.993031 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 15:56:25.993167 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:25.993109 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls podName:c3c0436a-0d7f-4f5e-a82a-c688e37206dc nodeName:}" failed. No retries permitted until 2026-09-10 15:56:26.493088263 +0000 UTC m=+36.047084134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls") pod "dns-default-bxxvm" (UID: "c3c0436a-0d7f-4f5e-a82a-c688e37206dc") : secret "dns-default-metrics-tls" not found Sep 10 15:56:25.993167 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.993152 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-config-volume\") pod \"dns-default-bxxvm\" (UID: \"c3c0436a-0d7f-4f5e-a82a-c688e37206dc\") " pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:25.993295 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.993192 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-tmp-dir\") pod \"dns-default-bxxvm\" (UID: \"c3c0436a-0d7f-4f5e-a82a-c688e37206dc\") " pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:25.995727 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:25.995705 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d6ca140-781c-47f6-8fba-c82e3f0dcb11-cert\") pod \"ingress-canary-zvh9n\" (UID: \"4d6ca140-781c-47f6-8fba-c82e3f0dcb11\") " pod="openshift-ingress-canary/ingress-canary-zvh9n" Sep 10 15:56:26.001766 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:26.001745 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxfsp\" (UniqueName: \"kubernetes.io/projected/4d6ca140-781c-47f6-8fba-c82e3f0dcb11-kube-api-access-lxfsp\") pod \"ingress-canary-zvh9n\" (UID: \"4d6ca140-781c-47f6-8fba-c82e3f0dcb11\") " pod="openshift-ingress-canary/ingress-canary-zvh9n" Sep 10 15:56:26.002585 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:26.002558 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65mk8\" (UniqueName: \"kubernetes.io/projected/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-kube-api-access-65mk8\") pod \"dns-default-bxxvm\" (UID: \"c3c0436a-0d7f-4f5e-a82a-c688e37206dc\") " pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:26.076003 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:26.075966 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zvh9n" Sep 10 15:56:26.396363 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:26.396324 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:26.396534 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:26.396510 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 15:56:26.396534 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:26.396532 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f66fdc88f-rgsts: secret "image-registry-tls" not found Sep 10 15:56:26.396633 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:26.396595 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls podName:53e62862-b83f-4433-b07e-161e92e937d9 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:27.39657862 +0000 UTC m=+36.950574493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls") pod "image-registry-5f66fdc88f-rgsts" (UID: "53e62862-b83f-4433-b07e-161e92e937d9") : secret "image-registry-tls" not found Sep 10 15:56:26.410276 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:26.410243 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zvh9n"] Sep 10 15:56:26.497499 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:26.497463 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls\") pod \"dns-default-bxxvm\" (UID: \"c3c0436a-0d7f-4f5e-a82a-c688e37206dc\") " pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:26.497691 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:26.497592 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 15:56:26.497691 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:26.497653 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls podName:c3c0436a-0d7f-4f5e-a82a-c688e37206dc nodeName:}" failed. No retries permitted until 2026-09-10 15:56:27.497634833 +0000 UTC m=+37.051630705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls") pod "dns-default-bxxvm" (UID: "c3c0436a-0d7f-4f5e-a82a-c688e37206dc") : secret "dns-default-metrics-tls" not found Sep 10 15:56:27.404981 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.404713 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:27.405726 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:27.404872 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 15:56:27.405726 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:27.405062 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f66fdc88f-rgsts: secret "image-registry-tls" not found Sep 10 15:56:27.405726 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:27.405122 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls podName:53e62862-b83f-4433-b07e-161e92e937d9 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:29.405106321 +0000 UTC m=+38.959102193 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls") pod "image-registry-5f66fdc88f-rgsts" (UID: "53e62862-b83f-4433-b07e-161e92e937d9") : secret "image-registry-tls" not found Sep 10 15:56:27.490582 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.490551 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qpvf4"] Sep 10 15:56:27.506130 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.506100 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls\") pod \"dns-default-bxxvm\" (UID: \"c3c0436a-0d7f-4f5e-a82a-c688e37206dc\") " pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:27.506318 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:27.506276 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 15:56:27.506380 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:27.506342 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls podName:c3c0436a-0d7f-4f5e-a82a-c688e37206dc nodeName:}" failed. No retries permitted until 2026-09-10 15:56:29.506323048 +0000 UTC m=+39.060318936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls") pod "dns-default-bxxvm" (UID: "c3c0436a-0d7f-4f5e-a82a-c688e37206dc") : secret "dns-default-metrics-tls" not found Sep 10 15:56:27.510036 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.510014 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:27.514775 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.514751 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 15:56:27.515318 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.515298 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 15:56:27.516226 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.516185 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 15:56:27.516332 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.516248 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zcsvb\"" Sep 10 15:56:27.516332 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.516267 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 15:56:27.523357 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.523336 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qpvf4"] Sep 10 15:56:27.607371 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.607338 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-crio-socket\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:27.607521 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.607400 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:27.607521 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.607437 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:27.607521 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.607462 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szsvr\" (UniqueName: \"kubernetes.io/projected/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-api-access-szsvr\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:27.607662 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.607576 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-data-volume\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:27.708310 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.708220 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-data-volume\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:27.708469 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.708351 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-crio-socket\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:27.708469 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.708376 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:27.708469 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.708393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:27.708469 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.708409 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szsvr\" (UniqueName: \"kubernetes.io/projected/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-api-access-szsvr\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:27.708675 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:27.708512 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 15:56:27.708675 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:27.708557 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 15:56:27.708675 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:27.708592 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-rbac-proxy-cm podName:5185c4fa-fd82-464f-a9ad-73e3512b7bf6 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:28.208571785 +0000 UTC m=+37.762567669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qpvf4" (UID: "5185c4fa-fd82-464f-a9ad-73e3512b7bf6") : configmap "kube-rbac-proxy" not found Sep 10 15:56:27.708675 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.708513 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-data-volume\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:27.708675 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:27.708612 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls podName:5185c4fa-fd82-464f-a9ad-73e3512b7bf6 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:28.208602095 +0000 UTC m=+37.762597971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qpvf4" (UID: "5185c4fa-fd82-464f-a9ad-73e3512b7bf6") : secret "insights-runtime-extractor-tls" not found Sep 10 15:56:27.708911 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.708683 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-crio-socket\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:27.721177 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:27.721149 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szsvr\" (UniqueName: \"kubernetes.io/projected/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-api-access-szsvr\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:27.766280 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:56:27.766254 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6ca140_781c_47f6_8fba_c82e3f0dcb11.slice/crio-dbe2aa804619458c35e1c8f047c7c7d34d621a63c9c83584f7d9b28c2ba6c4ad WatchSource:0}: Error finding container dbe2aa804619458c35e1c8f047c7c7d34d621a63c9c83584f7d9b28c2ba6c4ad: Status 404 returned error can't find the container with id dbe2aa804619458c35e1c8f047c7c7d34d621a63c9c83584f7d9b28c2ba6c4ad Sep 10 15:56:28.101597 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:28.101569 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zvh9n" event={"ID":"4d6ca140-781c-47f6-8fba-c82e3f0dcb11","Type":"ContainerStarted","Data":"dbe2aa804619458c35e1c8f047c7c7d34d621a63c9c83584f7d9b28c2ba6c4ad"} Sep 10 15:56:28.213773 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:28.213739 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:28.213773 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:28.213779 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:28.213989 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:28.213870 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 15:56:28.213989 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:28.213889 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 15:56:28.213989 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:28.213950 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-rbac-proxy-cm podName:5185c4fa-fd82-464f-a9ad-73e3512b7bf6 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:29.213927883 +0000 UTC m=+38.767923763 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qpvf4" (UID: "5185c4fa-fd82-464f-a9ad-73e3512b7bf6") : configmap "kube-rbac-proxy" not found Sep 10 15:56:28.213989 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:28.213971 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls podName:5185c4fa-fd82-464f-a9ad-73e3512b7bf6 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:29.213961298 +0000 UTC m=+38.767957178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qpvf4" (UID: "5185c4fa-fd82-464f-a9ad-73e3512b7bf6") : secret "insights-runtime-extractor-tls" not found Sep 10 15:56:28.851142 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:28.851061 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-28np2_023336c2-9df2-43ed-a744-b6d63753fc2a/dns-node-resolver/0.log" Sep 10 15:56:28.944134 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:28.943960 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mdl9f"] Sep 10 15:56:28.970043 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:28.970014 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mdl9f"] Sep 10 15:56:28.970264 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:28.970243 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mdl9f" Sep 10 15:56:28.974023 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:28.973996 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 10 15:56:28.974519 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:28.974495 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2cfjt\"" Sep 10 15:56:28.974977 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:28.974957 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 10 15:56:29.108021 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:29.107927 2574 generic.go:356] "Generic (PLEG): container finished" podID="a1c164f8-7f7a-46da-9b51-3b43f80aae6c" containerID="e585b9b5504cc7aa76d2900ca5a1fe255c94c3784a4b9cb4cce197e057c78270" exitCode=0 Sep 10 15:56:29.108190 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:29.108021 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltdqc" event={"ID":"a1c164f8-7f7a-46da-9b51-3b43f80aae6c","Type":"ContainerDied","Data":"e585b9b5504cc7aa76d2900ca5a1fe255c94c3784a4b9cb4cce197e057c78270"} Sep 10 15:56:29.121321 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:29.121294 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqbxp\" (UniqueName: \"kubernetes.io/projected/81c6ad20-f2f2-478e-992d-d774c64ace8f-kube-api-access-jqbxp\") pod \"migrator-fdbb8fdff-mdl9f\" (UID: \"81c6ad20-f2f2-478e-992d-d774c64ace8f\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mdl9f" Sep 10 15:56:29.222395 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:29.222362 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:29.222566 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:29.222407 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:29.222566 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:29.222436 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqbxp\" (UniqueName: \"kubernetes.io/projected/81c6ad20-f2f2-478e-992d-d774c64ace8f-kube-api-access-jqbxp\") pod \"migrator-fdbb8fdff-mdl9f\" (UID: \"81c6ad20-f2f2-478e-992d-d774c64ace8f\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mdl9f" Sep 10 15:56:29.222566 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:29.222503 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 15:56:29.222724 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:29.222570 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-rbac-proxy-cm podName:5185c4fa-fd82-464f-a9ad-73e3512b7bf6 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:31.22255074 +0000 UTC m=+40.776546624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qpvf4" (UID: "5185c4fa-fd82-464f-a9ad-73e3512b7bf6") : configmap "kube-rbac-proxy" not found Sep 10 15:56:29.222954 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:29.222927 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 15:56:29.223066 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:29.222989 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls podName:5185c4fa-fd82-464f-a9ad-73e3512b7bf6 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:31.222975345 +0000 UTC m=+40.776971214 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qpvf4" (UID: "5185c4fa-fd82-464f-a9ad-73e3512b7bf6") : secret "insights-runtime-extractor-tls" not found Sep 10 15:56:29.235870 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:29.235839 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqbxp\" (UniqueName: \"kubernetes.io/projected/81c6ad20-f2f2-478e-992d-d774c64ace8f-kube-api-access-jqbxp\") pod \"migrator-fdbb8fdff-mdl9f\" (UID: \"81c6ad20-f2f2-478e-992d-d774c64ace8f\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mdl9f" Sep 10 15:56:29.280717 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:29.280673 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mdl9f" Sep 10 15:56:29.424094 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:29.423984 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:29.424258 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:29.424148 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 15:56:29.424258 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:29.424168 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f66fdc88f-rgsts: secret "image-registry-tls" not found Sep 10 15:56:29.424258 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:29.424249 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls podName:53e62862-b83f-4433-b07e-161e92e937d9 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:33.424231772 +0000 UTC m=+42.978227640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls") pod "image-registry-5f66fdc88f-rgsts" (UID: "53e62862-b83f-4433-b07e-161e92e937d9") : secret "image-registry-tls" not found Sep 10 15:56:29.525023 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:29.524974 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls\") pod \"dns-default-bxxvm\" (UID: \"c3c0436a-0d7f-4f5e-a82a-c688e37206dc\") " pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:29.525215 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:29.525117 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 15:56:29.525215 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:29.525177 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls podName:c3c0436a-0d7f-4f5e-a82a-c688e37206dc nodeName:}" failed. No retries permitted until 2026-09-10 15:56:33.525162869 +0000 UTC m=+43.079158738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls") pod "dns-default-bxxvm" (UID: "c3c0436a-0d7f-4f5e-a82a-c688e37206dc") : secret "dns-default-metrics-tls" not found Sep 10 15:56:29.568001 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:29.567975 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mdl9f"] Sep 10 15:56:30.032385 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.032317 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qdj56_e4beb35b-8f19-446b-8344-511819233a1f/node-ca/0.log" Sep 10 15:56:30.114386 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.114350 2574 generic.go:356] "Generic (PLEG): container finished" podID="a1c164f8-7f7a-46da-9b51-3b43f80aae6c" containerID="7d18ba78212108faf3babd66475ea413df3230506cfa1f57b6cdaefed8e7fda5" exitCode=0 Sep 10 15:56:30.114546 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.114411 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltdqc" event={"ID":"a1c164f8-7f7a-46da-9b51-3b43f80aae6c","Type":"ContainerDied","Data":"7d18ba78212108faf3babd66475ea413df3230506cfa1f57b6cdaefed8e7fda5"} Sep 10 15:56:30.171602 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.171566 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-hk6wl"] Sep 10 15:56:30.208358 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.208324 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-hk6wl"] Sep 10 15:56:30.208523 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.208394 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-hk6wl" Sep 10 15:56:30.212975 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.212508 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 10 15:56:30.212975 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.212697 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 10 15:56:30.212975 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.212779 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 10 15:56:30.213305 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.213004 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 10 15:56:30.213305 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.213051 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qhsw2\"" Sep 10 15:56:30.317515 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:56:30.317445 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81c6ad20_f2f2_478e_992d_d774c64ace8f.slice/crio-1630d139617e9fed788ccdbbf249bf8013895c2de315579bbf5b879a609eee53 WatchSource:0}: Error finding container 1630d139617e9fed788ccdbbf249bf8013895c2de315579bbf5b879a609eee53: Status 404 returned error can't find the container with id 1630d139617e9fed788ccdbbf249bf8013895c2de315579bbf5b879a609eee53 Sep 10 15:56:30.332289 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.332262 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/886ce283-614f-4d93-b787-3510b049c34c-signing-cabundle\") pod \"service-ca-75d99c484-hk6wl\" (UID: \"886ce283-614f-4d93-b787-3510b049c34c\") " pod="openshift-service-ca/service-ca-75d99c484-hk6wl" Sep 10 15:56:30.332391 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.332300 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/886ce283-614f-4d93-b787-3510b049c34c-signing-key\") pod \"service-ca-75d99c484-hk6wl\" (UID: \"886ce283-614f-4d93-b787-3510b049c34c\") " pod="openshift-service-ca/service-ca-75d99c484-hk6wl" Sep 10 15:56:30.332391 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.332325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77tdz\" (UniqueName: \"kubernetes.io/projected/886ce283-614f-4d93-b787-3510b049c34c-kube-api-access-77tdz\") pod \"service-ca-75d99c484-hk6wl\" (UID: \"886ce283-614f-4d93-b787-3510b049c34c\") " pod="openshift-service-ca/service-ca-75d99c484-hk6wl" Sep 10 15:56:30.433639 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.433478 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/886ce283-614f-4d93-b787-3510b049c34c-signing-cabundle\") pod \"service-ca-75d99c484-hk6wl\" (UID: \"886ce283-614f-4d93-b787-3510b049c34c\") " pod="openshift-service-ca/service-ca-75d99c484-hk6wl" Sep 10 15:56:30.433716 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.433673 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/886ce283-614f-4d93-b787-3510b049c34c-signing-key\") pod \"service-ca-75d99c484-hk6wl\" (UID: \"886ce283-614f-4d93-b787-3510b049c34c\") " pod="openshift-service-ca/service-ca-75d99c484-hk6wl" Sep 10 15:56:30.433716 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.433698 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77tdz\" (UniqueName: \"kubernetes.io/projected/886ce283-614f-4d93-b787-3510b049c34c-kube-api-access-77tdz\") pod \"service-ca-75d99c484-hk6wl\" (UID: \"886ce283-614f-4d93-b787-3510b049c34c\") " pod="openshift-service-ca/service-ca-75d99c484-hk6wl" Sep 10 15:56:30.434123 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.434105 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/886ce283-614f-4d93-b787-3510b049c34c-signing-cabundle\") pod \"service-ca-75d99c484-hk6wl\" (UID: \"886ce283-614f-4d93-b787-3510b049c34c\") " pod="openshift-service-ca/service-ca-75d99c484-hk6wl" Sep 10 15:56:30.436954 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.436924 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/886ce283-614f-4d93-b787-3510b049c34c-signing-key\") pod \"service-ca-75d99c484-hk6wl\" (UID: \"886ce283-614f-4d93-b787-3510b049c34c\") " pod="openshift-service-ca/service-ca-75d99c484-hk6wl" Sep 10 15:56:30.445775 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.445755 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77tdz\" (UniqueName: \"kubernetes.io/projected/886ce283-614f-4d93-b787-3510b049c34c-kube-api-access-77tdz\") pod \"service-ca-75d99c484-hk6wl\" (UID: \"886ce283-614f-4d93-b787-3510b049c34c\") " pod="openshift-service-ca/service-ca-75d99c484-hk6wl" Sep 10 15:56:30.520608 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.520575 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-hk6wl" Sep 10 15:56:30.881018 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:30.880940 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-hk6wl"] Sep 10 15:56:30.883735 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:56:30.883711 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod886ce283_614f_4d93_b787_3510b049c34c.slice/crio-64381bc836bc791fe3bae65a88dae6d859792d24126b7bf0bc5bb993e830c10a WatchSource:0}: Error finding container 64381bc836bc791fe3bae65a88dae6d859792d24126b7bf0bc5bb993e830c10a: Status 404 returned error can't find the container with id 64381bc836bc791fe3bae65a88dae6d859792d24126b7bf0bc5bb993e830c10a Sep 10 15:56:31.120083 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:31.120048 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltdqc" event={"ID":"a1c164f8-7f7a-46da-9b51-3b43f80aae6c","Type":"ContainerStarted","Data":"50740ae67657175599cbe974006f50e9226e0285b3ba71f033b4613e5f8daf8a"} Sep 10 15:56:31.121533 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:31.121508 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zvh9n" event={"ID":"4d6ca140-781c-47f6-8fba-c82e3f0dcb11","Type":"ContainerStarted","Data":"e1a06f8a6d82ce8ae36583af6d995b9fa86d28641dd3d7342ac19ea5aa65253d"} Sep 10 15:56:31.122662 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:31.122638 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-hk6wl" event={"ID":"886ce283-614f-4d93-b787-3510b049c34c","Type":"ContainerStarted","Data":"64381bc836bc791fe3bae65a88dae6d859792d24126b7bf0bc5bb993e830c10a"} Sep 10 15:56:31.123544 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:31.123526 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mdl9f" event={"ID":"81c6ad20-f2f2-478e-992d-d774c64ace8f","Type":"ContainerStarted","Data":"1630d139617e9fed788ccdbbf249bf8013895c2de315579bbf5b879a609eee53"} Sep 10 15:56:31.167214 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:31.167115 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ltdqc" podStartSLOduration=8.283808515 podStartE2EDuration="40.167100381s" totalImagesPullingTime="31.883291866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:55:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:56:31.164760758 +0000 UTC m=+40.718756660" watchObservedRunningTime="2026-09-10 15:56:31.167100381 +0000 UTC m=+40.721096272" Sep 10 15:56:31.207166 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:31.207122 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zvh9n" podStartSLOduration=3.369544746 podStartE2EDuration="6.207109893s" totalImagesPullingTime="2.837565147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:56:31.205606596 +0000 UTC m=+40.759602486" watchObservedRunningTime="2026-09-10 15:56:31.207109893 +0000 UTC m=+40.761105807" Sep 10 15:56:31.241220 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:31.241043 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:31.241220 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:31.241093 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:31.241220 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:31.241105 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 15:56:31.241220 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:31.241210 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-rbac-proxy-cm podName:5185c4fa-fd82-464f-a9ad-73e3512b7bf6 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:35.241174709 +0000 UTC m=+44.795170589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qpvf4" (UID: "5185c4fa-fd82-464f-a9ad-73e3512b7bf6") : configmap "kube-rbac-proxy" not found Sep 10 15:56:31.241509 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:31.241242 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 15:56:31.241509 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:31.241282 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls podName:5185c4fa-fd82-464f-a9ad-73e3512b7bf6 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:35.241268701 +0000 UTC m=+44.795264585 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qpvf4" (UID: "5185c4fa-fd82-464f-a9ad-73e3512b7bf6") : secret "insights-runtime-extractor-tls" not found Sep 10 15:56:33.129878 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:33.129842 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mdl9f" event={"ID":"81c6ad20-f2f2-478e-992d-d774c64ace8f","Type":"ContainerStarted","Data":"3bce7c548fcc3c7297ba8999ea44cce9c14fbb4e2909c1c2b1600fb4037de5a8"} Sep 10 15:56:33.130232 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:33.129893 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mdl9f" event={"ID":"81c6ad20-f2f2-478e-992d-d774c64ace8f","Type":"ContainerStarted","Data":"a2aaede8d7a04ed1618866dbd076059a50a8bb36b052c58b659ca28a97f34a0d"} Sep 10 15:56:33.460686 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:33.460655 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:33.460819 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:33.460786 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 15:56:33.460819 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:33.460803 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f66fdc88f-rgsts: secret "image-registry-tls" not found Sep 10 15:56:33.460917 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:33.460850 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls podName:53e62862-b83f-4433-b07e-161e92e937d9 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:41.46083736 +0000 UTC m=+51.014833230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls") pod "image-registry-5f66fdc88f-rgsts" (UID: "53e62862-b83f-4433-b07e-161e92e937d9") : secret "image-registry-tls" not found Sep 10 15:56:33.561326 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:33.561294 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls\") pod \"dns-default-bxxvm\" (UID: \"c3c0436a-0d7f-4f5e-a82a-c688e37206dc\") " pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:33.561496 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:33.561450 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 15:56:33.561549 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:33.561514 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls podName:c3c0436a-0d7f-4f5e-a82a-c688e37206dc nodeName:}" failed. No retries permitted until 2026-09-10 15:56:41.561498415 +0000 UTC m=+51.115494307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls") pod "dns-default-bxxvm" (UID: "c3c0436a-0d7f-4f5e-a82a-c688e37206dc") : secret "dns-default-metrics-tls" not found Sep 10 15:56:34.133762 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:34.133723 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-hk6wl" event={"ID":"886ce283-614f-4d93-b787-3510b049c34c","Type":"ContainerStarted","Data":"682d4a6552c24b5759e818d655b7d297de3b29a945fdf03e6be0d1ad231a1d78"} Sep 10 15:56:34.157819 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:34.157770 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-mdl9f" podStartSLOduration=4.239264041 podStartE2EDuration="6.157755128s" totalImagesPullingTime="1.918491087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:56:33.153373577 +0000 UTC m=+42.707369469" watchObservedRunningTime="2026-09-10 15:56:34.157755128 +0000 UTC m=+43.711751035" Sep 10 15:56:35.277580 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:35.277527 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:35.277580 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:35.277585 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:35.278099 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:35.277773 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 15:56:35.278099 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:56:35.277853 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls podName:5185c4fa-fd82-464f-a9ad-73e3512b7bf6 nodeName:}" failed. No retries permitted until 2026-09-10 15:56:43.277832135 +0000 UTC m=+52.831828011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qpvf4" (UID: "5185c4fa-fd82-464f-a9ad-73e3512b7bf6") : secret "insights-runtime-extractor-tls" not found Sep 10 15:56:35.278247 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:35.278137 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:41.528978 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:41.528940 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:41.531319 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:41.531302 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls\") pod \"image-registry-5f66fdc88f-rgsts\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:41.629845 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:41.629796 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls\") pod \"dns-default-bxxvm\" (UID: \"c3c0436a-0d7f-4f5e-a82a-c688e37206dc\") " pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:41.631990 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:41.631962 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c0436a-0d7f-4f5e-a82a-c688e37206dc-metrics-tls\") pod \"dns-default-bxxvm\" (UID: \"c3c0436a-0d7f-4f5e-a82a-c688e37206dc\") " pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:41.639950 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:41.639929 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:41.652940 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:41.652916 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:41.935538 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:56:41.935512 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e62862_b83f_4433_b07e_161e92e937d9.slice/crio-e7da60b5e8845eac497b40520edd65e0493925891a1765d1f5cef7dde0d658cb WatchSource:0}: Error finding container e7da60b5e8845eac497b40520edd65e0493925891a1765d1f5cef7dde0d658cb: Status 404 returned error can't find the container with id e7da60b5e8845eac497b40520edd65e0493925891a1765d1f5cef7dde0d658cb Sep 10 15:56:41.937177 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:41.937135 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-hk6wl" podStartSLOduration=9.477064143 podStartE2EDuration="11.937120241s" totalImagesPullingTime="2.460056098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:56:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:56:34.158146498 +0000 UTC m=+43.712142390" watchObservedRunningTime="2026-09-10 15:56:41.937120241 +0000 UTC m=+51.491116144" Sep 10 15:56:41.938153 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:41.938133 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f66fdc88f-rgsts"] Sep 10 15:56:41.940566 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:41.940546 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bxxvm"] Sep 10 15:56:41.944670 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:56:41.944647 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c0436a_0d7f_4f5e_a82a_c688e37206dc.slice/crio-0984daff1980c907d74e2fd09fda59f787cdea65a244eb594781a6770d5a03cd WatchSource:0}: Error finding container 0984daff1980c907d74e2fd09fda59f787cdea65a244eb594781a6770d5a03cd: Status 404 returned error can't find the container with id 0984daff1980c907d74e2fd09fda59f787cdea65a244eb594781a6770d5a03cd Sep 10 15:56:42.156779 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:42.156740 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" event={"ID":"53e62862-b83f-4433-b07e-161e92e937d9","Type":"ContainerStarted","Data":"ddda39cf7b7c6d36a6187f9e8c769c0c5d962cc16819f1432de32972a1a957e2"} Sep 10 15:56:42.156958 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:42.156799 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" event={"ID":"53e62862-b83f-4433-b07e-161e92e937d9","Type":"ContainerStarted","Data":"e7da60b5e8845eac497b40520edd65e0493925891a1765d1f5cef7dde0d658cb"} Sep 10 15:56:42.156958 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:42.156838 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:56:42.158092 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:42.158070 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bxxvm" event={"ID":"c3c0436a-0d7f-4f5e-a82a-c688e37206dc","Type":"ContainerStarted","Data":"0984daff1980c907d74e2fd09fda59f787cdea65a244eb594781a6770d5a03cd"} Sep 10 15:56:42.192578 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:42.192476 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" podStartSLOduration=37.192458692 podStartE2EDuration="37.192458692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:56:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:56:42.190632818 +0000 UTC m=+51.744628709" watchObservedRunningTime="2026-09-10 15:56:42.192458692 +0000 UTC m=+51.746454579" Sep 10 15:56:43.342974 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:43.342923 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:43.345616 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:43.345589 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5185c4fa-fd82-464f-a9ad-73e3512b7bf6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpvf4\" (UID: \"5185c4fa-fd82-464f-a9ad-73e3512b7bf6\") " pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:43.420925 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:43.420887 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qpvf4" Sep 10 15:56:43.939861 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:43.939790 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qpvf4"] Sep 10 15:56:43.942673 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:56:43.942636 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5185c4fa_fd82_464f_a9ad_73e3512b7bf6.slice/crio-2aa5275abdde4994fa1f49ba9f78f3e444aa60a7eba31490d9606dd55b74cfd4 WatchSource:0}: Error finding container 2aa5275abdde4994fa1f49ba9f78f3e444aa60a7eba31490d9606dd55b74cfd4: Status 404 returned error can't find the container with id 2aa5275abdde4994fa1f49ba9f78f3e444aa60a7eba31490d9606dd55b74cfd4 Sep 10 15:56:44.167346 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:44.167311 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bxxvm" event={"ID":"c3c0436a-0d7f-4f5e-a82a-c688e37206dc","Type":"ContainerStarted","Data":"915bc187a4eb8bb7b0e966c6295aae0e3f5a5ca6c30807422323b139ff1a126f"} Sep 10 15:56:44.167638 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:44.167376 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bxxvm" event={"ID":"c3c0436a-0d7f-4f5e-a82a-c688e37206dc","Type":"ContainerStarted","Data":"048fb653c5551e03c28de88c0a25a376e48b69049e66a9109b101f819596f34f"} Sep 10 15:56:44.167638 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:44.167511 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:44.168910 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:44.168884 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qpvf4" event={"ID":"5185c4fa-fd82-464f-a9ad-73e3512b7bf6","Type":"ContainerStarted","Data":"a0a56a9ea5eceac1bd427d727983d5e8bbf109c5d3fb12f59028a25719cc4f1f"} Sep 10 15:56:44.168979 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:44.168939 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qpvf4" event={"ID":"5185c4fa-fd82-464f-a9ad-73e3512b7bf6","Type":"ContainerStarted","Data":"2aa5275abdde4994fa1f49ba9f78f3e444aa60a7eba31490d9606dd55b74cfd4"} Sep 10 15:56:44.196789 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:44.196693 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bxxvm" podStartSLOduration=17.453076902 podStartE2EDuration="19.196673407s" totalImagesPullingTime="1.743596505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:56:44.195676039 +0000 UTC m=+53.749671931" watchObservedRunningTime="2026-09-10 15:56:44.196673407 +0000 UTC m=+53.750669303" Sep 10 15:56:45.174132 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:45.174077 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qpvf4" event={"ID":"5185c4fa-fd82-464f-a9ad-73e3512b7bf6","Type":"ContainerStarted","Data":"0cfd26bfd8d046e68b056e0151a03a68c51678099f5fe9536d4fe65a46f40c10"} Sep 10 15:56:46.179157 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:46.179070 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qpvf4" event={"ID":"5185c4fa-fd82-464f-a9ad-73e3512b7bf6","Type":"ContainerStarted","Data":"1c012082a4bb37d61be0881a9dbc4e332b2d8259185eb4b6416421657b2729e8"} Sep 10 15:56:46.209259 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:46.209210 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qpvf4" podStartSLOduration=17.331849511 podStartE2EDuration="19.209180524s" totalImagesPullingTime="1.877331013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:56:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:56:46.208570783 +0000 UTC m=+55.762566674" watchObservedRunningTime="2026-09-10 15:56:46.209180524 +0000 UTC m=+55.763176414" Sep 10 15:56:52.092994 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:52.092964 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2r27m" Sep 10 15:56:54.176783 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:54.176756 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bxxvm" Sep 10 15:56:56.738044 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:56.738009 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs\") pod \"network-metrics-daemon-gj8vg\" (UID: \"885055da-965e-4c0d-915d-b2a2c078b5f4\") " pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:56.738437 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:56.738052 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret\") pod \"global-pull-secret-syncer-fhhc7\" (UID: \"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1\") " pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:56.741354 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:56.741339 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 15:56:56.742304 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:56.742287 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 15:56:56.750776 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:56.750760 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/885055da-965e-4c0d-915d-b2a2c078b5f4-metrics-certs\") pod \"network-metrics-daemon-gj8vg\" (UID: \"885055da-965e-4c0d-915d-b2a2c078b5f4\") " pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:56.750879 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:56.750857 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1-original-pull-secret\") pod \"global-pull-secret-syncer-fhhc7\" (UID: \"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1\") " pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:56.838418 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:56.838389 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnmhf\" (UniqueName: \"kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf\") pod \"network-check-target-rlx6p\" (UID: \"4e63901b-f7d1-4957-a13c-24bc96170b41\") " pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:56.841694 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:56.841678 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 15:56:56.852301 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:56.852281 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 15:56:56.861803 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:56.861777 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnmhf\" (UniqueName: \"kubernetes.io/projected/4e63901b-f7d1-4957-a13c-24bc96170b41-kube-api-access-vnmhf\") pod \"network-check-target-rlx6p\" (UID: \"4e63901b-f7d1-4957-a13c-24bc96170b41\") " pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:56.867352 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:56.867336 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v658w\"" Sep 10 15:56:56.870972 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:56.870960 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fhhc7" Sep 10 15:56:56.873616 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:56.873596 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:56:56.880045 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:56.880029 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k5znt\"" Sep 10 15:56:56.887391 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:56.887365 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gj8vg" Sep 10 15:56:57.151846 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:57.151818 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rlx6p"] Sep 10 15:56:57.154032 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:57.154012 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fhhc7"] Sep 10 15:56:57.155350 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:56:57.155318 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e63901b_f7d1_4957_a13c_24bc96170b41.slice/crio-6a8560d74dba61271df2525db4daf57a5586689271e6afbf9c9e5fd06e8700a3 WatchSource:0}: Error finding container 6a8560d74dba61271df2525db4daf57a5586689271e6afbf9c9e5fd06e8700a3: Status 404 returned error can't find the container with id 6a8560d74dba61271df2525db4daf57a5586689271e6afbf9c9e5fd06e8700a3 Sep 10 15:56:57.158292 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:56:57.158271 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e6345d_9054_4ab2_b8e0_daa7d5ee2eb1.slice/crio-2e946470d3f5a96fa3705ed367b2c0e80c6e2b3aefcffdf699f0be833cdc21d2 WatchSource:0}: Error finding container 2e946470d3f5a96fa3705ed367b2c0e80c6e2b3aefcffdf699f0be833cdc21d2: Status 404 returned error can't find the container with id 2e946470d3f5a96fa3705ed367b2c0e80c6e2b3aefcffdf699f0be833cdc21d2 Sep 10 15:56:57.178048 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:57.178027 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gj8vg"] Sep 10 15:56:57.180748 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:56:57.180727 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod885055da_965e_4c0d_915d_b2a2c078b5f4.slice/crio-b4b11164b3c1243d59d70a994514f021d495a0e08e447b141e3f1a368158f0e4 WatchSource:0}: Error finding container b4b11164b3c1243d59d70a994514f021d495a0e08e447b141e3f1a368158f0e4: Status 404 returned error can't find the container with id b4b11164b3c1243d59d70a994514f021d495a0e08e447b141e3f1a368158f0e4 Sep 10 15:56:57.216268 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:57.216241 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gj8vg" event={"ID":"885055da-965e-4c0d-915d-b2a2c078b5f4","Type":"ContainerStarted","Data":"b4b11164b3c1243d59d70a994514f021d495a0e08e447b141e3f1a368158f0e4"} Sep 10 15:56:57.217279 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:57.217251 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rlx6p" event={"ID":"4e63901b-f7d1-4957-a13c-24bc96170b41","Type":"ContainerStarted","Data":"6a8560d74dba61271df2525db4daf57a5586689271e6afbf9c9e5fd06e8700a3"} Sep 10 15:56:57.218280 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:57.218259 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fhhc7" event={"ID":"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1","Type":"ContainerStarted","Data":"2e946470d3f5a96fa3705ed367b2c0e80c6e2b3aefcffdf699f0be833cdc21d2"} Sep 10 15:56:59.230275 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:59.230174 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gj8vg" event={"ID":"885055da-965e-4c0d-915d-b2a2c078b5f4","Type":"ContainerStarted","Data":"df9889829a3b97245124b0f42f2c68a72d9a6fccf86cfcf364c7180aad96b553"} Sep 10 15:56:59.230275 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:59.230257 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gj8vg" event={"ID":"885055da-965e-4c0d-915d-b2a2c078b5f4","Type":"ContainerStarted","Data":"bf0a74256aa8b2f4c8142e7b1d1b6705406b5996bc25e0bfd5e144bf47a59173"} Sep 10 15:56:59.261451 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:56:59.261386 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gj8vg" podStartSLOduration=66.84321733 podStartE2EDuration="1m8.261365921s" totalImagesPullingTime="1.418148591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:56:59.260926927 +0000 UTC m=+68.814922821" watchObservedRunningTime="2026-09-10 15:56:59.261365921 +0000 UTC m=+68.815361815" Sep 10 15:57:01.644970 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:01.644922 2574 patch_prober.go:28] interesting pod/image-registry-5f66fdc88f-rgsts container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 10 15:57:01.645409 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:01.644990 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" podUID="53e62862-b83f-4433-b07e-161e92e937d9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 15:57:02.182280 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.182242 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-9wcbs"] Sep 10 15:57:02.184278 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.184260 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg"] Sep 10 15:57:02.184420 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.184398 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-9wcbs" Sep 10 15:57:02.186238 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.186217 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg" Sep 10 15:57:02.187603 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.187578 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8jdhv\"" Sep 10 15:57:02.187699 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.187578 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 15:57:02.187699 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.187588 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 15:57:02.191801 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.191784 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-thbwt\"" Sep 10 15:57:02.192079 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.192065 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 15:57:02.192167 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.192148 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 15:57:02.192512 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.192489 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 15:57:02.192567 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.192511 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 10 15:57:02.213589 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.213534 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f66fdc88f-rgsts"] Sep 10 15:57:02.214617 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.214596 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-9wcbs"] Sep 10 15:57:02.218773 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.218746 2574 patch_prober.go:28] interesting pod/image-registry-5f66fdc88f-rgsts container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 10 15:57:02.218887 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.218794 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" podUID="53e62862-b83f-4433-b07e-161e92e937d9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 15:57:02.244100 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.244067 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rlx6p" event={"ID":"4e63901b-f7d1-4957-a13c-24bc96170b41","Type":"ContainerStarted","Data":"1b52e5554aa791a15c3a016da48f81452165492ce3febed3592a56deaf684ab2"} Sep 10 15:57:02.244274 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.244183 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:57:02.245548 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.245528 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fhhc7" event={"ID":"66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1","Type":"ContainerStarted","Data":"35e127649a5ff547f6d3f0a26e09f3060edf2aa7deeb1bd81381e702bce6474c"} Sep 10 15:57:02.278824 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.278794 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfndh\" (UniqueName: \"kubernetes.io/projected/d6f95f07-6a03-40a9-ae59-938b52381d1d-kube-api-access-sfndh\") pod \"downloads-85d98c998f-9wcbs\" (UID: \"d6f95f07-6a03-40a9-ae59-938b52381d1d\") " pod="openshift-console/downloads-85d98c998f-9wcbs" Sep 10 15:57:02.278992 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.278919 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbcc8\" (UniqueName: \"kubernetes.io/projected/570d3cb9-e1b6-4d31-8be9-251fa65cb228-kube-api-access-dbcc8\") pod \"managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg\" (UID: \"570d3cb9-e1b6-4d31-8be9-251fa65cb228\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg" Sep 10 15:57:02.278992 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.278975 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/570d3cb9-e1b6-4d31-8be9-251fa65cb228-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg\" (UID: \"570d3cb9-e1b6-4d31-8be9-251fa65cb228\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg" Sep 10 15:57:02.284505 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.284480 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg"] Sep 10 15:57:02.322230 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.322137 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8d56ddb9b-8tk2d"] Sep 10 15:57:02.324334 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.324180 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.372075 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.372042 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8d56ddb9b-8tk2d"] Sep 10 15:57:02.380027 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.380000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8475d2ca-192b-4325-97ef-36db65d43acd-image-registry-private-configuration\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.380027 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.380030 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8475d2ca-192b-4325-97ef-36db65d43acd-installation-pull-secrets\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.380268 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.380051 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8475d2ca-192b-4325-97ef-36db65d43acd-registry-tls\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.380268 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.380070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pwh5\" (UniqueName: \"kubernetes.io/projected/8475d2ca-192b-4325-97ef-36db65d43acd-kube-api-access-5pwh5\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.380268 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.380128 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8475d2ca-192b-4325-97ef-36db65d43acd-registry-certificates\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.380268 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.380252 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8475d2ca-192b-4325-97ef-36db65d43acd-bound-sa-token\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.380425 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.380280 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/570d3cb9-e1b6-4d31-8be9-251fa65cb228-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg\" (UID: \"570d3cb9-e1b6-4d31-8be9-251fa65cb228\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg" Sep 10 15:57:02.380425 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.380301 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8475d2ca-192b-4325-97ef-36db65d43acd-ca-trust-extracted\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.380425 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.380319 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfndh\" (UniqueName: \"kubernetes.io/projected/d6f95f07-6a03-40a9-ae59-938b52381d1d-kube-api-access-sfndh\") pod \"downloads-85d98c998f-9wcbs\" (UID: \"d6f95f07-6a03-40a9-ae59-938b52381d1d\") " pod="openshift-console/downloads-85d98c998f-9wcbs" Sep 10 15:57:02.380425 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.380358 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8475d2ca-192b-4325-97ef-36db65d43acd-trusted-ca\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.380425 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.380394 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbcc8\" (UniqueName: \"kubernetes.io/projected/570d3cb9-e1b6-4d31-8be9-251fa65cb228-kube-api-access-dbcc8\") pod \"managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg\" (UID: \"570d3cb9-e1b6-4d31-8be9-251fa65cb228\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg" Sep 10 15:57:02.382907 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.382887 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/570d3cb9-e1b6-4d31-8be9-251fa65cb228-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg\" (UID: \"570d3cb9-e1b6-4d31-8be9-251fa65cb228\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg" Sep 10 15:57:02.417791 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.417762 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbcc8\" (UniqueName: \"kubernetes.io/projected/570d3cb9-e1b6-4d31-8be9-251fa65cb228-kube-api-access-dbcc8\") pod \"managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg\" (UID: \"570d3cb9-e1b6-4d31-8be9-251fa65cb228\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg" Sep 10 15:57:02.418283 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.418259 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfndh\" (UniqueName: \"kubernetes.io/projected/d6f95f07-6a03-40a9-ae59-938b52381d1d-kube-api-access-sfndh\") pod \"downloads-85d98c998f-9wcbs\" (UID: \"d6f95f07-6a03-40a9-ae59-938b52381d1d\") " pod="openshift-console/downloads-85d98c998f-9wcbs" Sep 10 15:57:02.481282 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.481227 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8475d2ca-192b-4325-97ef-36db65d43acd-image-registry-private-configuration\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.481282 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.481283 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8475d2ca-192b-4325-97ef-36db65d43acd-installation-pull-secrets\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.481533 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.481304 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8475d2ca-192b-4325-97ef-36db65d43acd-registry-tls\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.481533 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.481327 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pwh5\" (UniqueName: \"kubernetes.io/projected/8475d2ca-192b-4325-97ef-36db65d43acd-kube-api-access-5pwh5\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.481533 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.481352 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8475d2ca-192b-4325-97ef-36db65d43acd-registry-certificates\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.481533 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.481374 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8475d2ca-192b-4325-97ef-36db65d43acd-bound-sa-token\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.481533 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.481395 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8475d2ca-192b-4325-97ef-36db65d43acd-ca-trust-extracted\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.481533 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.481429 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8475d2ca-192b-4325-97ef-36db65d43acd-trusted-ca\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.481946 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.481920 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8475d2ca-192b-4325-97ef-36db65d43acd-ca-trust-extracted\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.482419 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.482394 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8475d2ca-192b-4325-97ef-36db65d43acd-registry-certificates\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.482837 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.482815 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8475d2ca-192b-4325-97ef-36db65d43acd-trusted-ca\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.483756 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.483729 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8475d2ca-192b-4325-97ef-36db65d43acd-installation-pull-secrets\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.483839 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.483770 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8475d2ca-192b-4325-97ef-36db65d43acd-image-registry-private-configuration\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.483879 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.483860 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8475d2ca-192b-4325-97ef-36db65d43acd-registry-tls\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.494711 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.494691 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-9wcbs" Sep 10 15:57:02.500325 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.500285 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fhhc7" podStartSLOduration=66.622914125 podStartE2EDuration="1m11.50027022s" totalImagesPullingTime="4.877356095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 15:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:57:02.498435601 +0000 UTC m=+72.052431492" watchObservedRunningTime="2026-09-10 15:57:02.50027022 +0000 UTC m=+72.054266110" Sep 10 15:57:02.504748 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.504727 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pwh5\" (UniqueName: \"kubernetes.io/projected/8475d2ca-192b-4325-97ef-36db65d43acd-kube-api-access-5pwh5\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.510402 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.510375 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8475d2ca-192b-4325-97ef-36db65d43acd-bound-sa-token\") pod \"image-registry-8d56ddb9b-8tk2d\" (UID: \"8475d2ca-192b-4325-97ef-36db65d43acd\") " pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.512285 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.512269 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg" Sep 10 15:57:02.541212 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.540971 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rlx6p" podStartSLOduration=66.662660242 podStartE2EDuration="1m11.540950248s" totalImagesPullingTime="4.878290006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:57:02.540015536 +0000 UTC m=+72.094011428" watchObservedRunningTime="2026-09-10 15:57:02.540950248 +0000 UTC m=+72.094946140" Sep 10 15:57:02.632886 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.632853 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:02.792704 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.792629 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-9wcbs"] Sep 10 15:57:02.796672 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:57:02.796645 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6f95f07_6a03_40a9_ae59_938b52381d1d.slice/crio-ca180f26c507305741db09fd925edae1beca1a9a5e9a38c42a62e455d710ab0c WatchSource:0}: Error finding container ca180f26c507305741db09fd925edae1beca1a9a5e9a38c42a62e455d710ab0c: Status 404 returned error can't find the container with id ca180f26c507305741db09fd925edae1beca1a9a5e9a38c42a62e455d710ab0c Sep 10 15:57:02.812674 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.812646 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg"] Sep 10 15:57:02.812927 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:57:02.812907 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod570d3cb9_e1b6_4d31_8be9_251fa65cb228.slice/crio-26a1fd1c2c386ca8b2f9cf89a0b16fd2ca5cc56410c7c0af95431e514b02c2d5 WatchSource:0}: Error finding container 26a1fd1c2c386ca8b2f9cf89a0b16fd2ca5cc56410c7c0af95431e514b02c2d5: Status 404 returned error can't find the container with id 26a1fd1c2c386ca8b2f9cf89a0b16fd2ca5cc56410c7c0af95431e514b02c2d5 Sep 10 15:57:02.937762 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:02.937687 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8d56ddb9b-8tk2d"] Sep 10 15:57:03.250309 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:03.250226 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-9wcbs" event={"ID":"d6f95f07-6a03-40a9-ae59-938b52381d1d","Type":"ContainerStarted","Data":"ca180f26c507305741db09fd925edae1beca1a9a5e9a38c42a62e455d710ab0c"} Sep 10 15:57:03.251899 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:03.251868 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" event={"ID":"8475d2ca-192b-4325-97ef-36db65d43acd","Type":"ContainerStarted","Data":"4f77cec22ac8786b2010096a0ccf69de8b78c3ea1494c1ab03c007678e7fffd0"} Sep 10 15:57:03.252027 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:03.251913 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" event={"ID":"8475d2ca-192b-4325-97ef-36db65d43acd","Type":"ContainerStarted","Data":"d9ebed4d90503432135e0dd5aa1c2523b4b12362874a312563b4b4f23ab7f7ba"} Sep 10 15:57:03.252027 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:03.251974 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:03.253210 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:03.253167 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg" event={"ID":"570d3cb9-e1b6-4d31-8be9-251fa65cb228","Type":"ContainerStarted","Data":"26a1fd1c2c386ca8b2f9cf89a0b16fd2ca5cc56410c7c0af95431e514b02c2d5"} Sep 10 15:57:03.291649 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:03.291547 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" podStartSLOduration=1.2915293829999999 podStartE2EDuration="1.291529383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:57:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:57:03.290768008 +0000 UTC m=+72.844763899" watchObservedRunningTime="2026-09-10 15:57:03.291529383 +0000 UTC m=+72.845525272" Sep 10 15:57:07.270915 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:07.270879 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg" event={"ID":"570d3cb9-e1b6-4d31-8be9-251fa65cb228","Type":"ContainerStarted","Data":"70acf1bf875cb9bd97fec84c8d984e597a754adb69d11c0f202685991e90c437"} Sep 10 15:57:07.294484 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:07.294427 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5c84b96d-lxlfg" podStartSLOduration=1.9262466599999999 podStartE2EDuration="5.294406255s" totalImagesPullingTime="3.368159595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:57:07.292187225 +0000 UTC m=+76.846183117" watchObservedRunningTime="2026-09-10 15:57:07.294406255 +0000 UTC m=+76.848402148" Sep 10 15:57:12.220146 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:12.220114 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:57:13.061160 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.061038 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bff4d67d-x6nc5"] Sep 10 15:57:13.063612 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.063586 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.069290 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.069270 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 15:57:13.069421 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.069348 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 15:57:13.069515 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.069505 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 15:57:13.070670 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.070639 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 15:57:13.070778 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.070701 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 15:57:13.070778 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.070743 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jkblw\"" Sep 10 15:57:13.076310 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.076291 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 15:57:13.086644 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.086619 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bff4d67d-x6nc5"] Sep 10 15:57:13.167490 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.167454 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-service-ca\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.167670 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.167508 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-oauth-serving-cert\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.167670 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.167601 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z8pp\" (UniqueName: \"kubernetes.io/projected/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-kube-api-access-7z8pp\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.167670 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.167645 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-config\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.167815 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.167695 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-serving-cert\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.167815 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.167729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-trusted-ca-bundle\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.167815 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.167777 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-oauth-config\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.268554 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.268511 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-service-ca\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.269018 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.268569 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-oauth-serving-cert\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.269018 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.268615 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z8pp\" (UniqueName: \"kubernetes.io/projected/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-kube-api-access-7z8pp\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.269018 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.268643 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-config\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.269018 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.268678 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-serving-cert\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.269018 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.268710 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-trusted-ca-bundle\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.269018 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.268741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-oauth-config\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.269435 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.269407 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-service-ca\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.269507 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.269434 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-oauth-serving-cert\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.269507 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.269478 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-config\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.269798 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.269777 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-trusted-ca-bundle\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.271834 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.271813 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-serving-cert\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.271943 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.271839 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-oauth-config\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.281822 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.281796 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z8pp\" (UniqueName: \"kubernetes.io/projected/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-kube-api-access-7z8pp\") pod \"console-7bff4d67d-x6nc5\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:13.375913 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:13.375878 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:16.032683 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.032645 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-j855c"] Sep 10 15:57:16.035355 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.035334 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" Sep 10 15:57:16.039355 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.039182 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 15:57:16.040723 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.040526 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 15:57:16.041053 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.041034 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 10 15:57:16.041371 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.041354 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-b7m2l\"" Sep 10 15:57:16.042015 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.041995 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 10 15:57:16.042565 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.042547 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 15:57:16.049739 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.049692 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-j855c"] Sep 10 15:57:16.092477 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.092434 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7c71378-f202-454a-8a67-bb49ecf3371e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-j855c\" (UID: \"e7c71378-f202-454a-8a67-bb49ecf3371e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" Sep 10 15:57:16.092658 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.092506 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7c71378-f202-454a-8a67-bb49ecf3371e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-j855c\" (UID: \"e7c71378-f202-454a-8a67-bb49ecf3371e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" Sep 10 15:57:16.092658 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.092577 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7c71378-f202-454a-8a67-bb49ecf3371e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-j855c\" (UID: \"e7c71378-f202-454a-8a67-bb49ecf3371e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" Sep 10 15:57:16.092658 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.092600 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvjgs\" (UniqueName: \"kubernetes.io/projected/e7c71378-f202-454a-8a67-bb49ecf3371e-kube-api-access-wvjgs\") pod \"prometheus-operator-6f4946db56-j855c\" (UID: \"e7c71378-f202-454a-8a67-bb49ecf3371e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" Sep 10 15:57:16.193349 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.193309 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvjgs\" (UniqueName: \"kubernetes.io/projected/e7c71378-f202-454a-8a67-bb49ecf3371e-kube-api-access-wvjgs\") pod \"prometheus-operator-6f4946db56-j855c\" (UID: \"e7c71378-f202-454a-8a67-bb49ecf3371e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" Sep 10 15:57:16.193533 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.193401 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7c71378-f202-454a-8a67-bb49ecf3371e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-j855c\" (UID: \"e7c71378-f202-454a-8a67-bb49ecf3371e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" Sep 10 15:57:16.193533 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:57:16.193514 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 10 15:57:16.193640 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.193547 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7c71378-f202-454a-8a67-bb49ecf3371e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-j855c\" (UID: \"e7c71378-f202-454a-8a67-bb49ecf3371e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" Sep 10 15:57:16.193640 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:57:16.193578 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7c71378-f202-454a-8a67-bb49ecf3371e-prometheus-operator-tls podName:e7c71378-f202-454a-8a67-bb49ecf3371e nodeName:}" failed. No retries permitted until 2026-09-10 15:57:16.693555294 +0000 UTC m=+86.247551188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e7c71378-f202-454a-8a67-bb49ecf3371e-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-j855c" (UID: "e7c71378-f202-454a-8a67-bb49ecf3371e") : secret "prometheus-operator-tls" not found Sep 10 15:57:16.193640 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.193628 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7c71378-f202-454a-8a67-bb49ecf3371e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-j855c\" (UID: \"e7c71378-f202-454a-8a67-bb49ecf3371e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" Sep 10 15:57:16.194322 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.194300 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7c71378-f202-454a-8a67-bb49ecf3371e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-j855c\" (UID: \"e7c71378-f202-454a-8a67-bb49ecf3371e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" Sep 10 15:57:16.196311 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.196289 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7c71378-f202-454a-8a67-bb49ecf3371e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-j855c\" (UID: \"e7c71378-f202-454a-8a67-bb49ecf3371e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" Sep 10 15:57:16.204188 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.204165 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvjgs\" (UniqueName: \"kubernetes.io/projected/e7c71378-f202-454a-8a67-bb49ecf3371e-kube-api-access-wvjgs\") pod \"prometheus-operator-6f4946db56-j855c\" (UID: \"e7c71378-f202-454a-8a67-bb49ecf3371e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" Sep 10 15:57:16.698696 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.698655 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7c71378-f202-454a-8a67-bb49ecf3371e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-j855c\" (UID: \"e7c71378-f202-454a-8a67-bb49ecf3371e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" Sep 10 15:57:16.701214 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.701180 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7c71378-f202-454a-8a67-bb49ecf3371e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-j855c\" (UID: \"e7c71378-f202-454a-8a67-bb49ecf3371e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" Sep 10 15:57:16.947164 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:16.947122 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" Sep 10 15:57:19.317753 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:19.317714 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-9wcbs" event={"ID":"d6f95f07-6a03-40a9-ae59-938b52381d1d","Type":"ContainerStarted","Data":"bca348a317f090285763e72091ba416c7d857cf5d39891fe8953633bf5fbcbd5"} Sep 10 15:57:19.318159 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:19.317906 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-9wcbs" Sep 10 15:57:19.319285 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:19.319264 2574 patch_prober.go:28] interesting pod/downloads-85d98c998f-9wcbs container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.12:8080/\": dial tcp 10.133.0.12:8080: connect: connection refused" start-of-body= Sep 10 15:57:19.319340 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:19.319308 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-85d98c998f-9wcbs" podUID="d6f95f07-6a03-40a9-ae59-938b52381d1d" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.12:8080/\": dial tcp 10.133.0.12:8080: connect: connection refused" Sep 10 15:57:19.338462 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:19.338413 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-9wcbs" podStartSLOduration=0.931222703 podStartE2EDuration="17.338374633s" totalImagesPullingTime="16.40715193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:57:19.336956386 +0000 UTC m=+88.890952280" watchObservedRunningTime="2026-09-10 15:57:19.338374633 +0000 UTC m=+88.892370562" Sep 10 15:57:19.412157 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:19.412108 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-j855c"] Sep 10 15:57:19.413575 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:19.413548 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bff4d67d-x6nc5"] Sep 10 15:57:19.413799 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:57:19.413772 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode836c680_a4b9_4027_9cbc_7933b5cc3ef8.slice/crio-575c78580cdc71ec3ac1c72fed50d238afeeee12f3b9f22404e2cfdd534b8748 WatchSource:0}: Error finding container 575c78580cdc71ec3ac1c72fed50d238afeeee12f3b9f22404e2cfdd534b8748: Status 404 returned error can't find the container with id 575c78580cdc71ec3ac1c72fed50d238afeeee12f3b9f22404e2cfdd534b8748 Sep 10 15:57:19.414850 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:57:19.414724 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7c71378_f202_454a_8a67_bb49ecf3371e.slice/crio-b8cb5362c3f0e7333ec8a583afb28d8d0805d1fc1b3f00c8bf453c80c1494747 WatchSource:0}: Error finding container b8cb5362c3f0e7333ec8a583afb28d8d0805d1fc1b3f00c8bf453c80c1494747: Status 404 returned error can't find the container with id b8cb5362c3f0e7333ec8a583afb28d8d0805d1fc1b3f00c8bf453c80c1494747 Sep 10 15:57:20.327004 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:20.326912 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bff4d67d-x6nc5" event={"ID":"e836c680-a4b9-4027-9cbc-7933b5cc3ef8","Type":"ContainerStarted","Data":"575c78580cdc71ec3ac1c72fed50d238afeeee12f3b9f22404e2cfdd534b8748"} Sep 10 15:57:20.329227 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:20.329135 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" event={"ID":"e7c71378-f202-454a-8a67-bb49ecf3371e","Type":"ContainerStarted","Data":"b8cb5362c3f0e7333ec8a583afb28d8d0805d1fc1b3f00c8bf453c80c1494747"} Sep 10 15:57:20.342030 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:20.341999 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-9wcbs" Sep 10 15:57:22.343161 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:22.343121 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" event={"ID":"e7c71378-f202-454a-8a67-bb49ecf3371e","Type":"ContainerStarted","Data":"ee8d3fcc8eda401a64f344449d3074d511c74e25c0b1933e741f7c15d79031ef"} Sep 10 15:57:23.351702 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:23.351662 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" event={"ID":"e7c71378-f202-454a-8a67-bb49ecf3371e","Type":"ContainerStarted","Data":"b68db626a25a776b6add6d963839f72da7878f1211b1a743f4b207024859e92f"} Sep 10 15:57:23.375887 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:23.375496 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-j855c" podStartSLOduration=5.354318057 podStartE2EDuration="7.375473679s" totalImagesPullingTime="2.021155622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:57:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:57:23.374150437 +0000 UTC m=+92.928146341" watchObservedRunningTime="2026-09-10 15:57:23.375473679 +0000 UTC m=+92.929469571" Sep 10 15:57:24.263335 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:24.263301 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8d56ddb9b-8tk2d" Sep 10 15:57:24.359092 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:24.359032 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bff4d67d-x6nc5" event={"ID":"e836c680-a4b9-4027-9cbc-7933b5cc3ef8","Type":"ContainerStarted","Data":"f3ccfdb518450771a3768c038833c2d2d0fc377d6e6da422394e7635c2eba21b"} Sep 10 15:57:24.388802 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:24.388745 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bff4d67d-x6nc5" podStartSLOduration=7.483469788 podStartE2EDuration="11.388727454s" totalImagesPullingTime="3.905257666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:57:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:57:24.387947867 +0000 UTC m=+93.941943759" watchObservedRunningTime="2026-09-10 15:57:24.388727454 +0000 UTC m=+93.942723346" Sep 10 15:57:25.557812 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.557770 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vr76q"] Sep 10 15:57:25.599959 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.599923 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.605502 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.605307 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 15:57:25.605502 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.605377 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dd9s6\"" Sep 10 15:57:25.605925 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.605892 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 15:57:25.606393 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.606379 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 15:57:25.674937 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.674890 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e44edc3b-301e-4678-b853-3f1db51d5b4a-root\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.675130 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.675027 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-accelerators-collector-config\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.675130 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.675082 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-wtmp\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.675130 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.675110 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e44edc3b-301e-4678-b853-3f1db51d5b4a-sys\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.675336 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.675144 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-textfile\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.675336 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.675170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e44edc3b-301e-4678-b853-3f1db51d5b4a-metrics-client-ca\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.675336 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.675251 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-tls\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.675336 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.675277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.675336 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.675331 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh2bm\" (UniqueName: \"kubernetes.io/projected/e44edc3b-301e-4678-b853-3f1db51d5b4a-kube-api-access-bh2bm\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.778511 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.776697 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-tls\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.778511 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.776745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.778511 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.776783 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh2bm\" (UniqueName: \"kubernetes.io/projected/e44edc3b-301e-4678-b853-3f1db51d5b4a-kube-api-access-bh2bm\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.778511 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.776832 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e44edc3b-301e-4678-b853-3f1db51d5b4a-root\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.778511 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.776881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-accelerators-collector-config\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.778511 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.776913 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-wtmp\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.778511 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.776941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e44edc3b-301e-4678-b853-3f1db51d5b4a-sys\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.778511 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.776964 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-textfile\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.778511 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.776992 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e44edc3b-301e-4678-b853-3f1db51d5b4a-metrics-client-ca\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.778511 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.777671 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e44edc3b-301e-4678-b853-3f1db51d5b4a-metrics-client-ca\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.778511 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:57:25.777794 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 15:57:25.778511 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:57:25.777856 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-tls podName:e44edc3b-301e-4678-b853-3f1db51d5b4a nodeName:}" failed. No retries permitted until 2026-09-10 15:57:26.277836464 +0000 UTC m=+95.831832337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-tls") pod "node-exporter-vr76q" (UID: "e44edc3b-301e-4678-b853-3f1db51d5b4a") : secret "node-exporter-tls" not found Sep 10 15:57:25.779458 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.779436 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-wtmp\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.780515 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.780378 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-accelerators-collector-config\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.780515 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.780417 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e44edc3b-301e-4678-b853-3f1db51d5b4a-sys\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.780673 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.780529 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e44edc3b-301e-4678-b853-3f1db51d5b4a-root\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.780787 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.780759 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-textfile\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.781016 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.780996 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:25.791662 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:25.791639 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh2bm\" (UniqueName: \"kubernetes.io/projected/e44edc3b-301e-4678-b853-3f1db51d5b4a-kube-api-access-bh2bm\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:26.281204 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:26.281144 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-tls\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:26.283975 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:26.283938 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e44edc3b-301e-4678-b853-3f1db51d5b4a-node-exporter-tls\") pod \"node-exporter-vr76q\" (UID: \"e44edc3b-301e-4678-b853-3f1db51d5b4a\") " pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:26.514752 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:26.514712 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vr76q" Sep 10 15:57:26.559143 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:57:26.559113 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode44edc3b_301e_4678_b853_3f1db51d5b4a.slice/crio-51a6d4a3ccb02b558e17e388d37635d7e45ff4496497c2f55ad7727f3017ebdb WatchSource:0}: Error finding container 51a6d4a3ccb02b558e17e388d37635d7e45ff4496497c2f55ad7727f3017ebdb: Status 404 returned error can't find the container with id 51a6d4a3ccb02b558e17e388d37635d7e45ff4496497c2f55ad7727f3017ebdb Sep 10 15:57:27.233520 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.233283 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" podUID="53e62862-b83f-4433-b07e-161e92e937d9" containerName="registry" containerID="cri-o://ddda39cf7b7c6d36a6187f9e8c769c0c5d962cc16819f1432de32972a1a957e2" gracePeriod=30 Sep 10 15:57:27.376020 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.375936 2574 generic.go:356] "Generic (PLEG): container finished" podID="53e62862-b83f-4433-b07e-161e92e937d9" containerID="ddda39cf7b7c6d36a6187f9e8c769c0c5d962cc16819f1432de32972a1a957e2" exitCode=0 Sep 10 15:57:27.376169 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.376028 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" event={"ID":"53e62862-b83f-4433-b07e-161e92e937d9","Type":"ContainerDied","Data":"ddda39cf7b7c6d36a6187f9e8c769c0c5d962cc16819f1432de32972a1a957e2"} Sep 10 15:57:27.377798 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.377767 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vr76q" event={"ID":"e44edc3b-301e-4678-b853-3f1db51d5b4a","Type":"ContainerStarted","Data":"51a6d4a3ccb02b558e17e388d37635d7e45ff4496497c2f55ad7727f3017ebdb"} Sep 10 15:57:27.444461 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.442014 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2"] Sep 10 15:57:27.459779 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.458673 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.463833 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.463686 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2"] Sep 10 15:57:27.468711 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.464539 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 10 15:57:27.468711 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.465474 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 10 15:57:27.468711 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.465531 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fjkrl\"" Sep 10 15:57:27.468711 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.465787 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 10 15:57:27.468711 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.466008 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 10 15:57:27.468711 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.466138 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 10 15:57:27.468711 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.466331 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6rmifr1ptj856\"" Sep 10 15:57:27.528166 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.528139 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:57:27.593306 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.593251 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53e62862-b83f-4433-b07e-161e92e937d9-image-registry-private-configuration\") pod \"53e62862-b83f-4433-b07e-161e92e937d9\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " Sep 10 15:57:27.593306 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.593315 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-bound-sa-token\") pod \"53e62862-b83f-4433-b07e-161e92e937d9\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " Sep 10 15:57:27.593958 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.593352 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53e62862-b83f-4433-b07e-161e92e937d9-registry-certificates\") pod \"53e62862-b83f-4433-b07e-161e92e937d9\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " Sep 10 15:57:27.593958 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.593390 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53e62862-b83f-4433-b07e-161e92e937d9-trusted-ca\") pod \"53e62862-b83f-4433-b07e-161e92e937d9\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " Sep 10 15:57:27.593958 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.593435 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53e62862-b83f-4433-b07e-161e92e937d9-ca-trust-extracted\") pod \"53e62862-b83f-4433-b07e-161e92e937d9\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " Sep 10 15:57:27.593958 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.593473 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w97n4\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-kube-api-access-w97n4\") pod \"53e62862-b83f-4433-b07e-161e92e937d9\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " Sep 10 15:57:27.593958 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.593506 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53e62862-b83f-4433-b07e-161e92e937d9-installation-pull-secrets\") pod \"53e62862-b83f-4433-b07e-161e92e937d9\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " Sep 10 15:57:27.593958 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.593547 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls\") pod \"53e62862-b83f-4433-b07e-161e92e937d9\" (UID: \"53e62862-b83f-4433-b07e-161e92e937d9\") " Sep 10 15:57:27.593958 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.593674 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62c03299-34e0-4a90-a13c-d067cdc7c019-metrics-client-ca\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.593958 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.593741 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.593958 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.593779 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.593958 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.593804 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-grpc-tls\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.593958 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.593845 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pknhd\" (UniqueName: \"kubernetes.io/projected/62c03299-34e0-4a90-a13c-d067cdc7c019-kube-api-access-pknhd\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.593958 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.593873 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-thanos-querier-tls\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.594604 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.593968 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.594604 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.594034 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.595284 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.595255 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53e62862-b83f-4433-b07e-161e92e937d9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "53e62862-b83f-4433-b07e-161e92e937d9" (UID: "53e62862-b83f-4433-b07e-161e92e937d9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 15:57:27.595516 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.595492 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53e62862-b83f-4433-b07e-161e92e937d9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "53e62862-b83f-4433-b07e-161e92e937d9" (UID: "53e62862-b83f-4433-b07e-161e92e937d9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 15:57:27.597887 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.597593 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-kube-api-access-w97n4" (OuterVolumeSpecName: "kube-api-access-w97n4") pod "53e62862-b83f-4433-b07e-161e92e937d9" (UID: "53e62862-b83f-4433-b07e-161e92e937d9"). InnerVolumeSpecName "kube-api-access-w97n4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 15:57:27.597887 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.597753 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "53e62862-b83f-4433-b07e-161e92e937d9" (UID: "53e62862-b83f-4433-b07e-161e92e937d9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 15:57:27.598067 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.597974 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "53e62862-b83f-4433-b07e-161e92e937d9" (UID: "53e62862-b83f-4433-b07e-161e92e937d9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 15:57:27.598484 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.598426 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53e62862-b83f-4433-b07e-161e92e937d9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "53e62862-b83f-4433-b07e-161e92e937d9" (UID: "53e62862-b83f-4433-b07e-161e92e937d9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 15:57:27.607058 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.606772 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53e62862-b83f-4433-b07e-161e92e937d9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "53e62862-b83f-4433-b07e-161e92e937d9" (UID: "53e62862-b83f-4433-b07e-161e92e937d9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 15:57:27.607901 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.607867 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53e62862-b83f-4433-b07e-161e92e937d9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "53e62862-b83f-4433-b07e-161e92e937d9" (UID: "53e62862-b83f-4433-b07e-161e92e937d9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 15:57:27.695681 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.695482 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.695681 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.695535 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-grpc-tls\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.695681 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.695572 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pknhd\" (UniqueName: \"kubernetes.io/projected/62c03299-34e0-4a90-a13c-d067cdc7c019-kube-api-access-pknhd\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.695681 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.695602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-thanos-querier-tls\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.696042 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.695729 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.696042 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.695784 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.696042 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.695850 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62c03299-34e0-4a90-a13c-d067cdc7c019-metrics-client-ca\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.696042 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.695915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.696042 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.695973 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-bound-sa-token\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 15:57:27.696042 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.695990 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53e62862-b83f-4433-b07e-161e92e937d9-registry-certificates\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 15:57:27.696042 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.696005 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53e62862-b83f-4433-b07e-161e92e937d9-trusted-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 15:57:27.696042 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.696025 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53e62862-b83f-4433-b07e-161e92e937d9-ca-trust-extracted\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 15:57:27.696042 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.696037 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w97n4\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-kube-api-access-w97n4\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 15:57:27.696481 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.696049 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53e62862-b83f-4433-b07e-161e92e937d9-installation-pull-secrets\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 15:57:27.696481 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.696064 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53e62862-b83f-4433-b07e-161e92e937d9-registry-tls\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 15:57:27.696481 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.696079 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53e62862-b83f-4433-b07e-161e92e937d9-image-registry-private-configuration\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 15:57:27.697214 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.697169 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62c03299-34e0-4a90-a13c-d067cdc7c019-metrics-client-ca\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.699213 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.699142 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.699678 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.699625 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.700551 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.700506 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-grpc-tls\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.700728 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.700700 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.700811 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.700789 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.701549 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.701505 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/62c03299-34e0-4a90-a13c-d067cdc7c019-secret-thanos-querier-tls\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.705145 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.705122 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pknhd\" (UniqueName: \"kubernetes.io/projected/62c03299-34e0-4a90-a13c-d067cdc7c019-kube-api-access-pknhd\") pod \"thanos-querier-67bfd8b8d7-46lr2\" (UID: \"62c03299-34e0-4a90-a13c-d067cdc7c019\") " pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:27.775264 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:27.775173 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:28.145375 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:28.145347 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2"] Sep 10 15:57:28.237797 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:57:28.237763 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62c03299_34e0_4a90_a13c_d067cdc7c019.slice/crio-31a35a615c4c541a40b51f6d4df90e47f79c27459213bf829f14f6fa41a3a412 WatchSource:0}: Error finding container 31a35a615c4c541a40b51f6d4df90e47f79c27459213bf829f14f6fa41a3a412: Status 404 returned error can't find the container with id 31a35a615c4c541a40b51f6d4df90e47f79c27459213bf829f14f6fa41a3a412 Sep 10 15:57:28.383255 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:28.383216 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" event={"ID":"62c03299-34e0-4a90-a13c-d067cdc7c019","Type":"ContainerStarted","Data":"31a35a615c4c541a40b51f6d4df90e47f79c27459213bf829f14f6fa41a3a412"} Sep 10 15:57:28.384806 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:28.384778 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" event={"ID":"53e62862-b83f-4433-b07e-161e92e937d9","Type":"ContainerDied","Data":"e7da60b5e8845eac497b40520edd65e0493925891a1765d1f5cef7dde0d658cb"} Sep 10 15:57:28.384806 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:28.384797 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f66fdc88f-rgsts" Sep 10 15:57:28.384996 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:28.384835 2574 scope.go:117] "RemoveContainer" containerID="ddda39cf7b7c6d36a6187f9e8c769c0c5d962cc16819f1432de32972a1a957e2" Sep 10 15:57:28.414946 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:28.414919 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f66fdc88f-rgsts"] Sep 10 15:57:28.421216 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:28.420457 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5f66fdc88f-rgsts"] Sep 10 15:57:28.956688 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:28.956648 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53e62862-b83f-4433-b07e-161e92e937d9" path="/var/lib/kubelet/pods/53e62862-b83f-4433-b07e-161e92e937d9/volumes" Sep 10 15:57:29.392012 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:29.391979 2574 generic.go:356] "Generic (PLEG): container finished" podID="e44edc3b-301e-4678-b853-3f1db51d5b4a" containerID="abb7d9f5d0ef7091524908699ea5244c70e323db26a7402f3a717c1c33c6b460" exitCode=0 Sep 10 15:57:29.392225 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:29.392070 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vr76q" event={"ID":"e44edc3b-301e-4678-b853-3f1db51d5b4a","Type":"ContainerDied","Data":"abb7d9f5d0ef7091524908699ea5244c70e323db26a7402f3a717c1c33c6b460"} Sep 10 15:57:30.053983 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.053901 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-56dbc7db6-ntz5s"] Sep 10 15:57:30.054386 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.054252 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53e62862-b83f-4433-b07e-161e92e937d9" containerName="registry" Sep 10 15:57:30.054386 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.054267 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="53e62862-b83f-4433-b07e-161e92e937d9" containerName="registry" Sep 10 15:57:30.054386 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.054314 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="53e62862-b83f-4433-b07e-161e92e937d9" containerName="registry" Sep 10 15:57:30.081807 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.081766 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.082821 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.082576 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56dbc7db6-ntz5s"] Sep 10 15:57:30.085128 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.085102 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 10 15:57:30.085626 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.085605 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 10 15:57:30.085728 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.085605 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-w5h5l\"" Sep 10 15:57:30.086605 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.086537 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 10 15:57:30.086726 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.086704 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 15:57:30.086805 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.086746 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c3nb9p2n4qouu\"" Sep 10 15:57:30.220595 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.220558 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d381e46-01fb-4af8-9823-1277f1b8b4f2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.220768 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.220600 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4d381e46-01fb-4af8-9823-1277f1b8b4f2-secret-metrics-server-tls\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.220768 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.220622 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4d381e46-01fb-4af8-9823-1277f1b8b4f2-audit-log\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.220768 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.220715 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4d381e46-01fb-4af8-9823-1277f1b8b4f2-secret-metrics-server-client-certs\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.220927 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.220790 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4dx5\" (UniqueName: \"kubernetes.io/projected/4d381e46-01fb-4af8-9823-1277f1b8b4f2-kube-api-access-r4dx5\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.220927 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.220823 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4d381e46-01fb-4af8-9823-1277f1b8b4f2-metrics-server-audit-profiles\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.220927 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.220850 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d381e46-01fb-4af8-9823-1277f1b8b4f2-client-ca-bundle\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.308641 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.308568 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-lj555"] Sep 10 15:57:30.321501 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.321473 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4d381e46-01fb-4af8-9823-1277f1b8b4f2-secret-metrics-server-client-certs\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.321647 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.321521 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4dx5\" (UniqueName: \"kubernetes.io/projected/4d381e46-01fb-4af8-9823-1277f1b8b4f2-kube-api-access-r4dx5\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.321647 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.321570 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4d381e46-01fb-4af8-9823-1277f1b8b4f2-metrics-server-audit-profiles\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.321647 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.321604 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d381e46-01fb-4af8-9823-1277f1b8b4f2-client-ca-bundle\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.321647 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.321645 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d381e46-01fb-4af8-9823-1277f1b8b4f2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.321856 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.321686 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4d381e46-01fb-4af8-9823-1277f1b8b4f2-secret-metrics-server-tls\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.321856 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.321709 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4d381e46-01fb-4af8-9823-1277f1b8b4f2-audit-log\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.322241 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.322115 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lj555" Sep 10 15:57:30.322355 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.322268 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4d381e46-01fb-4af8-9823-1277f1b8b4f2-audit-log\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.322620 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.322505 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d381e46-01fb-4af8-9823-1277f1b8b4f2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.323512 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.323463 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4d381e46-01fb-4af8-9823-1277f1b8b4f2-metrics-server-audit-profiles\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.324681 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.324645 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4d381e46-01fb-4af8-9823-1277f1b8b4f2-secret-metrics-server-client-certs\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.325038 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.325013 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d381e46-01fb-4af8-9823-1277f1b8b4f2-client-ca-bundle\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.325137 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.325114 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4d381e46-01fb-4af8-9823-1277f1b8b4f2-secret-metrics-server-tls\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.325655 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.325637 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 10 15:57:30.325883 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.325866 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-86bnj\"" Sep 10 15:57:30.326167 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.326152 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-lj555"] Sep 10 15:57:30.332552 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.332528 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bff4d67d-x6nc5"] Sep 10 15:57:30.338378 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.338356 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4dx5\" (UniqueName: \"kubernetes.io/projected/4d381e46-01fb-4af8-9823-1277f1b8b4f2-kube-api-access-r4dx5\") pod \"metrics-server-56dbc7db6-ntz5s\" (UID: \"4d381e46-01fb-4af8-9823-1277f1b8b4f2\") " pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.394919 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.394891 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:30.397978 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.397950 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vr76q" event={"ID":"e44edc3b-301e-4678-b853-3f1db51d5b4a","Type":"ContainerStarted","Data":"be56bc19ad750366414fd9a6019a0e7fd56c3d24a00314d218f17ac415b26da2"} Sep 10 15:57:30.398096 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.398003 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vr76q" event={"ID":"e44edc3b-301e-4678-b853-3f1db51d5b4a","Type":"ContainerStarted","Data":"36c14aedac618486dc054a55d203245807c7e1c724e3dcbb81f396e61fb41b5f"} Sep 10 15:57:30.422261 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.422236 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7ww6\" (UniqueName: \"kubernetes.io/projected/89e54772-0be1-41b4-9e8b-de76ed6f3d15-kube-api-access-m7ww6\") pod \"monitoring-plugin-85bbbbbf4-lj555\" (UID: \"89e54772-0be1-41b4-9e8b-de76ed6f3d15\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lj555" Sep 10 15:57:30.422383 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.422310 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/89e54772-0be1-41b4-9e8b-de76ed6f3d15-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-lj555\" (UID: \"89e54772-0be1-41b4-9e8b-de76ed6f3d15\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lj555" Sep 10 15:57:30.436438 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.436388 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vr76q" podStartSLOduration=3.64888767 podStartE2EDuration="5.436371003s" totalImagesPullingTime="1.709713558s" totalInitContainerRuntime="77.769775ms" isStatefulPod=true podCreationTimestamp="2026-09-10 15:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:57:30.436155653 +0000 UTC m=+99.990151544" watchObservedRunningTime="2026-09-10 15:57:30.436371003 +0000 UTC m=+99.990366893" Sep 10 15:57:30.522930 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.522886 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/89e54772-0be1-41b4-9e8b-de76ed6f3d15-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-lj555\" (UID: \"89e54772-0be1-41b4-9e8b-de76ed6f3d15\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lj555" Sep 10 15:57:30.523115 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:57:30.523003 2574 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 10 15:57:30.523115 ip-10-0-131-28 kubenswrapper[2574]: E0910 15:57:30.523071 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89e54772-0be1-41b4-9e8b-de76ed6f3d15-monitoring-plugin-cert podName:89e54772-0be1-41b4-9e8b-de76ed6f3d15 nodeName:}" failed. No retries permitted until 2026-09-10 15:57:31.023048778 +0000 UTC m=+100.577044650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/89e54772-0be1-41b4-9e8b-de76ed6f3d15-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-lj555" (UID: "89e54772-0be1-41b4-9e8b-de76ed6f3d15") : secret "monitoring-plugin-cert" not found Sep 10 15:57:30.523290 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.523141 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7ww6\" (UniqueName: \"kubernetes.io/projected/89e54772-0be1-41b4-9e8b-de76ed6f3d15-kube-api-access-m7ww6\") pod \"monitoring-plugin-85bbbbbf4-lj555\" (UID: \"89e54772-0be1-41b4-9e8b-de76ed6f3d15\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lj555" Sep 10 15:57:30.537538 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.537515 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7ww6\" (UniqueName: \"kubernetes.io/projected/89e54772-0be1-41b4-9e8b-de76ed6f3d15-kube-api-access-m7ww6\") pod \"monitoring-plugin-85bbbbbf4-lj555\" (UID: \"89e54772-0be1-41b4-9e8b-de76ed6f3d15\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lj555" Sep 10 15:57:30.711138 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.711105 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-744cf969cd-q46zs"] Sep 10 15:57:30.728701 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.728672 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.732277 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.732250 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 10 15:57:30.732404 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.732250 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 10 15:57:30.732404 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.732250 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 10 15:57:30.732640 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.732446 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 10 15:57:30.732640 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.732514 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 10 15:57:30.732640 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.732565 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-v5xds\"" Sep 10 15:57:30.744555 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.744530 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-744cf969cd-q46zs"] Sep 10 15:57:30.744902 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.744878 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 10 15:57:30.826539 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.826506 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-serving-certs-ca-bundle\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.826663 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.826587 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-federate-client-tls\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.826663 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.826611 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.826663 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.826630 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-telemeter-client-tls\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.826663 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.826659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.826845 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.826686 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-secret-telemeter-client\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.826845 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.826715 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-metrics-client-ca\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.826845 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.826790 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nwvp\" (UniqueName: \"kubernetes.io/projected/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-kube-api-access-7nwvp\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.857913 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:57:30.857883 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d381e46_01fb_4af8_9823_1277f1b8b4f2.slice/crio-4b3582dc7588ce4c4a7c60891fa418cb7dcb40b762dbaa3136dcdd65143804a5 WatchSource:0}: Error finding container 4b3582dc7588ce4c4a7c60891fa418cb7dcb40b762dbaa3136dcdd65143804a5: Status 404 returned error can't find the container with id 4b3582dc7588ce4c4a7c60891fa418cb7dcb40b762dbaa3136dcdd65143804a5 Sep 10 15:57:30.858808 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.858783 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56dbc7db6-ntz5s"] Sep 10 15:57:30.927509 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.927478 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-secret-telemeter-client\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.927630 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.927519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-metrics-client-ca\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.927630 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.927557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nwvp\" (UniqueName: \"kubernetes.io/projected/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-kube-api-access-7nwvp\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.927630 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.927584 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-serving-certs-ca-bundle\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.927810 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.927784 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-federate-client-tls\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.927866 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.927834 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.927919 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.927870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-telemeter-client-tls\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.927970 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.927919 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.928373 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.928304 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-metrics-client-ca\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.928493 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.928464 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-serving-certs-ca-bundle\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.928837 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.928816 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.930027 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.930008 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-secret-telemeter-client\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.930234 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.930215 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.930513 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.930484 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-federate-client-tls\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.930577 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.930557 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-telemeter-client-tls\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:30.943550 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:30.943530 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nwvp\" (UniqueName: \"kubernetes.io/projected/0ccabcf2-cbb9-4112-9ded-b8f18f507a6c-kube-api-access-7nwvp\") pod \"telemeter-client-744cf969cd-q46zs\" (UID: \"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c\") " pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:31.028566 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:31.028524 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/89e54772-0be1-41b4-9e8b-de76ed6f3d15-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-lj555\" (UID: \"89e54772-0be1-41b4-9e8b-de76ed6f3d15\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lj555" Sep 10 15:57:31.030939 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:31.030917 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/89e54772-0be1-41b4-9e8b-de76ed6f3d15-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-lj555\" (UID: \"89e54772-0be1-41b4-9e8b-de76ed6f3d15\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lj555" Sep 10 15:57:31.044249 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:31.044228 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" Sep 10 15:57:31.247860 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:31.247826 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lj555" Sep 10 15:57:31.337241 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:31.337114 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-744cf969cd-q46zs"] Sep 10 15:57:31.341807 ip-10-0-131-28 kubenswrapper[2574]: W0910 15:57:31.341779 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ccabcf2_cbb9_4112_9ded_b8f18f507a6c.slice/crio-83f3c6474565addeb4211934a521362525a379a1534c56f8395e0dc66e81da1d WatchSource:0}: Error finding container 83f3c6474565addeb4211934a521362525a379a1534c56f8395e0dc66e81da1d: Status 404 returned error can't find the container with id 83f3c6474565addeb4211934a521362525a379a1534c56f8395e0dc66e81da1d Sep 10 15:57:31.403424 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:31.403340 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" event={"ID":"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c","Type":"ContainerStarted","Data":"83f3c6474565addeb4211934a521362525a379a1534c56f8395e0dc66e81da1d"} Sep 10 15:57:31.405555 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:31.405529 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" event={"ID":"62c03299-34e0-4a90-a13c-d067cdc7c019","Type":"ContainerStarted","Data":"dafcc9d4265810121d0fb3be61a332863d94845f56da31816c8290f867f84255"} Sep 10 15:57:31.405669 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:31.405585 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" event={"ID":"62c03299-34e0-4a90-a13c-d067cdc7c019","Type":"ContainerStarted","Data":"fe810157d23bd7d38775beedc6368fb7dc0c26c4a33ce20d1c829c3612c84f2a"} Sep 10 15:57:31.405669 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:31.405617 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" event={"ID":"62c03299-34e0-4a90-a13c-d067cdc7c019","Type":"ContainerStarted","Data":"d7f4a55538227119df2b6f955d611c1dd65b99115e1aa4dcf545ca15e1dd8971"} Sep 10 15:57:31.406671 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:31.406645 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" event={"ID":"4d381e46-01fb-4af8-9823-1277f1b8b4f2","Type":"ContainerStarted","Data":"4b3582dc7588ce4c4a7c60891fa418cb7dcb40b762dbaa3136dcdd65143804a5"} Sep 10 15:57:31.547086 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:31.547053 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-lj555"] Sep 10 15:57:32.418317 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:32.418100 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lj555" event={"ID":"89e54772-0be1-41b4-9e8b-de76ed6f3d15","Type":"ContainerStarted","Data":"e8cceb0ef9810e6c04fd3c83d7e58920ec15f8c149bb37161f69bdfd6b64331a"} Sep 10 15:57:33.256397 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:33.256314 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rlx6p" Sep 10 15:57:33.376053 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:33.376018 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:35.430937 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:35.430892 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" event={"ID":"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c","Type":"ContainerStarted","Data":"b8fd2de6440a0ff761db4f08a2c6e4f4e72d2f88e9a95f989ce157f4048a12cb"} Sep 10 15:57:35.432987 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:35.432644 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lj555" event={"ID":"89e54772-0be1-41b4-9e8b-de76ed6f3d15","Type":"ContainerStarted","Data":"246d9584e2686f8bb4b25b43232bd233eb96e189f02a7550f1eac5bf4800e1f8"} Sep 10 15:57:35.432987 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:35.432846 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lj555" Sep 10 15:57:35.436273 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:35.436246 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" event={"ID":"62c03299-34e0-4a90-a13c-d067cdc7c019","Type":"ContainerStarted","Data":"9b2431aa06987bad00aacde0ee4792b53c07c2a586c7cd2062e61653414eca12"} Sep 10 15:57:35.436489 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:35.436313 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" event={"ID":"62c03299-34e0-4a90-a13c-d067cdc7c019","Type":"ContainerStarted","Data":"2ac3f89fd90b103386c51d6c979a2764ec8b59981cc108dc5f456dcf26a3c17d"} Sep 10 15:57:35.436489 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:35.436353 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" event={"ID":"62c03299-34e0-4a90-a13c-d067cdc7c019","Type":"ContainerStarted","Data":"8b7898e8ca0a2558836bcaf7c9111e15991b3877fb0794c186f26da9ba777604"} Sep 10 15:57:35.436489 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:35.436401 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:35.438343 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:35.438312 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" event={"ID":"4d381e46-01fb-4af8-9823-1277f1b8b4f2","Type":"ContainerStarted","Data":"28ad2a5c80bac1f3746b9b2afe98248f887d92692245150fd2f5eb826db685b1"} Sep 10 15:57:35.438884 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:35.438863 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lj555" Sep 10 15:57:35.442413 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:35.442395 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" Sep 10 15:57:35.452890 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:35.452849 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-lj555" podStartSLOduration=2.60378481 podStartE2EDuration="5.452835745s" totalImagesPullingTime="2.849050935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:57:35.451296576 +0000 UTC m=+105.005292483" watchObservedRunningTime="2026-09-10 15:57:35.452835745 +0000 UTC m=+105.006831637" Sep 10 15:57:35.502179 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:35.502128 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-67bfd8b8d7-46lr2" podStartSLOduration=2.758867876 podStartE2EDuration="8.502117109s" totalImagesPullingTime="5.743249233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:57:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:57:35.501594682 +0000 UTC m=+105.055590608" watchObservedRunningTime="2026-09-10 15:57:35.502117109 +0000 UTC m=+105.056113000" Sep 10 15:57:35.525472 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:35.525415 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" podStartSLOduration=1.979627389 podStartE2EDuration="5.525395528s" totalImagesPullingTime="3.545768139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:57:35.522882776 +0000 UTC m=+105.076878668" watchObservedRunningTime="2026-09-10 15:57:35.525395528 +0000 UTC m=+105.079391420" Sep 10 15:57:36.445500 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:36.445462 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" event={"ID":"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c","Type":"ContainerStarted","Data":"70e34ab9d50dea06bdd47f2935860fab24e3ab8c499083d870ef050304ab78fe"} Sep 10 15:57:36.445936 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:36.445523 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" event={"ID":"0ccabcf2-cbb9-4112-9ded-b8f18f507a6c","Type":"ContainerStarted","Data":"95e7d0b9c57e44dcb7b1a5eb562b734dded7dbc3a22d08d0fbcbbd88f149866c"} Sep 10 15:57:36.480176 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:36.480117 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-744cf969cd-q46zs" podStartSLOduration=2.11760146 podStartE2EDuration="6.480100175s" totalImagesPullingTime="4.362498715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:57:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:57:36.479872588 +0000 UTC m=+106.033868480" watchObservedRunningTime="2026-09-10 15:57:36.480100175 +0000 UTC m=+106.034096065" Sep 10 15:57:50.395503 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:50.395467 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:50.395963 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:50.395553 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:57:55.353658 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.353588 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bff4d67d-x6nc5" podUID="e836c680-a4b9-4027-9cbc-7933b5cc3ef8" containerName="console" containerID="cri-o://f3ccfdb518450771a3768c038833c2d2d0fc377d6e6da422394e7635c2eba21b" gracePeriod=15 Sep 10 15:57:55.521852 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.521822 2574 generic.go:356] "Generic (PLEG): container finished" podID="e836c680-a4b9-4027-9cbc-7933b5cc3ef8" containerID="f3ccfdb518450771a3768c038833c2d2d0fc377d6e6da422394e7635c2eba21b" exitCode=0 Sep 10 15:57:55.522000 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.521893 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bff4d67d-x6nc5" event={"ID":"e836c680-a4b9-4027-9cbc-7933b5cc3ef8","Type":"ContainerDied","Data":"f3ccfdb518450771a3768c038833c2d2d0fc377d6e6da422394e7635c2eba21b"} Sep 10 15:57:55.619221 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.619154 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:55.738896 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.738855 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-oauth-config\") pod \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " Sep 10 15:57:55.738896 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.738897 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-config\") pod \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " Sep 10 15:57:55.739120 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.738921 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-serving-cert\") pod \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " Sep 10 15:57:55.739120 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.738955 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-service-ca\") pod \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " Sep 10 15:57:55.739120 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.738981 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7z8pp\" (UniqueName: \"kubernetes.io/projected/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-kube-api-access-7z8pp\") pod \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " Sep 10 15:57:55.739120 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.739009 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-oauth-serving-cert\") pod \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " Sep 10 15:57:55.739120 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.739089 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-trusted-ca-bundle\") pod \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\" (UID: \"e836c680-a4b9-4027-9cbc-7933b5cc3ef8\") " Sep 10 15:57:55.739528 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.739483 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-service-ca" (OuterVolumeSpecName: "service-ca") pod "e836c680-a4b9-4027-9cbc-7933b5cc3ef8" (UID: "e836c680-a4b9-4027-9cbc-7933b5cc3ef8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 15:57:55.739638 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.739540 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e836c680-a4b9-4027-9cbc-7933b5cc3ef8" (UID: "e836c680-a4b9-4027-9cbc-7933b5cc3ef8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 15:57:55.739638 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.739552 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-config" (OuterVolumeSpecName: "console-config") pod "e836c680-a4b9-4027-9cbc-7933b5cc3ef8" (UID: "e836c680-a4b9-4027-9cbc-7933b5cc3ef8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 15:57:55.739638 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.739604 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e836c680-a4b9-4027-9cbc-7933b5cc3ef8" (UID: "e836c680-a4b9-4027-9cbc-7933b5cc3ef8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 15:57:55.741308 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.741280 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-kube-api-access-7z8pp" (OuterVolumeSpecName: "kube-api-access-7z8pp") pod "e836c680-a4b9-4027-9cbc-7933b5cc3ef8" (UID: "e836c680-a4b9-4027-9cbc-7933b5cc3ef8"). InnerVolumeSpecName "kube-api-access-7z8pp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 15:57:55.741541 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.741512 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e836c680-a4b9-4027-9cbc-7933b5cc3ef8" (UID: "e836c680-a4b9-4027-9cbc-7933b5cc3ef8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 15:57:55.741613 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.741523 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e836c680-a4b9-4027-9cbc-7933b5cc3ef8" (UID: "e836c680-a4b9-4027-9cbc-7933b5cc3ef8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 15:57:55.840466 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.840429 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-trusted-ca-bundle\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 15:57:55.840466 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.840458 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-oauth-config\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 15:57:55.840466 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.840468 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-config\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 15:57:55.840466 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.840476 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-console-serving-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 15:57:55.840717 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.840486 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 15:57:55.840717 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.840494 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7z8pp\" (UniqueName: \"kubernetes.io/projected/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-kube-api-access-7z8pp\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 15:57:55.840717 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:55.840503 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e836c680-a4b9-4027-9cbc-7933b5cc3ef8-oauth-serving-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 15:57:56.527389 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:56.527359 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bff4d67d-x6nc5" Sep 10 15:57:56.527968 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:56.527359 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bff4d67d-x6nc5" event={"ID":"e836c680-a4b9-4027-9cbc-7933b5cc3ef8","Type":"ContainerDied","Data":"575c78580cdc71ec3ac1c72fed50d238afeeee12f3b9f22404e2cfdd534b8748"} Sep 10 15:57:56.527968 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:56.527485 2574 scope.go:117] "RemoveContainer" containerID="f3ccfdb518450771a3768c038833c2d2d0fc377d6e6da422394e7635c2eba21b" Sep 10 15:57:56.548213 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:56.548166 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bff4d67d-x6nc5"] Sep 10 15:57:56.550231 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:56.550189 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bff4d67d-x6nc5"] Sep 10 15:57:56.955719 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:57:56.955685 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e836c680-a4b9-4027-9cbc-7933b5cc3ef8" path="/var/lib/kubelet/pods/e836c680-a4b9-4027-9cbc-7933b5cc3ef8/volumes" Sep 10 15:58:10.400900 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:10.400868 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:58:10.404605 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:10.404577 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-56dbc7db6-ntz5s" Sep 10 15:58:44.565790 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.565709 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-674d448c7b-2j4xs"] Sep 10 15:58:44.566216 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.566027 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e836c680-a4b9-4027-9cbc-7933b5cc3ef8" containerName="console" Sep 10 15:58:44.566216 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.566040 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e836c680-a4b9-4027-9cbc-7933b5cc3ef8" containerName="console" Sep 10 15:58:44.566216 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.566110 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e836c680-a4b9-4027-9cbc-7933b5cc3ef8" containerName="console" Sep 10 15:58:44.568181 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.568165 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.573460 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.573414 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 15:58:44.573614 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.573585 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 15:58:44.573614 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.573601 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 15:58:44.573726 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.573585 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 15:58:44.573885 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.573867 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jkblw\"" Sep 10 15:58:44.573953 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.573920 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 15:58:44.581061 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.581041 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 15:58:44.581735 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.581717 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-674d448c7b-2j4xs"] Sep 10 15:58:44.641705 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.641670 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-oauth-serving-cert\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.641705 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.641705 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-service-ca\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.641900 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.641725 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-serving-cert\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.641900 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.641740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-config\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.641900 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.641792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-oauth-config\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.641900 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.641813 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4tbk\" (UniqueName: \"kubernetes.io/projected/74d80ffa-b52a-4bc3-8302-198bfeb9975e-kube-api-access-s4tbk\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.641900 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.641845 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-trusted-ca-bundle\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.742689 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.742648 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4tbk\" (UniqueName: \"kubernetes.io/projected/74d80ffa-b52a-4bc3-8302-198bfeb9975e-kube-api-access-s4tbk\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.742689 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.742691 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-trusted-ca-bundle\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.742925 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.742740 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-oauth-serving-cert\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.742925 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.742756 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-service-ca\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.742925 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.742776 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-serving-cert\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.742925 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.742870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-config\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.742925 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.742922 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-oauth-config\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.743602 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.743578 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-service-ca\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.743700 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.743647 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-oauth-serving-cert\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.743760 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.743738 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-config\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.743985 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.743968 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-trusted-ca-bundle\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.745275 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.745254 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-serving-cert\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.745390 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.745281 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-oauth-config\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.750949 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.750928 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4tbk\" (UniqueName: \"kubernetes.io/projected/74d80ffa-b52a-4bc3-8302-198bfeb9975e-kube-api-access-s4tbk\") pod \"console-674d448c7b-2j4xs\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:44.877578 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:44.877547 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:45.150654 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:45.150630 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-674d448c7b-2j4xs"] Sep 10 15:58:45.714534 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:45.714492 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674d448c7b-2j4xs" event={"ID":"74d80ffa-b52a-4bc3-8302-198bfeb9975e","Type":"ContainerStarted","Data":"88663b052631264203f472daf6e7c4414d1e82cc690210fbf327a8d963b874ec"} Sep 10 15:58:45.714918 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:45.714597 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674d448c7b-2j4xs" event={"ID":"74d80ffa-b52a-4bc3-8302-198bfeb9975e","Type":"ContainerStarted","Data":"95c176e669ed99ce14e414ec1a91fed76919f78501c9b439a81b8abeb64dec78"} Sep 10 15:58:45.734334 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:45.734284 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-674d448c7b-2j4xs" podStartSLOduration=1.734269577 podStartE2EDuration="1.734269577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 15:58:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 15:58:45.732769681 +0000 UTC m=+175.286765572" watchObservedRunningTime="2026-09-10 15:58:45.734269577 +0000 UTC m=+175.288265468" Sep 10 15:58:54.877937 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:54.877896 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:54.878440 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:54.877962 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:54.882902 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:54.882879 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 15:58:55.755401 ip-10-0-131-28 kubenswrapper[2574]: I0910 15:58:55.755373 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 16:00:08.892393 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:08.892353 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-7h2v6"] Sep 10 16:00:08.895079 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:08.895061 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7h2v6" Sep 10 16:00:08.897734 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:08.897711 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 16:00:08.898826 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:08.898808 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 16:00:08.898826 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:08.898817 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-m5vxp\"" Sep 10 16:00:08.904718 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:08.904698 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-7h2v6"] Sep 10 16:00:09.031703 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:09.031670 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v47v7\" (UniqueName: \"kubernetes.io/projected/bdd9281d-fa0f-4f8b-95c5-9f4fd96163a9-kube-api-access-v47v7\") pod \"cert-manager-cainjector-559cdd8c87-7h2v6\" (UID: \"bdd9281d-fa0f-4f8b-95c5-9f4fd96163a9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7h2v6" Sep 10 16:00:09.031882 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:09.031710 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdd9281d-fa0f-4f8b-95c5-9f4fd96163a9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-7h2v6\" (UID: \"bdd9281d-fa0f-4f8b-95c5-9f4fd96163a9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7h2v6" Sep 10 16:00:09.132375 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:09.132341 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v47v7\" (UniqueName: \"kubernetes.io/projected/bdd9281d-fa0f-4f8b-95c5-9f4fd96163a9-kube-api-access-v47v7\") pod \"cert-manager-cainjector-559cdd8c87-7h2v6\" (UID: \"bdd9281d-fa0f-4f8b-95c5-9f4fd96163a9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7h2v6" Sep 10 16:00:09.132552 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:09.132388 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdd9281d-fa0f-4f8b-95c5-9f4fd96163a9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-7h2v6\" (UID: \"bdd9281d-fa0f-4f8b-95c5-9f4fd96163a9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7h2v6" Sep 10 16:00:09.144802 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:09.144736 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v47v7\" (UniqueName: \"kubernetes.io/projected/bdd9281d-fa0f-4f8b-95c5-9f4fd96163a9-kube-api-access-v47v7\") pod \"cert-manager-cainjector-559cdd8c87-7h2v6\" (UID: \"bdd9281d-fa0f-4f8b-95c5-9f4fd96163a9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7h2v6" Sep 10 16:00:09.144802 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:09.144767 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdd9281d-fa0f-4f8b-95c5-9f4fd96163a9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-7h2v6\" (UID: \"bdd9281d-fa0f-4f8b-95c5-9f4fd96163a9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7h2v6" Sep 10 16:00:09.204110 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:09.204060 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7h2v6" Sep 10 16:00:09.469952 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:09.469883 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-7h2v6"] Sep 10 16:00:09.472133 ip-10-0-131-28 kubenswrapper[2574]: W0910 16:00:09.472104 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdd9281d_fa0f_4f8b_95c5_9f4fd96163a9.slice/crio-bb136dbbeee3b1954738673d5dd89f7637704ed53fb962562d9a0cd6682b1e58 WatchSource:0}: Error finding container bb136dbbeee3b1954738673d5dd89f7637704ed53fb962562d9a0cd6682b1e58: Status 404 returned error can't find the container with id bb136dbbeee3b1954738673d5dd89f7637704ed53fb962562d9a0cd6682b1e58 Sep 10 16:00:10.024040 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:10.024007 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7h2v6" event={"ID":"bdd9281d-fa0f-4f8b-95c5-9f4fd96163a9","Type":"ContainerStarted","Data":"bb136dbbeee3b1954738673d5dd89f7637704ed53fb962562d9a0cd6682b1e58"} Sep 10 16:00:13.761551 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:13.761458 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jmbbv"] Sep 10 16:00:13.764246 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:13.764219 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jmbbv" Sep 10 16:00:13.766831 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:13.766806 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rhj2f\"" Sep 10 16:00:13.778319 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:13.778294 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jmbbv"] Sep 10 16:00:13.874721 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:13.874685 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb9ml\" (UniqueName: \"kubernetes.io/projected/5ad935aa-ba81-4892-9e51-076abb0a1b42-kube-api-access-jb9ml\") pod \"cert-manager-55b4d954d5-jmbbv\" (UID: \"5ad935aa-ba81-4892-9e51-076abb0a1b42\") " pod="cert-manager/cert-manager-55b4d954d5-jmbbv" Sep 10 16:00:13.874905 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:13.874792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ad935aa-ba81-4892-9e51-076abb0a1b42-bound-sa-token\") pod \"cert-manager-55b4d954d5-jmbbv\" (UID: \"5ad935aa-ba81-4892-9e51-076abb0a1b42\") " pod="cert-manager/cert-manager-55b4d954d5-jmbbv" Sep 10 16:00:13.975404 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:13.975371 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb9ml\" (UniqueName: \"kubernetes.io/projected/5ad935aa-ba81-4892-9e51-076abb0a1b42-kube-api-access-jb9ml\") pod \"cert-manager-55b4d954d5-jmbbv\" (UID: \"5ad935aa-ba81-4892-9e51-076abb0a1b42\") " pod="cert-manager/cert-manager-55b4d954d5-jmbbv" Sep 10 16:00:13.975573 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:13.975425 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ad935aa-ba81-4892-9e51-076abb0a1b42-bound-sa-token\") pod \"cert-manager-55b4d954d5-jmbbv\" (UID: \"5ad935aa-ba81-4892-9e51-076abb0a1b42\") " pod="cert-manager/cert-manager-55b4d954d5-jmbbv" Sep 10 16:00:13.984412 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:13.984379 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ad935aa-ba81-4892-9e51-076abb0a1b42-bound-sa-token\") pod \"cert-manager-55b4d954d5-jmbbv\" (UID: \"5ad935aa-ba81-4892-9e51-076abb0a1b42\") " pod="cert-manager/cert-manager-55b4d954d5-jmbbv" Sep 10 16:00:13.984562 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:13.984504 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb9ml\" (UniqueName: \"kubernetes.io/projected/5ad935aa-ba81-4892-9e51-076abb0a1b42-kube-api-access-jb9ml\") pod \"cert-manager-55b4d954d5-jmbbv\" (UID: \"5ad935aa-ba81-4892-9e51-076abb0a1b42\") " pod="cert-manager/cert-manager-55b4d954d5-jmbbv" Sep 10 16:00:14.074657 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:14.074576 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jmbbv" Sep 10 16:00:14.359552 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:14.359520 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jmbbv"] Sep 10 16:00:14.363148 ip-10-0-131-28 kubenswrapper[2574]: W0910 16:00:14.363106 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ad935aa_ba81_4892_9e51_076abb0a1b42.slice/crio-324db05b17d753382a6f94a7961fcb68f30da8279b3637cc72dbdd25bf103991 WatchSource:0}: Error finding container 324db05b17d753382a6f94a7961fcb68f30da8279b3637cc72dbdd25bf103991: Status 404 returned error can't find the container with id 324db05b17d753382a6f94a7961fcb68f30da8279b3637cc72dbdd25bf103991 Sep 10 16:00:15.046192 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:15.046149 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jmbbv" event={"ID":"5ad935aa-ba81-4892-9e51-076abb0a1b42","Type":"ContainerStarted","Data":"78329e77f560f1199f9c8531797e2fa3d41f8c93c2e4daf982a1a42a37d6ccd5"} Sep 10 16:00:15.046192 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:15.046213 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jmbbv" event={"ID":"5ad935aa-ba81-4892-9e51-076abb0a1b42","Type":"ContainerStarted","Data":"324db05b17d753382a6f94a7961fcb68f30da8279b3637cc72dbdd25bf103991"} Sep 10 16:00:15.047689 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:15.047664 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7h2v6" event={"ID":"bdd9281d-fa0f-4f8b-95c5-9f4fd96163a9","Type":"ContainerStarted","Data":"053c23785cb1dc1f86e9a860084b416d31831dadd8444893c9cba019c8352483"} Sep 10 16:00:15.063793 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:15.063747 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-jmbbv" podStartSLOduration=2.063729408 podStartE2EDuration="2.063729408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:00:15.062282844 +0000 UTC m=+264.616278737" watchObservedRunningTime="2026-09-10 16:00:15.063729408 +0000 UTC m=+264.617725298" Sep 10 16:00:15.077916 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:15.077871 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7h2v6" podStartSLOduration=2.446865252 podStartE2EDuration="7.077855857s" totalImagesPullingTime="4.630990605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:00:15.077376561 +0000 UTC m=+264.631372453" watchObservedRunningTime="2026-09-10 16:00:15.077855857 +0000 UTC m=+264.631851747" Sep 10 16:00:38.457182 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.457144 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs"] Sep 10 16:00:38.459637 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.459621 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:38.462781 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.462752 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 16:00:38.462781 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.462772 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 16:00:38.462948 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.462822 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sfvsh\"" Sep 10 16:00:38.463111 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.463097 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 16:00:38.464445 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.464428 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 16:00:38.473618 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.473595 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da5efc8a-fb82-4828-9f3b-4a727df73896-tmp\") pod \"opendatahub-operator-controller-manager-5995b6f449-s8jhs\" (UID: \"da5efc8a-fb82-4828-9f3b-4a727df73896\") " pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:38.473713 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.473642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da5efc8a-fb82-4828-9f3b-4a727df73896-webhook-cert\") pod \"opendatahub-operator-controller-manager-5995b6f449-s8jhs\" (UID: \"da5efc8a-fb82-4828-9f3b-4a727df73896\") " pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:38.473713 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.473675 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/da5efc8a-fb82-4828-9f3b-4a727df73896-manifests\") pod \"opendatahub-operator-controller-manager-5995b6f449-s8jhs\" (UID: \"da5efc8a-fb82-4828-9f3b-4a727df73896\") " pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:38.473713 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.473692 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd5k4\" (UniqueName: \"kubernetes.io/projected/da5efc8a-fb82-4828-9f3b-4a727df73896-kube-api-access-nd5k4\") pod \"opendatahub-operator-controller-manager-5995b6f449-s8jhs\" (UID: \"da5efc8a-fb82-4828-9f3b-4a727df73896\") " pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:38.473713 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.473711 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/da5efc8a-fb82-4828-9f3b-4a727df73896-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5995b6f449-s8jhs\" (UID: \"da5efc8a-fb82-4828-9f3b-4a727df73896\") " pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:38.490109 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.490085 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs"] Sep 10 16:00:38.574274 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.574243 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da5efc8a-fb82-4828-9f3b-4a727df73896-tmp\") pod \"opendatahub-operator-controller-manager-5995b6f449-s8jhs\" (UID: \"da5efc8a-fb82-4828-9f3b-4a727df73896\") " pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:38.574476 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.574305 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da5efc8a-fb82-4828-9f3b-4a727df73896-webhook-cert\") pod \"opendatahub-operator-controller-manager-5995b6f449-s8jhs\" (UID: \"da5efc8a-fb82-4828-9f3b-4a727df73896\") " pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:38.574476 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.574337 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/da5efc8a-fb82-4828-9f3b-4a727df73896-manifests\") pod \"opendatahub-operator-controller-manager-5995b6f449-s8jhs\" (UID: \"da5efc8a-fb82-4828-9f3b-4a727df73896\") " pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:38.574476 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.574362 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd5k4\" (UniqueName: \"kubernetes.io/projected/da5efc8a-fb82-4828-9f3b-4a727df73896-kube-api-access-nd5k4\") pod \"opendatahub-operator-controller-manager-5995b6f449-s8jhs\" (UID: \"da5efc8a-fb82-4828-9f3b-4a727df73896\") " pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:38.574476 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.574387 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/da5efc8a-fb82-4828-9f3b-4a727df73896-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5995b6f449-s8jhs\" (UID: \"da5efc8a-fb82-4828-9f3b-4a727df73896\") " pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:38.574813 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.574791 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/da5efc8a-fb82-4828-9f3b-4a727df73896-manifests\") pod \"opendatahub-operator-controller-manager-5995b6f449-s8jhs\" (UID: \"da5efc8a-fb82-4828-9f3b-4a727df73896\") " pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:38.576566 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.576547 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da5efc8a-fb82-4828-9f3b-4a727df73896-tmp\") pod \"opendatahub-operator-controller-manager-5995b6f449-s8jhs\" (UID: \"da5efc8a-fb82-4828-9f3b-4a727df73896\") " pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:38.576829 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.576811 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da5efc8a-fb82-4828-9f3b-4a727df73896-webhook-cert\") pod \"opendatahub-operator-controller-manager-5995b6f449-s8jhs\" (UID: \"da5efc8a-fb82-4828-9f3b-4a727df73896\") " pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:38.576899 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.576880 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/da5efc8a-fb82-4828-9f3b-4a727df73896-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5995b6f449-s8jhs\" (UID: \"da5efc8a-fb82-4828-9f3b-4a727df73896\") " pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:38.585405 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.585379 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd5k4\" (UniqueName: \"kubernetes.io/projected/da5efc8a-fb82-4828-9f3b-4a727df73896-kube-api-access-nd5k4\") pod \"opendatahub-operator-controller-manager-5995b6f449-s8jhs\" (UID: \"da5efc8a-fb82-4828-9f3b-4a727df73896\") " pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:38.770059 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:38.769979 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:39.049182 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:39.049153 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs"] Sep 10 16:00:39.050851 ip-10-0-131-28 kubenswrapper[2574]: W0910 16:00:39.050824 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda5efc8a_fb82_4828_9f3b_4a727df73896.slice/crio-1a636e01b089e14521cc42201915a6c81945c62e13517e28d6065bcf11cc7fb0 WatchSource:0}: Error finding container 1a636e01b089e14521cc42201915a6c81945c62e13517e28d6065bcf11cc7fb0: Status 404 returned error can't find the container with id 1a636e01b089e14521cc42201915a6c81945c62e13517e28d6065bcf11cc7fb0 Sep 10 16:00:39.139496 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:39.139459 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" event={"ID":"da5efc8a-fb82-4828-9f3b-4a727df73896","Type":"ContainerStarted","Data":"1a636e01b089e14521cc42201915a6c81945c62e13517e28d6065bcf11cc7fb0"} Sep 10 16:00:43.158814 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:43.158772 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" event={"ID":"da5efc8a-fb82-4828-9f3b-4a727df73896","Type":"ContainerStarted","Data":"5b49f4aa2414f2646fd798a18b08d525124f6788ccbbaa98ee0b64b1b6ea5e48"} Sep 10 16:00:44.164350 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:44.164314 2574 generic.go:356] "Generic (PLEG): container finished" podID="da5efc8a-fb82-4828-9f3b-4a727df73896" containerID="5b49f4aa2414f2646fd798a18b08d525124f6788ccbbaa98ee0b64b1b6ea5e48" exitCode=0 Sep 10 16:00:44.164710 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:44.164415 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" event={"ID":"da5efc8a-fb82-4828-9f3b-4a727df73896","Type":"ContainerDied","Data":"5b49f4aa2414f2646fd798a18b08d525124f6788ccbbaa98ee0b64b1b6ea5e48"} Sep 10 16:00:45.170632 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:45.170532 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" event={"ID":"da5efc8a-fb82-4828-9f3b-4a727df73896","Type":"ContainerStarted","Data":"6ce5a3231fc395aa80320b4a485765048f9e66dd9f10d1fb237735ee202eaba3"} Sep 10 16:00:45.171055 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:45.170646 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:00:45.194107 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:45.194051 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" podStartSLOduration=1.90083722 podStartE2EDuration="7.194034375s" totalImagesPullingTime="4.278484992s" totalInitContainerRuntime="1.014712163s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:00:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:00:45.191837267 +0000 UTC m=+294.745833157" watchObservedRunningTime="2026-09-10 16:00:45.194034375 +0000 UTC m=+294.748030265" Sep 10 16:00:50.849004 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:50.848964 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2r27m_9feb0e61-fa46-4164-9ab2-cbfdd536205b/ovn-acl-logging/0.log" Sep 10 16:00:50.849901 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:50.849876 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2r27m_9feb0e61-fa46-4164-9ab2-cbfdd536205b/ovn-acl-logging/0.log" Sep 10 16:00:50.854863 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:50.854836 2574 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 16:00:56.177467 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:00:56.177435 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5995b6f449-s8jhs" Sep 10 16:01:08.841043 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:08.841003 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f"] Sep 10 16:01:08.843898 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:08.843873 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f" Sep 10 16:01:08.847167 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:08.847146 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 10 16:01:08.847286 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:08.847178 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 10 16:01:08.848238 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:08.848220 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 16:01:08.848333 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:08.848236 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 16:01:08.848333 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:08.848225 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5zrbt\"" Sep 10 16:01:08.855999 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:08.855975 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f"] Sep 10 16:01:08.936178 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:08.936136 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08e19084-b74f-42e0-a592-3a641e061eaa-tls-certs\") pod \"kube-auth-proxy-89dd5bbbb-rkc6f\" (UID: \"08e19084-b74f-42e0-a592-3a641e061eaa\") " pod="openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f" Sep 10 16:01:08.936178 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:08.936180 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08e19084-b74f-42e0-a592-3a641e061eaa-tmp\") pod \"kube-auth-proxy-89dd5bbbb-rkc6f\" (UID: \"08e19084-b74f-42e0-a592-3a641e061eaa\") " pod="openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f" Sep 10 16:01:08.936382 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:08.936308 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7x2l\" (UniqueName: \"kubernetes.io/projected/08e19084-b74f-42e0-a592-3a641e061eaa-kube-api-access-g7x2l\") pod \"kube-auth-proxy-89dd5bbbb-rkc6f\" (UID: \"08e19084-b74f-42e0-a592-3a641e061eaa\") " pod="openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f" Sep 10 16:01:09.037672 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.037628 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08e19084-b74f-42e0-a592-3a641e061eaa-tls-certs\") pod \"kube-auth-proxy-89dd5bbbb-rkc6f\" (UID: \"08e19084-b74f-42e0-a592-3a641e061eaa\") " pod="openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f" Sep 10 16:01:09.037859 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.037680 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08e19084-b74f-42e0-a592-3a641e061eaa-tmp\") pod \"kube-auth-proxy-89dd5bbbb-rkc6f\" (UID: \"08e19084-b74f-42e0-a592-3a641e061eaa\") " pod="openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f" Sep 10 16:01:09.037859 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.037764 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7x2l\" (UniqueName: \"kubernetes.io/projected/08e19084-b74f-42e0-a592-3a641e061eaa-kube-api-access-g7x2l\") pod \"kube-auth-proxy-89dd5bbbb-rkc6f\" (UID: \"08e19084-b74f-42e0-a592-3a641e061eaa\") " pod="openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f" Sep 10 16:01:09.037859 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:01:09.037766 2574 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 10 16:01:09.037859 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:01:09.037858 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08e19084-b74f-42e0-a592-3a641e061eaa-tls-certs podName:08e19084-b74f-42e0-a592-3a641e061eaa nodeName:}" failed. No retries permitted until 2026-09-10 16:01:09.537831731 +0000 UTC m=+319.091827613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/08e19084-b74f-42e0-a592-3a641e061eaa-tls-certs") pod "kube-auth-proxy-89dd5bbbb-rkc6f" (UID: "08e19084-b74f-42e0-a592-3a641e061eaa") : secret "kube-auth-proxy-tls" not found Sep 10 16:01:09.040450 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.040427 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08e19084-b74f-42e0-a592-3a641e061eaa-tmp\") pod \"kube-auth-proxy-89dd5bbbb-rkc6f\" (UID: \"08e19084-b74f-42e0-a592-3a641e061eaa\") " pod="openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f" Sep 10 16:01:09.048495 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.048470 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7x2l\" (UniqueName: \"kubernetes.io/projected/08e19084-b74f-42e0-a592-3a641e061eaa-kube-api-access-g7x2l\") pod \"kube-auth-proxy-89dd5bbbb-rkc6f\" (UID: \"08e19084-b74f-42e0-a592-3a641e061eaa\") " pod="openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f" Sep 10 16:01:09.543011 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.542971 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08e19084-b74f-42e0-a592-3a641e061eaa-tls-certs\") pod \"kube-auth-proxy-89dd5bbbb-rkc6f\" (UID: \"08e19084-b74f-42e0-a592-3a641e061eaa\") " pod="openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f" Sep 10 16:01:09.545299 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.545271 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08e19084-b74f-42e0-a592-3a641e061eaa-tls-certs\") pod \"kube-auth-proxy-89dd5bbbb-rkc6f\" (UID: \"08e19084-b74f-42e0-a592-3a641e061eaa\") " pod="openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f" Sep 10 16:01:09.551652 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.551623 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tf86h"] Sep 10 16:01:09.554092 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.554073 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tf86h" Sep 10 16:01:09.562393 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.562375 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 10 16:01:09.577044 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.577020 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tf86h"] Sep 10 16:01:09.644037 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.644000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpkdr\" (UniqueName: \"kubernetes.io/projected/428131af-5c52-4344-add7-4fa536de9ceb-kube-api-access-gpkdr\") pod \"model-serving-api-54d89bd5fc-tf86h\" (UID: \"428131af-5c52-4344-add7-4fa536de9ceb\") " pod="opendatahub/model-serving-api-54d89bd5fc-tf86h" Sep 10 16:01:09.644037 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.644044 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/428131af-5c52-4344-add7-4fa536de9ceb-tls-certs\") pod \"model-serving-api-54d89bd5fc-tf86h\" (UID: \"428131af-5c52-4344-add7-4fa536de9ceb\") " pod="opendatahub/model-serving-api-54d89bd5fc-tf86h" Sep 10 16:01:09.744751 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.744713 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpkdr\" (UniqueName: \"kubernetes.io/projected/428131af-5c52-4344-add7-4fa536de9ceb-kube-api-access-gpkdr\") pod \"model-serving-api-54d89bd5fc-tf86h\" (UID: \"428131af-5c52-4344-add7-4fa536de9ceb\") " pod="opendatahub/model-serving-api-54d89bd5fc-tf86h" Sep 10 16:01:09.744751 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.744759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/428131af-5c52-4344-add7-4fa536de9ceb-tls-certs\") pod \"model-serving-api-54d89bd5fc-tf86h\" (UID: \"428131af-5c52-4344-add7-4fa536de9ceb\") " pod="opendatahub/model-serving-api-54d89bd5fc-tf86h" Sep 10 16:01:09.747244 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.747225 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/428131af-5c52-4344-add7-4fa536de9ceb-tls-certs\") pod \"model-serving-api-54d89bd5fc-tf86h\" (UID: \"428131af-5c52-4344-add7-4fa536de9ceb\") " pod="opendatahub/model-serving-api-54d89bd5fc-tf86h" Sep 10 16:01:09.753820 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.753791 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f" Sep 10 16:01:09.754111 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.754093 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpkdr\" (UniqueName: \"kubernetes.io/projected/428131af-5c52-4344-add7-4fa536de9ceb-kube-api-access-gpkdr\") pod \"model-serving-api-54d89bd5fc-tf86h\" (UID: \"428131af-5c52-4344-add7-4fa536de9ceb\") " pod="opendatahub/model-serving-api-54d89bd5fc-tf86h" Sep 10 16:01:09.864342 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:09.864307 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tf86h" Sep 10 16:01:10.025762 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:10.025739 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f"] Sep 10 16:01:10.028205 ip-10-0-131-28 kubenswrapper[2574]: W0910 16:01:10.028160 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e19084_b74f_42e0_a592_3a641e061eaa.slice/crio-4c79515335dd68ab0ff21d51286a8be7b6e132f8616eac1b3b71bddd9c7d545d WatchSource:0}: Error finding container 4c79515335dd68ab0ff21d51286a8be7b6e132f8616eac1b3b71bddd9c7d545d: Status 404 returned error can't find the container with id 4c79515335dd68ab0ff21d51286a8be7b6e132f8616eac1b3b71bddd9c7d545d Sep 10 16:01:10.029929 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:10.029915 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 16:01:10.134075 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:10.134038 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tf86h"] Sep 10 16:01:10.139664 ip-10-0-131-28 kubenswrapper[2574]: W0910 16:01:10.139637 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428131af_5c52_4344_add7_4fa536de9ceb.slice/crio-97a3c235fb412250a6eeb36b2a14c74cd878d42bef3f73cbe8140b69bcdff98e WatchSource:0}: Error finding container 97a3c235fb412250a6eeb36b2a14c74cd878d42bef3f73cbe8140b69bcdff98e: Status 404 returned error can't find the container with id 97a3c235fb412250a6eeb36b2a14c74cd878d42bef3f73cbe8140b69bcdff98e Sep 10 16:01:10.274852 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:10.274815 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f" event={"ID":"08e19084-b74f-42e0-a592-3a641e061eaa","Type":"ContainerStarted","Data":"4c79515335dd68ab0ff21d51286a8be7b6e132f8616eac1b3b71bddd9c7d545d"} Sep 10 16:01:10.275940 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:10.275917 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tf86h" event={"ID":"428131af-5c52-4344-add7-4fa536de9ceb","Type":"ContainerStarted","Data":"97a3c235fb412250a6eeb36b2a14c74cd878d42bef3f73cbe8140b69bcdff98e"} Sep 10 16:01:14.296971 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:14.296928 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tf86h" event={"ID":"428131af-5c52-4344-add7-4fa536de9ceb","Type":"ContainerStarted","Data":"c4b9c3e7258f2704ac55f636998dd0e1ec2397bf2d077394f6a1fb472c24aea0"} Sep 10 16:01:14.297480 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:14.297077 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-tf86h" Sep 10 16:01:14.298418 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:14.298397 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f" event={"ID":"08e19084-b74f-42e0-a592-3a641e061eaa","Type":"ContainerStarted","Data":"b469ed036fea539276e50340f0ece9c2c62a84cf283eef506505516cc6654722"} Sep 10 16:01:14.314598 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:14.314549 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-tf86h" podStartSLOduration=1.662500281 podStartE2EDuration="5.314527628s" totalImagesPullingTime="3.652027347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:01:14.313308239 +0000 UTC m=+323.867304154" watchObservedRunningTime="2026-09-10 16:01:14.314527628 +0000 UTC m=+323.868523519" Sep 10 16:01:14.330003 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:14.329956 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-89dd5bbbb-rkc6f" podStartSLOduration=2.553756335 podStartE2EDuration="6.329941921s" totalImagesPullingTime="3.776185586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:01:14.328727992 +0000 UTC m=+323.882723884" watchObservedRunningTime="2026-09-10 16:01:14.329941921 +0000 UTC m=+323.883937813" Sep 10 16:01:17.601295 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.601258 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd"] Sep 10 16:01:17.603809 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.603791 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.606639 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.606611 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 16:01:17.606815 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.606797 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-64x4w\"" Sep 10 16:01:17.613096 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.613055 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.613235 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.613117 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.613235 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.613166 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.613362 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.613274 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.613362 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.613310 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjltv\" (UniqueName: \"kubernetes.io/projected/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-kube-api-access-tjltv\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.613362 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.613339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.613517 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.613368 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.613517 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.613399 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.613517 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.613457 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.621816 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.621793 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd"] Sep 10 16:01:17.713855 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.713820 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.713855 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.713867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.714105 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.713923 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.714105 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.713982 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.714105 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.714029 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.714105 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.714045 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjltv\" (UniqueName: \"kubernetes.io/projected/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-kube-api-access-tjltv\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.714105 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.714069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.714105 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.714096 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.714440 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.714129 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.714440 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.714311 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.714641 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.714616 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.714705 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.714652 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.714768 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.714749 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.714817 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.714783 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.716274 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.716259 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.716864 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.716846 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.728447 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.728417 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.728590 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.728503 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjltv\" (UniqueName: \"kubernetes.io/projected/eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8-kube-api-access-tjltv\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd\" (UID: \"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:17.915304 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:17.915212 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:18.211048 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.211018 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd"] Sep 10 16:01:18.211596 ip-10-0-131-28 kubenswrapper[2574]: W0910 16:01:18.211570 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec1184f_cf7a_4eaf_8646_9ab3fcc7d6a8.slice/crio-406fc17c5dc9e94e5ae75f849704f465743bbc272c1768ff6c1c185f3443089f WatchSource:0}: Error finding container 406fc17c5dc9e94e5ae75f849704f465743bbc272c1768ff6c1c185f3443089f: Status 404 returned error can't find the container with id 406fc17c5dc9e94e5ae75f849704f465743bbc272c1768ff6c1c185f3443089f Sep 10 16:01:18.317346 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.317314 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" event={"ID":"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8","Type":"ContainerStarted","Data":"406fc17c5dc9e94e5ae75f849704f465743bbc272c1768ff6c1c185f3443089f"} Sep 10 16:01:18.683394 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.683352 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-f69bf"] Sep 10 16:01:18.687120 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.687096 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f69bf" Sep 10 16:01:18.690324 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.690294 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 10 16:01:18.690492 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.690299 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-nv2b4\"" Sep 10 16:01:18.697126 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.697097 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-95csb"] Sep 10 16:01:18.700528 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.700497 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95csb" Sep 10 16:01:18.705532 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.705505 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-6jrzv\"" Sep 10 16:01:18.705756 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.705737 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 10 16:01:18.710685 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.710643 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-f69bf"] Sep 10 16:01:18.723153 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.723114 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn2fw\" (UniqueName: \"kubernetes.io/projected/903a9282-5ecc-4afa-8934-65065d8cc77b-kube-api-access-cn2fw\") pod \"kserve-controller-manager-d6f4b65b8-f69bf\" (UID: \"903a9282-5ecc-4afa-8934-65065d8cc77b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f69bf" Sep 10 16:01:18.723393 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.723214 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfbzh\" (UniqueName: \"kubernetes.io/projected/555484fb-9d21-4693-ba1b-eabe2acdb302-kube-api-access-sfbzh\") pod \"llmisvc-controller-manager-777c6bd7d5-95csb\" (UID: \"555484fb-9d21-4693-ba1b-eabe2acdb302\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95csb" Sep 10 16:01:18.723393 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.723277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/903a9282-5ecc-4afa-8934-65065d8cc77b-cert\") pod \"kserve-controller-manager-d6f4b65b8-f69bf\" (UID: \"903a9282-5ecc-4afa-8934-65065d8cc77b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f69bf" Sep 10 16:01:18.723393 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.723331 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/555484fb-9d21-4693-ba1b-eabe2acdb302-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-95csb\" (UID: \"555484fb-9d21-4693-ba1b-eabe2acdb302\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95csb" Sep 10 16:01:18.739783 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.739747 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-95csb"] Sep 10 16:01:18.823799 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.823751 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn2fw\" (UniqueName: \"kubernetes.io/projected/903a9282-5ecc-4afa-8934-65065d8cc77b-kube-api-access-cn2fw\") pod \"kserve-controller-manager-d6f4b65b8-f69bf\" (UID: \"903a9282-5ecc-4afa-8934-65065d8cc77b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f69bf" Sep 10 16:01:18.823979 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.823921 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfbzh\" (UniqueName: \"kubernetes.io/projected/555484fb-9d21-4693-ba1b-eabe2acdb302-kube-api-access-sfbzh\") pod \"llmisvc-controller-manager-777c6bd7d5-95csb\" (UID: \"555484fb-9d21-4693-ba1b-eabe2acdb302\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95csb" Sep 10 16:01:18.823979 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.823973 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/903a9282-5ecc-4afa-8934-65065d8cc77b-cert\") pod \"kserve-controller-manager-d6f4b65b8-f69bf\" (UID: \"903a9282-5ecc-4afa-8934-65065d8cc77b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f69bf" Sep 10 16:01:18.824052 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.824021 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/555484fb-9d21-4693-ba1b-eabe2acdb302-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-95csb\" (UID: \"555484fb-9d21-4693-ba1b-eabe2acdb302\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95csb" Sep 10 16:01:18.824151 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:01:18.824136 2574 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Sep 10 16:01:18.824228 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:01:18.824215 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/555484fb-9d21-4693-ba1b-eabe2acdb302-cert podName:555484fb-9d21-4693-ba1b-eabe2acdb302 nodeName:}" failed. No retries permitted until 2026-09-10 16:01:19.324182815 +0000 UTC m=+328.878178684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/555484fb-9d21-4693-ba1b-eabe2acdb302-cert") pod "llmisvc-controller-manager-777c6bd7d5-95csb" (UID: "555484fb-9d21-4693-ba1b-eabe2acdb302") : secret "llmisvc-webhook-server-cert" not found Sep 10 16:01:18.826625 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.826602 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/903a9282-5ecc-4afa-8934-65065d8cc77b-cert\") pod \"kserve-controller-manager-d6f4b65b8-f69bf\" (UID: \"903a9282-5ecc-4afa-8934-65065d8cc77b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f69bf" Sep 10 16:01:18.837913 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.837878 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn2fw\" (UniqueName: \"kubernetes.io/projected/903a9282-5ecc-4afa-8934-65065d8cc77b-kube-api-access-cn2fw\") pod \"kserve-controller-manager-d6f4b65b8-f69bf\" (UID: \"903a9282-5ecc-4afa-8934-65065d8cc77b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f69bf" Sep 10 16:01:18.841723 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:18.841694 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfbzh\" (UniqueName: \"kubernetes.io/projected/555484fb-9d21-4693-ba1b-eabe2acdb302-kube-api-access-sfbzh\") pod \"llmisvc-controller-manager-777c6bd7d5-95csb\" (UID: \"555484fb-9d21-4693-ba1b-eabe2acdb302\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95csb" Sep 10 16:01:19.003576 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.003475 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f69bf" Sep 10 16:01:19.293907 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.293824 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-f69bf"] Sep 10 16:01:19.297806 ip-10-0-131-28 kubenswrapper[2574]: W0910 16:01:19.297777 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903a9282_5ecc_4afa_8934_65065d8cc77b.slice/crio-f111ceb74d022148ba7fc32f79283cfb0f8c4f2275121f8dd676899eedb66ca5 WatchSource:0}: Error finding container f111ceb74d022148ba7fc32f79283cfb0f8c4f2275121f8dd676899eedb66ca5: Status 404 returned error can't find the container with id f111ceb74d022148ba7fc32f79283cfb0f8c4f2275121f8dd676899eedb66ca5 Sep 10 16:01:19.323158 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.323118 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f69bf" event={"ID":"903a9282-5ecc-4afa-8934-65065d8cc77b","Type":"ContainerStarted","Data":"f111ceb74d022148ba7fc32f79283cfb0f8c4f2275121f8dd676899eedb66ca5"} Sep 10 16:01:19.327522 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.327502 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/555484fb-9d21-4693-ba1b-eabe2acdb302-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-95csb\" (UID: \"555484fb-9d21-4693-ba1b-eabe2acdb302\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95csb" Sep 10 16:01:19.329864 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.329846 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/555484fb-9d21-4693-ba1b-eabe2acdb302-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-95csb\" (UID: \"555484fb-9d21-4693-ba1b-eabe2acdb302\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95csb" Sep 10 16:01:19.590611 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.590573 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5"] Sep 10 16:01:19.593493 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.593471 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" Sep 10 16:01:19.597959 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.597714 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 16:01:19.597959 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.597777 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 16:01:19.597959 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.597808 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 16:01:19.597959 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.597716 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 16:01:19.597959 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.597809 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 16:01:19.597959 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.597957 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xn6tz\"" Sep 10 16:01:19.618055 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.618006 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5"] Sep 10 16:01:19.623655 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.623600 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95csb" Sep 10 16:01:19.629350 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.629263 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa-manager-config\") pod \"lws-controller-manager-5b9559cd76-bbsv5\" (UID: \"ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa\") " pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" Sep 10 16:01:19.629350 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.629310 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa-metrics-cert\") pod \"lws-controller-manager-5b9559cd76-bbsv5\" (UID: \"ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa\") " pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" Sep 10 16:01:19.629538 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.629393 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wx2v\" (UniqueName: \"kubernetes.io/projected/ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa-kube-api-access-7wx2v\") pod \"lws-controller-manager-5b9559cd76-bbsv5\" (UID: \"ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa\") " pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" Sep 10 16:01:19.629538 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.629425 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa-cert\") pod \"lws-controller-manager-5b9559cd76-bbsv5\" (UID: \"ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa\") " pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" Sep 10 16:01:19.729933 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.729897 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa-manager-config\") pod \"lws-controller-manager-5b9559cd76-bbsv5\" (UID: \"ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa\") " pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" Sep 10 16:01:19.729933 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.729943 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa-metrics-cert\") pod \"lws-controller-manager-5b9559cd76-bbsv5\" (UID: \"ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa\") " pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" Sep 10 16:01:19.730459 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.729999 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wx2v\" (UniqueName: \"kubernetes.io/projected/ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa-kube-api-access-7wx2v\") pod \"lws-controller-manager-5b9559cd76-bbsv5\" (UID: \"ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa\") " pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" Sep 10 16:01:19.730459 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.730029 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa-cert\") pod \"lws-controller-manager-5b9559cd76-bbsv5\" (UID: \"ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa\") " pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" Sep 10 16:01:19.731337 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.731312 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa-manager-config\") pod \"lws-controller-manager-5b9559cd76-bbsv5\" (UID: \"ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa\") " pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" Sep 10 16:01:19.733632 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.733595 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa-cert\") pod \"lws-controller-manager-5b9559cd76-bbsv5\" (UID: \"ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa\") " pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" Sep 10 16:01:19.735007 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.734986 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa-metrics-cert\") pod \"lws-controller-manager-5b9559cd76-bbsv5\" (UID: \"ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa\") " pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" Sep 10 16:01:19.740558 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.740514 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wx2v\" (UniqueName: \"kubernetes.io/projected/ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa-kube-api-access-7wx2v\") pod \"lws-controller-manager-5b9559cd76-bbsv5\" (UID: \"ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa\") " pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" Sep 10 16:01:19.907174 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.906892 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" Sep 10 16:01:19.939057 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:19.938869 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-95csb"] Sep 10 16:01:19.979163 ip-10-0-131-28 kubenswrapper[2574]: W0910 16:01:19.979129 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod555484fb_9d21_4693_ba1b_eabe2acdb302.slice/crio-be606ce235b8d7f2c6783ce139472d4b5ac3aca4af9350460423a00ef8923991 WatchSource:0}: Error finding container be606ce235b8d7f2c6783ce139472d4b5ac3aca4af9350460423a00ef8923991: Status 404 returned error can't find the container with id be606ce235b8d7f2c6783ce139472d4b5ac3aca4af9350460423a00ef8923991 Sep 10 16:01:20.266357 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:20.266332 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5"] Sep 10 16:01:20.269290 ip-10-0-131-28 kubenswrapper[2574]: W0910 16:01:20.269255 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded004f00_a1f8_44d9_8f4b_9fe7ff55fcfa.slice/crio-fa7c74f08f18f87ad9fa801f9b6cf66997fc9d767d8288643ab72b4b695139e9 WatchSource:0}: Error finding container fa7c74f08f18f87ad9fa801f9b6cf66997fc9d767d8288643ab72b4b695139e9: Status 404 returned error can't find the container with id fa7c74f08f18f87ad9fa801f9b6cf66997fc9d767d8288643ab72b4b695139e9 Sep 10 16:01:20.329481 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:20.329438 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95csb" event={"ID":"555484fb-9d21-4693-ba1b-eabe2acdb302","Type":"ContainerStarted","Data":"be606ce235b8d7f2c6783ce139472d4b5ac3aca4af9350460423a00ef8923991"} Sep 10 16:01:20.331051 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:20.331010 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" event={"ID":"ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa","Type":"ContainerStarted","Data":"fa7c74f08f18f87ad9fa801f9b6cf66997fc9d767d8288643ab72b4b695139e9"} Sep 10 16:01:21.612783 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:21.612748 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 16:01:21.613030 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:21.612818 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 16:01:21.613030 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:21.612846 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 10 16:01:22.347856 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:22.347808 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" event={"ID":"eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8","Type":"ContainerStarted","Data":"887fd4761eabb5dae357d2b9e026c062dccb0c8b39143b02cb5d0b979b93253a"} Sep 10 16:01:22.374318 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:22.374260 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" podStartSLOduration=1.975390627 podStartE2EDuration="5.374243318s" totalImagesPullingTime="3.398852691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:01:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:01:22.37260217 +0000 UTC m=+331.926598153" watchObservedRunningTime="2026-09-10 16:01:22.374243318 +0000 UTC m=+331.928239208" Sep 10 16:01:22.915786 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:22.915744 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:22.921579 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:22.921552 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:23.354010 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:23.353956 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:23.355336 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:23.355305 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd" Sep 10 16:01:25.306635 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:25.306605 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-tf86h" Sep 10 16:01:25.365311 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:25.365276 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95csb" event={"ID":"555484fb-9d21-4693-ba1b-eabe2acdb302","Type":"ContainerStarted","Data":"84dcf5e39147a394402779e5c2549e35df789f4a8c9fbf91ccf67843a3ddd7b8"} Sep 10 16:01:25.365499 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:25.365404 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95csb" Sep 10 16:01:25.366915 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:25.366890 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f69bf" event={"ID":"903a9282-5ecc-4afa-8934-65065d8cc77b","Type":"ContainerStarted","Data":"6cf7489a15aa86a4e93898d0fe5bd58f08dfe6d8ec7bffc94af9f28b97acdfc2"} Sep 10 16:01:25.367022 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:25.366972 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f69bf" Sep 10 16:01:25.368401 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:25.368381 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" event={"ID":"ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa","Type":"ContainerStarted","Data":"0c2df6d0dbf1fe95a408711012d9e2561c44a4a290f45914395a022505cfff94"} Sep 10 16:01:25.368625 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:25.368611 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" Sep 10 16:01:25.383304 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:25.383247 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95csb" podStartSLOduration=2.541443105 podStartE2EDuration="7.383227067s" totalImagesPullingTime="4.841783962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:01:25.381972696 +0000 UTC m=+334.935968588" watchObservedRunningTime="2026-09-10 16:01:25.383227067 +0000 UTC m=+334.937222958" Sep 10 16:01:25.399146 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:25.399098 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f69bf" podStartSLOduration=1.879830826 podStartE2EDuration="7.399083637s" totalImagesPullingTime="5.519252811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:01:25.397329804 +0000 UTC m=+334.951325707" watchObservedRunningTime="2026-09-10 16:01:25.399083637 +0000 UTC m=+334.953079551" Sep 10 16:01:25.413787 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:25.413699 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" podStartSLOduration=1.869660948 podStartE2EDuration="6.413680824s" totalImagesPullingTime="4.544019876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:01:25.413267375 +0000 UTC m=+334.967263267" watchObservedRunningTime="2026-09-10 16:01:25.413680824 +0000 UTC m=+334.967676718" Sep 10 16:01:36.374706 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:36.374675 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b9559cd76-bbsv5" Sep 10 16:01:56.374859 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:56.374828 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-95csb" Sep 10 16:01:56.377860 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:01:56.377842 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f69bf" Sep 10 16:02:40.358959 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:02:40.358923 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-674d448c7b-2j4xs"] Sep 10 16:03:05.384154 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.384101 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-674d448c7b-2j4xs" podUID="74d80ffa-b52a-4bc3-8302-198bfeb9975e" containerName="console" containerID="cri-o://88663b052631264203f472daf6e7c4414d1e82cc690210fbf327a8d963b874ec" gracePeriod=15 Sep 10 16:03:05.625103 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.625080 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 16:03:05.662412 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.662331 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-oauth-serving-cert\") pod \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " Sep 10 16:03:05.662412 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.662370 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-config\") pod \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " Sep 10 16:03:05.662412 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.662411 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-service-ca\") pod \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " Sep 10 16:03:05.662719 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.662449 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4tbk\" (UniqueName: \"kubernetes.io/projected/74d80ffa-b52a-4bc3-8302-198bfeb9975e-kube-api-access-s4tbk\") pod \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " Sep 10 16:03:05.662719 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.662612 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-oauth-config\") pod \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " Sep 10 16:03:05.662719 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.662659 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-trusted-ca-bundle\") pod \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " Sep 10 16:03:05.662719 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.662692 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-serving-cert\") pod \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\" (UID: \"74d80ffa-b52a-4bc3-8302-198bfeb9975e\") " Sep 10 16:03:05.662925 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.662733 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "74d80ffa-b52a-4bc3-8302-198bfeb9975e" (UID: "74d80ffa-b52a-4bc3-8302-198bfeb9975e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:03:05.662925 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.662791 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-service-ca" (OuterVolumeSpecName: "service-ca") pod "74d80ffa-b52a-4bc3-8302-198bfeb9975e" (UID: "74d80ffa-b52a-4bc3-8302-198bfeb9975e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:03:05.662925 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.662801 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-config" (OuterVolumeSpecName: "console-config") pod "74d80ffa-b52a-4bc3-8302-198bfeb9975e" (UID: "74d80ffa-b52a-4bc3-8302-198bfeb9975e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:03:05.663145 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.663094 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-oauth-serving-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 16:03:05.663145 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.663117 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-config\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 16:03:05.663145 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.663132 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-service-ca\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 16:03:05.663373 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.663219 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "74d80ffa-b52a-4bc3-8302-198bfeb9975e" (UID: "74d80ffa-b52a-4bc3-8302-198bfeb9975e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:03:05.664710 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.664683 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74d80ffa-b52a-4bc3-8302-198bfeb9975e-kube-api-access-s4tbk" (OuterVolumeSpecName: "kube-api-access-s4tbk") pod "74d80ffa-b52a-4bc3-8302-198bfeb9975e" (UID: "74d80ffa-b52a-4bc3-8302-198bfeb9975e"). InnerVolumeSpecName "kube-api-access-s4tbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:03:05.664855 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.664835 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "74d80ffa-b52a-4bc3-8302-198bfeb9975e" (UID: "74d80ffa-b52a-4bc3-8302-198bfeb9975e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:03:05.664910 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.664877 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "74d80ffa-b52a-4bc3-8302-198bfeb9975e" (UID: "74d80ffa-b52a-4bc3-8302-198bfeb9975e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:03:05.764431 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.764397 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4tbk\" (UniqueName: \"kubernetes.io/projected/74d80ffa-b52a-4bc3-8302-198bfeb9975e-kube-api-access-s4tbk\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 16:03:05.764431 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.764424 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-oauth-config\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 16:03:05.764431 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.764433 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74d80ffa-b52a-4bc3-8302-198bfeb9975e-trusted-ca-bundle\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 16:03:05.764660 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.764443 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74d80ffa-b52a-4bc3-8302-198bfeb9975e-console-serving-cert\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 16:03:05.803567 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.803536 2574 generic.go:356] "Generic (PLEG): container finished" podID="74d80ffa-b52a-4bc3-8302-198bfeb9975e" containerID="88663b052631264203f472daf6e7c4414d1e82cc690210fbf327a8d963b874ec" exitCode=0 Sep 10 16:03:05.803730 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.803583 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674d448c7b-2j4xs" event={"ID":"74d80ffa-b52a-4bc3-8302-198bfeb9975e","Type":"ContainerDied","Data":"88663b052631264203f472daf6e7c4414d1e82cc690210fbf327a8d963b874ec"} Sep 10 16:03:05.803730 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.803590 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674d448c7b-2j4xs" Sep 10 16:03:05.803730 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.803648 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674d448c7b-2j4xs" event={"ID":"74d80ffa-b52a-4bc3-8302-198bfeb9975e","Type":"ContainerDied","Data":"95c176e669ed99ce14e414ec1a91fed76919f78501c9b439a81b8abeb64dec78"} Sep 10 16:03:05.803730 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.803668 2574 scope.go:117] "RemoveContainer" containerID="88663b052631264203f472daf6e7c4414d1e82cc690210fbf327a8d963b874ec" Sep 10 16:03:05.813091 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.813070 2574 scope.go:117] "RemoveContainer" containerID="88663b052631264203f472daf6e7c4414d1e82cc690210fbf327a8d963b874ec" Sep 10 16:03:05.813408 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:03:05.813386 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88663b052631264203f472daf6e7c4414d1e82cc690210fbf327a8d963b874ec\": container with ID starting with 88663b052631264203f472daf6e7c4414d1e82cc690210fbf327a8d963b874ec not found: ID does not exist" containerID="88663b052631264203f472daf6e7c4414d1e82cc690210fbf327a8d963b874ec" Sep 10 16:03:05.813456 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.813419 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88663b052631264203f472daf6e7c4414d1e82cc690210fbf327a8d963b874ec"} err="failed to get container status \"88663b052631264203f472daf6e7c4414d1e82cc690210fbf327a8d963b874ec\": rpc error: code = NotFound desc = could not find container \"88663b052631264203f472daf6e7c4414d1e82cc690210fbf327a8d963b874ec\": container with ID starting with 88663b052631264203f472daf6e7c4414d1e82cc690210fbf327a8d963b874ec not found: ID does not exist" Sep 10 16:03:05.827699 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.827674 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-674d448c7b-2j4xs"] Sep 10 16:03:05.830390 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:05.830368 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-674d448c7b-2j4xs"] Sep 10 16:03:06.957352 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:06.957317 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74d80ffa-b52a-4bc3-8302-198bfeb9975e" path="/var/lib/kubelet/pods/74d80ffa-b52a-4bc3-8302-198bfeb9975e/volumes" Sep 10 16:03:38.263250 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:38.263219 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-ggbvl"] Sep 10 16:03:38.263688 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:38.263548 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74d80ffa-b52a-4bc3-8302-198bfeb9975e" containerName="console" Sep 10 16:03:38.263688 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:38.263558 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="74d80ffa-b52a-4bc3-8302-198bfeb9975e" containerName="console" Sep 10 16:03:38.263688 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:38.263624 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="74d80ffa-b52a-4bc3-8302-198bfeb9975e" containerName="console" Sep 10 16:03:38.265695 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:38.265680 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-ggbvl" Sep 10 16:03:38.268481 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:38.268462 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 16:03:38.269524 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:38.269506 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 16:03:38.269612 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:38.269569 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-tl6p7\"" Sep 10 16:03:38.272812 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:38.272728 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-ggbvl"] Sep 10 16:03:38.339493 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:38.339435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l97bc\" (UniqueName: \"kubernetes.io/projected/8a846243-18d0-485f-90c8-ff4e442cf0d3-kube-api-access-l97bc\") pod \"authorino-59c974bd48-ggbvl\" (UID: \"8a846243-18d0-485f-90c8-ff4e442cf0d3\") " pod="kuadrant-system/authorino-59c974bd48-ggbvl" Sep 10 16:03:38.440432 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:38.440394 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l97bc\" (UniqueName: \"kubernetes.io/projected/8a846243-18d0-485f-90c8-ff4e442cf0d3-kube-api-access-l97bc\") pod \"authorino-59c974bd48-ggbvl\" (UID: \"8a846243-18d0-485f-90c8-ff4e442cf0d3\") " pod="kuadrant-system/authorino-59c974bd48-ggbvl" Sep 10 16:03:38.451359 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:38.451331 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l97bc\" (UniqueName: \"kubernetes.io/projected/8a846243-18d0-485f-90c8-ff4e442cf0d3-kube-api-access-l97bc\") pod \"authorino-59c974bd48-ggbvl\" (UID: \"8a846243-18d0-485f-90c8-ff4e442cf0d3\") " pod="kuadrant-system/authorino-59c974bd48-ggbvl" Sep 10 16:03:38.575986 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:38.575956 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-ggbvl" Sep 10 16:03:38.844651 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:38.844570 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-ggbvl"] Sep 10 16:03:38.848557 ip-10-0-131-28 kubenswrapper[2574]: W0910 16:03:38.848529 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a846243_18d0_485f_90c8_ff4e442cf0d3.slice/crio-441725bb5997ad6b15c1d2c08a8dbc775c70fe5d4f8933d25298272a505fb848 WatchSource:0}: Error finding container 441725bb5997ad6b15c1d2c08a8dbc775c70fe5d4f8933d25298272a505fb848: Status 404 returned error can't find the container with id 441725bb5997ad6b15c1d2c08a8dbc775c70fe5d4f8933d25298272a505fb848 Sep 10 16:03:38.955959 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:38.955919 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-ggbvl" event={"ID":"8a846243-18d0-485f-90c8-ff4e442cf0d3","Type":"ContainerStarted","Data":"441725bb5997ad6b15c1d2c08a8dbc775c70fe5d4f8933d25298272a505fb848"} Sep 10 16:03:41.972640 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:41.972598 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-ggbvl" event={"ID":"8a846243-18d0-485f-90c8-ff4e442cf0d3","Type":"ContainerStarted","Data":"aea63ac5c78fe009c214b446ed115793a685e0963372072ec61053f40bb11692"} Sep 10 16:03:41.988257 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:03:41.988185 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-ggbvl" podStartSLOduration=1.6406145030000001 podStartE2EDuration="3.988170256s" totalImagesPullingTime="2.347555753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:41.987675662 +0000 UTC m=+471.541671552" watchObservedRunningTime="2026-09-10 16:03:41.988170256 +0000 UTC m=+471.542166146" Sep 10 16:04:11.184223 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:11.184177 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-dhbw8"] Sep 10 16:04:11.187553 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:11.187536 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-dhbw8" Sep 10 16:04:11.198019 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:11.197994 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-dhbw8"] Sep 10 16:04:11.230008 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:11.229974 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slqh4\" (UniqueName: \"kubernetes.io/projected/3420ec9b-050c-4572-ba9b-95798c976ab6-kube-api-access-slqh4\") pod \"authorino-557f876f69-dhbw8\" (UID: \"3420ec9b-050c-4572-ba9b-95798c976ab6\") " pod="kuadrant-system/authorino-557f876f69-dhbw8" Sep 10 16:04:11.330573 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:11.330529 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slqh4\" (UniqueName: \"kubernetes.io/projected/3420ec9b-050c-4572-ba9b-95798c976ab6-kube-api-access-slqh4\") pod \"authorino-557f876f69-dhbw8\" (UID: \"3420ec9b-050c-4572-ba9b-95798c976ab6\") " pod="kuadrant-system/authorino-557f876f69-dhbw8" Sep 10 16:04:11.340083 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:11.340049 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slqh4\" (UniqueName: \"kubernetes.io/projected/3420ec9b-050c-4572-ba9b-95798c976ab6-kube-api-access-slqh4\") pod \"authorino-557f876f69-dhbw8\" (UID: \"3420ec9b-050c-4572-ba9b-95798c976ab6\") " pod="kuadrant-system/authorino-557f876f69-dhbw8" Sep 10 16:04:11.430428 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:11.430392 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-dhbw8"] Sep 10 16:04:11.430661 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:11.430648 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-dhbw8" Sep 10 16:04:11.700499 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:11.700472 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-dhbw8"] Sep 10 16:04:11.702328 ip-10-0-131-28 kubenswrapper[2574]: W0910 16:04:11.702296 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3420ec9b_050c_4572_ba9b_95798c976ab6.slice/crio-a2d45bbed65330d50168d6e1b8698a0ac49b4781d3499362e3fa40dec93ffd3c WatchSource:0}: Error finding container a2d45bbed65330d50168d6e1b8698a0ac49b4781d3499362e3fa40dec93ffd3c: Status 404 returned error can't find the container with id a2d45bbed65330d50168d6e1b8698a0ac49b4781d3499362e3fa40dec93ffd3c Sep 10 16:04:12.108993 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:12.108959 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-dhbw8" event={"ID":"3420ec9b-050c-4572-ba9b-95798c976ab6","Type":"ContainerStarted","Data":"a2d45bbed65330d50168d6e1b8698a0ac49b4781d3499362e3fa40dec93ffd3c"} Sep 10 16:04:13.114974 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:13.114940 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-dhbw8" event={"ID":"3420ec9b-050c-4572-ba9b-95798c976ab6","Type":"ContainerStarted","Data":"7b93c3fd8bac345252ed7011ddb327956c29b281c3a50bdfcba09dd39b5fb241"} Sep 10 16:04:13.115389 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:13.114986 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-dhbw8" podUID="3420ec9b-050c-4572-ba9b-95798c976ab6" containerName="authorino" containerID="cri-o://7b93c3fd8bac345252ed7011ddb327956c29b281c3a50bdfcba09dd39b5fb241" gracePeriod=30 Sep 10 16:04:13.131086 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:13.131042 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-dhbw8" podStartSLOduration=1.484532199 podStartE2EDuration="2.131027037s" totalImagesPullingTime="646.494838ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:13.130424067 +0000 UTC m=+502.684419959" watchObservedRunningTime="2026-09-10 16:04:13.131027037 +0000 UTC m=+502.685022928" Sep 10 16:04:13.358429 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:13.358403 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-dhbw8" Sep 10 16:04:13.448519 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:13.448433 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slqh4\" (UniqueName: \"kubernetes.io/projected/3420ec9b-050c-4572-ba9b-95798c976ab6-kube-api-access-slqh4\") pod \"3420ec9b-050c-4572-ba9b-95798c976ab6\" (UID: \"3420ec9b-050c-4572-ba9b-95798c976ab6\") " Sep 10 16:04:13.450484 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:13.450454 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3420ec9b-050c-4572-ba9b-95798c976ab6-kube-api-access-slqh4" (OuterVolumeSpecName: "kube-api-access-slqh4") pod "3420ec9b-050c-4572-ba9b-95798c976ab6" (UID: "3420ec9b-050c-4572-ba9b-95798c976ab6"). InnerVolumeSpecName "kube-api-access-slqh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:04:13.494717 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:13.494681 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-ggbvl"] Sep 10 16:04:13.494894 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:13.494872 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-ggbvl" podUID="8a846243-18d0-485f-90c8-ff4e442cf0d3" containerName="authorino" containerID="cri-o://aea63ac5c78fe009c214b446ed115793a685e0963372072ec61053f40bb11692" gracePeriod=30 Sep 10 16:04:13.549835 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:13.549801 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slqh4\" (UniqueName: \"kubernetes.io/projected/3420ec9b-050c-4572-ba9b-95798c976ab6-kube-api-access-slqh4\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 16:04:13.736284 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:13.736261 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-ggbvl" Sep 10 16:04:13.852926 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:13.852888 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l97bc\" (UniqueName: \"kubernetes.io/projected/8a846243-18d0-485f-90c8-ff4e442cf0d3-kube-api-access-l97bc\") pod \"8a846243-18d0-485f-90c8-ff4e442cf0d3\" (UID: \"8a846243-18d0-485f-90c8-ff4e442cf0d3\") " Sep 10 16:04:13.854960 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:13.854938 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a846243-18d0-485f-90c8-ff4e442cf0d3-kube-api-access-l97bc" (OuterVolumeSpecName: "kube-api-access-l97bc") pod "8a846243-18d0-485f-90c8-ff4e442cf0d3" (UID: "8a846243-18d0-485f-90c8-ff4e442cf0d3"). InnerVolumeSpecName "kube-api-access-l97bc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:04:13.953735 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:13.953697 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l97bc\" (UniqueName: \"kubernetes.io/projected/8a846243-18d0-485f-90c8-ff4e442cf0d3-kube-api-access-l97bc\") on node \"ip-10-0-131-28.ec2.internal\" DevicePath \"\"" Sep 10 16:04:14.121613 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.121582 2574 generic.go:356] "Generic (PLEG): container finished" podID="8a846243-18d0-485f-90c8-ff4e442cf0d3" containerID="aea63ac5c78fe009c214b446ed115793a685e0963372072ec61053f40bb11692" exitCode=0 Sep 10 16:04:14.122063 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.121624 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-ggbvl" Sep 10 16:04:14.122063 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.121670 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-ggbvl" event={"ID":"8a846243-18d0-485f-90c8-ff4e442cf0d3","Type":"ContainerDied","Data":"aea63ac5c78fe009c214b446ed115793a685e0963372072ec61053f40bb11692"} Sep 10 16:04:14.122063 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.121711 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-ggbvl" event={"ID":"8a846243-18d0-485f-90c8-ff4e442cf0d3","Type":"ContainerDied","Data":"441725bb5997ad6b15c1d2c08a8dbc775c70fe5d4f8933d25298272a505fb848"} Sep 10 16:04:14.122063 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.121728 2574 scope.go:117] "RemoveContainer" containerID="aea63ac5c78fe009c214b446ed115793a685e0963372072ec61053f40bb11692" Sep 10 16:04:14.123104 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.123046 2574 generic.go:356] "Generic (PLEG): container finished" podID="3420ec9b-050c-4572-ba9b-95798c976ab6" containerID="7b93c3fd8bac345252ed7011ddb327956c29b281c3a50bdfcba09dd39b5fb241" exitCode=0 Sep 10 16:04:14.123104 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.123079 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-dhbw8" Sep 10 16:04:14.123104 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.123097 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-dhbw8" event={"ID":"3420ec9b-050c-4572-ba9b-95798c976ab6","Type":"ContainerDied","Data":"7b93c3fd8bac345252ed7011ddb327956c29b281c3a50bdfcba09dd39b5fb241"} Sep 10 16:04:14.123270 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.123126 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-dhbw8" event={"ID":"3420ec9b-050c-4572-ba9b-95798c976ab6","Type":"ContainerDied","Data":"a2d45bbed65330d50168d6e1b8698a0ac49b4781d3499362e3fa40dec93ffd3c"} Sep 10 16:04:14.132691 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.132668 2574 scope.go:117] "RemoveContainer" containerID="aea63ac5c78fe009c214b446ed115793a685e0963372072ec61053f40bb11692" Sep 10 16:04:14.133301 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:04:14.133279 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aea63ac5c78fe009c214b446ed115793a685e0963372072ec61053f40bb11692\": container with ID starting with aea63ac5c78fe009c214b446ed115793a685e0963372072ec61053f40bb11692 not found: ID does not exist" containerID="aea63ac5c78fe009c214b446ed115793a685e0963372072ec61053f40bb11692" Sep 10 16:04:14.133423 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.133312 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aea63ac5c78fe009c214b446ed115793a685e0963372072ec61053f40bb11692"} err="failed to get container status \"aea63ac5c78fe009c214b446ed115793a685e0963372072ec61053f40bb11692\": rpc error: code = NotFound desc = could not find container \"aea63ac5c78fe009c214b446ed115793a685e0963372072ec61053f40bb11692\": container with ID starting with aea63ac5c78fe009c214b446ed115793a685e0963372072ec61053f40bb11692 not found: ID does not exist" Sep 10 16:04:14.133423 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.133336 2574 scope.go:117] "RemoveContainer" containerID="7b93c3fd8bac345252ed7011ddb327956c29b281c3a50bdfcba09dd39b5fb241" Sep 10 16:04:14.141302 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.141280 2574 scope.go:117] "RemoveContainer" containerID="7b93c3fd8bac345252ed7011ddb327956c29b281c3a50bdfcba09dd39b5fb241" Sep 10 16:04:14.141590 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:04:14.141563 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b93c3fd8bac345252ed7011ddb327956c29b281c3a50bdfcba09dd39b5fb241\": container with ID starting with 7b93c3fd8bac345252ed7011ddb327956c29b281c3a50bdfcba09dd39b5fb241 not found: ID does not exist" containerID="7b93c3fd8bac345252ed7011ddb327956c29b281c3a50bdfcba09dd39b5fb241" Sep 10 16:04:14.141676 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.141593 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b93c3fd8bac345252ed7011ddb327956c29b281c3a50bdfcba09dd39b5fb241"} err="failed to get container status \"7b93c3fd8bac345252ed7011ddb327956c29b281c3a50bdfcba09dd39b5fb241\": rpc error: code = NotFound desc = could not find container \"7b93c3fd8bac345252ed7011ddb327956c29b281c3a50bdfcba09dd39b5fb241\": container with ID starting with 7b93c3fd8bac345252ed7011ddb327956c29b281c3a50bdfcba09dd39b5fb241 not found: ID does not exist" Sep 10 16:04:14.159040 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.159016 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-ggbvl"] Sep 10 16:04:14.165609 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.165587 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-ggbvl"] Sep 10 16:04:14.189931 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.189901 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-dhbw8"] Sep 10 16:04:14.191961 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.191935 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-dhbw8"] Sep 10 16:04:14.956840 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.956811 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3420ec9b-050c-4572-ba9b-95798c976ab6" path="/var/lib/kubelet/pods/3420ec9b-050c-4572-ba9b-95798c976ab6/volumes" Sep 10 16:04:14.957146 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:04:14.957133 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a846243-18d0-485f-90c8-ff4e442cf0d3" path="/var/lib/kubelet/pods/8a846243-18d0-485f-90c8-ff4e442cf0d3/volumes" Sep 10 16:05:50.876850 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:50.876823 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2r27m_9feb0e61-fa46-4164-9ab2-cbfdd536205b/ovn-acl-logging/0.log" Sep 10 16:05:50.877826 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:50.877803 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2r27m_9feb0e61-fa46-4164-9ab2-cbfdd536205b/ovn-acl-logging/0.log" Sep 10 16:05:56.783981 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.783942 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw"] Sep 10 16:05:56.786252 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.784369 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a846243-18d0-485f-90c8-ff4e442cf0d3" containerName="authorino" Sep 10 16:05:56.786252 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.784383 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a846243-18d0-485f-90c8-ff4e442cf0d3" containerName="authorino" Sep 10 16:05:56.786252 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.784390 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3420ec9b-050c-4572-ba9b-95798c976ab6" containerName="authorino" Sep 10 16:05:56.786252 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.784396 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3420ec9b-050c-4572-ba9b-95798c976ab6" containerName="authorino" Sep 10 16:05:56.786252 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.784461 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3420ec9b-050c-4572-ba9b-95798c976ab6" containerName="authorino" Sep 10 16:05:56.786252 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.784472 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a846243-18d0-485f-90c8-ff4e442cf0d3" containerName="authorino" Sep 10 16:05:56.787336 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.787319 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.791535 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.791514 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2h8fg\"" Sep 10 16:05:56.791671 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.791556 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 16:05:56.791671 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.791518 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 10 16:05:56.791671 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.791621 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 16:05:56.798584 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.798561 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw"] Sep 10 16:05:56.832874 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.832841 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2280d16-1f62-4fd2-8871-ffa8336618d4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.833055 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.832888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2280d16-1f62-4fd2-8871-ffa8336618d4-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.833055 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.832909 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2280d16-1f62-4fd2-8871-ffa8336618d4-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.833055 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.833011 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c784c\" (UniqueName: \"kubernetes.io/projected/a2280d16-1f62-4fd2-8871-ffa8336618d4-kube-api-access-c784c\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.833233 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.833061 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2280d16-1f62-4fd2-8871-ffa8336618d4-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.833233 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.833095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2280d16-1f62-4fd2-8871-ffa8336618d4-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.934128 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.934093 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2280d16-1f62-4fd2-8871-ffa8336618d4-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.934334 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.934137 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2280d16-1f62-4fd2-8871-ffa8336618d4-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.934334 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.934177 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c784c\" (UniqueName: \"kubernetes.io/projected/a2280d16-1f62-4fd2-8871-ffa8336618d4-kube-api-access-c784c\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.934334 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.934236 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2280d16-1f62-4fd2-8871-ffa8336618d4-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.934500 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.934351 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2280d16-1f62-4fd2-8871-ffa8336618d4-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.934500 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.934412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2280d16-1f62-4fd2-8871-ffa8336618d4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.934616 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.934564 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2280d16-1f62-4fd2-8871-ffa8336618d4-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.934672 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.934652 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2280d16-1f62-4fd2-8871-ffa8336618d4-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.934753 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.934733 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2280d16-1f62-4fd2-8871-ffa8336618d4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.936509 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.936493 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2280d16-1f62-4fd2-8871-ffa8336618d4-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.936769 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.936753 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2280d16-1f62-4fd2-8871-ffa8336618d4-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:56.944046 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:56.944017 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c784c\" (UniqueName: \"kubernetes.io/projected/a2280d16-1f62-4fd2-8871-ffa8336618d4-kube-api-access-c784c\") pod \"e2e-distinct-simulated-kserve-6685d86975-7lxqw\" (UID: \"a2280d16-1f62-4fd2-8871-ffa8336618d4\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:57.097267 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:57.097234 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:05:57.366131 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:57.366102 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw"] Sep 10 16:05:57.368237 ip-10-0-131-28 kubenswrapper[2574]: W0910 16:05:57.368190 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2280d16_1f62_4fd2_8871_ffa8336618d4.slice/crio-21b5ab8f26f7f8cc9c32348dcf1bf248a4bc4e8ffd17ad89757d8910cc010769 WatchSource:0}: Error finding container 21b5ab8f26f7f8cc9c32348dcf1bf248a4bc4e8ffd17ad89757d8910cc010769: Status 404 returned error can't find the container with id 21b5ab8f26f7f8cc9c32348dcf1bf248a4bc4e8ffd17ad89757d8910cc010769 Sep 10 16:05:57.579277 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:57.579173 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" event={"ID":"a2280d16-1f62-4fd2-8871-ffa8336618d4","Type":"ContainerStarted","Data":"21b5ab8f26f7f8cc9c32348dcf1bf248a4bc4e8ffd17ad89757d8910cc010769"} Sep 10 16:05:58.586485 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:58.586452 2574 generic.go:356] "Generic (PLEG): container finished" podID="a2280d16-1f62-4fd2-8871-ffa8336618d4" containerID="80aac8a57a627c5245ef5d2e24638ddd6f1f28c92fb1ebd8f2b1e4723b519711" exitCode=0 Sep 10 16:05:58.586891 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:58.586539 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" event={"ID":"a2280d16-1f62-4fd2-8871-ffa8336618d4","Type":"ContainerDied","Data":"80aac8a57a627c5245ef5d2e24638ddd6f1f28c92fb1ebd8f2b1e4723b519711"} Sep 10 16:05:58.586891 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:58.586741 2574 scope.go:117] "RemoveContainer" containerID="80aac8a57a627c5245ef5d2e24638ddd6f1f28c92fb1ebd8f2b1e4723b519711" Sep 10 16:05:59.592465 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:59.592426 2574 generic.go:356] "Generic (PLEG): container finished" podID="a2280d16-1f62-4fd2-8871-ffa8336618d4" containerID="2f597d05814aef41433c1814030ee43d79d13a98a148a86b7f0c2ed8a0dd59f0" exitCode=0 Sep 10 16:05:59.592896 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:59.592511 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" event={"ID":"a2280d16-1f62-4fd2-8871-ffa8336618d4","Type":"ContainerDied","Data":"2f597d05814aef41433c1814030ee43d79d13a98a148a86b7f0c2ed8a0dd59f0"} Sep 10 16:05:59.592896 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:59.592558 2574 scope.go:117] "RemoveContainer" containerID="80aac8a57a627c5245ef5d2e24638ddd6f1f28c92fb1ebd8f2b1e4723b519711" Sep 10 16:05:59.593031 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:05:59.592892 2574 scope.go:117] "RemoveContainer" containerID="2f597d05814aef41433c1814030ee43d79d13a98a148a86b7f0c2ed8a0dd59f0" Sep 10 16:05:59.593137 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:05:59.593117 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:06:00.598717 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:00.598689 2574 scope.go:117] "RemoveContainer" containerID="2f597d05814aef41433c1814030ee43d79d13a98a148a86b7f0c2ed8a0dd59f0" Sep 10 16:06:00.599089 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:06:00.598864 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:06:07.097706 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:07.097665 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:06:07.098086 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:07.097725 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:06:07.098086 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:07.097741 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:06:07.098086 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:07.097757 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:06:07.098183 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:07.098119 2574 scope.go:117] "RemoveContainer" containerID="2f597d05814aef41433c1814030ee43d79d13a98a148a86b7f0c2ed8a0dd59f0" Sep 10 16:06:07.098326 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:06:07.098306 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:06:18.951578 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:18.951495 2574 scope.go:117] "RemoveContainer" containerID="2f597d05814aef41433c1814030ee43d79d13a98a148a86b7f0c2ed8a0dd59f0" Sep 10 16:06:18.951943 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:18.951756 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 16:06:19.685586 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:19.685553 2574 generic.go:356] "Generic (PLEG): container finished" podID="a2280d16-1f62-4fd2-8871-ffa8336618d4" containerID="23293171733e9e927b341f5d7cc5ac57ac55153a31ce2ac1600a7dc097e2a22c" exitCode=0 Sep 10 16:06:19.685772 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:19.685622 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" event={"ID":"a2280d16-1f62-4fd2-8871-ffa8336618d4","Type":"ContainerDied","Data":"23293171733e9e927b341f5d7cc5ac57ac55153a31ce2ac1600a7dc097e2a22c"} Sep 10 16:06:19.685772 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:19.685681 2574 scope.go:117] "RemoveContainer" containerID="2f597d05814aef41433c1814030ee43d79d13a98a148a86b7f0c2ed8a0dd59f0" Sep 10 16:06:19.686067 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:19.686045 2574 scope.go:117] "RemoveContainer" containerID="23293171733e9e927b341f5d7cc5ac57ac55153a31ce2ac1600a7dc097e2a22c" Sep 10 16:06:19.686303 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:06:19.686280 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:06:27.097667 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:27.097630 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:06:27.098073 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:27.097688 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:06:27.098073 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:27.097705 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:06:27.098073 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:27.097718 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:06:27.098073 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:27.098042 2574 scope.go:117] "RemoveContainer" containerID="23293171733e9e927b341f5d7cc5ac57ac55153a31ce2ac1600a7dc097e2a22c" Sep 10 16:06:27.098232 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:06:27.098214 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:06:41.951078 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:41.951046 2574 scope.go:117] "RemoveContainer" containerID="23293171733e9e927b341f5d7cc5ac57ac55153a31ce2ac1600a7dc097e2a22c" Sep 10 16:06:42.794877 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:42.794846 2574 generic.go:356] "Generic (PLEG): container finished" podID="a2280d16-1f62-4fd2-8871-ffa8336618d4" containerID="3bec6131abcfc5fea0865aec1cff307299324a5baf8ba34a1fb2e7eda3657b60" exitCode=0 Sep 10 16:06:42.795043 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:42.794918 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" event={"ID":"a2280d16-1f62-4fd2-8871-ffa8336618d4","Type":"ContainerDied","Data":"3bec6131abcfc5fea0865aec1cff307299324a5baf8ba34a1fb2e7eda3657b60"} Sep 10 16:06:42.795043 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:42.794978 2574 scope.go:117] "RemoveContainer" containerID="23293171733e9e927b341f5d7cc5ac57ac55153a31ce2ac1600a7dc097e2a22c" Sep 10 16:06:42.795348 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:42.795326 2574 scope.go:117] "RemoveContainer" containerID="3bec6131abcfc5fea0865aec1cff307299324a5baf8ba34a1fb2e7eda3657b60" Sep 10 16:06:42.795522 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:06:42.795496 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:06:47.098122 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:47.098087 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:06:47.098506 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:47.098170 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:06:47.098506 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:47.098213 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:06:47.098506 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:47.098234 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:06:47.098631 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:47.098579 2574 scope.go:117] "RemoveContainer" containerID="3bec6131abcfc5fea0865aec1cff307299324a5baf8ba34a1fb2e7eda3657b60" Sep 10 16:06:47.098781 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:06:47.098761 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:06:47.819418 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:47.819391 2574 scope.go:117] "RemoveContainer" containerID="3bec6131abcfc5fea0865aec1cff307299324a5baf8ba34a1fb2e7eda3657b60" Sep 10 16:06:47.819574 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:06:47.819555 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:06:51.983565 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:51.983527 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx"] Sep 10 16:06:51.986795 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:51.986777 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:51.989393 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:51.989372 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 10 16:06:51.996513 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:51.996493 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx"] Sep 10 16:06:52.120398 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.120347 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28b2e6aa-ff3b-4c7b-9833-015403fd698b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.120398 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.120406 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28b2e6aa-ff3b-4c7b-9833-015403fd698b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.120600 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.120459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28b2e6aa-ff3b-4c7b-9833-015403fd698b-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.120600 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.120491 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlfh4\" (UniqueName: \"kubernetes.io/projected/28b2e6aa-ff3b-4c7b-9833-015403fd698b-kube-api-access-rlfh4\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.120600 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.120512 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28b2e6aa-ff3b-4c7b-9833-015403fd698b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.120600 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.120530 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28b2e6aa-ff3b-4c7b-9833-015403fd698b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.221901 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.221868 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28b2e6aa-ff3b-4c7b-9833-015403fd698b-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.222053 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.221917 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlfh4\" (UniqueName: \"kubernetes.io/projected/28b2e6aa-ff3b-4c7b-9833-015403fd698b-kube-api-access-rlfh4\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.222053 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.221974 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28b2e6aa-ff3b-4c7b-9833-015403fd698b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.222053 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.222010 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28b2e6aa-ff3b-4c7b-9833-015403fd698b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.222169 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.222073 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28b2e6aa-ff3b-4c7b-9833-015403fd698b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.222272 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.222249 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28b2e6aa-ff3b-4c7b-9833-015403fd698b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.222510 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.222488 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28b2e6aa-ff3b-4c7b-9833-015403fd698b-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.222610 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.222548 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28b2e6aa-ff3b-4c7b-9833-015403fd698b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.222671 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.222654 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28b2e6aa-ff3b-4c7b-9833-015403fd698b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.224314 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.224287 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28b2e6aa-ff3b-4c7b-9833-015403fd698b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.224695 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.224675 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28b2e6aa-ff3b-4c7b-9833-015403fd698b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.232033 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.232011 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlfh4\" (UniqueName: \"kubernetes.io/projected/28b2e6aa-ff3b-4c7b-9833-015403fd698b-kube-api-access-rlfh4\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx\" (UID: \"28b2e6aa-ff3b-4c7b-9833-015403fd698b\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.296385 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.296302 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:06:52.567380 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.567358 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx"] Sep 10 16:06:52.569521 ip-10-0-131-28 kubenswrapper[2574]: W0910 16:06:52.569497 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28b2e6aa_ff3b_4c7b_9833_015403fd698b.slice/crio-f0d1ddcb4542fd1c785450141cd51c302c09d7348bcef82688173b770ebc12b2 WatchSource:0}: Error finding container f0d1ddcb4542fd1c785450141cd51c302c09d7348bcef82688173b770ebc12b2: Status 404 returned error can't find the container with id f0d1ddcb4542fd1c785450141cd51c302c09d7348bcef82688173b770ebc12b2 Sep 10 16:06:52.843631 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.843603 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" event={"ID":"28b2e6aa-ff3b-4c7b-9833-015403fd698b","Type":"ContainerStarted","Data":"d1f83bacf651f0de765826f098b265f36ed603c609fe899b5b6b7158427723e8"} Sep 10 16:06:52.843722 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.843641 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" event={"ID":"28b2e6aa-ff3b-4c7b-9833-015403fd698b","Type":"ContainerStarted","Data":"f0d1ddcb4542fd1c785450141cd51c302c09d7348bcef82688173b770ebc12b2"} Sep 10 16:06:52.863464 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:52.863425 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podStartSLOduration=1.653631225 podStartE2EDuration="1.863408857s" totalImagesPullingTime="209.777632ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:06:52.860661939 +0000 UTC m=+662.414657837" watchObservedRunningTime="2026-09-10 16:06:52.863408857 +0000 UTC m=+662.417404752" Sep 10 16:06:53.849400 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:53.849363 2574 generic.go:356] "Generic (PLEG): container finished" podID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" containerID="d1f83bacf651f0de765826f098b265f36ed603c609fe899b5b6b7158427723e8" exitCode=0 Sep 10 16:06:53.849771 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:53.849452 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" event={"ID":"28b2e6aa-ff3b-4c7b-9833-015403fd698b","Type":"ContainerDied","Data":"d1f83bacf651f0de765826f098b265f36ed603c609fe899b5b6b7158427723e8"} Sep 10 16:06:53.849771 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:53.849648 2574 scope.go:117] "RemoveContainer" containerID="d1f83bacf651f0de765826f098b265f36ed603c609fe899b5b6b7158427723e8" Sep 10 16:06:54.855621 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:54.855592 2574 generic.go:356] "Generic (PLEG): container finished" podID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" containerID="3dfeb1ff935e205b6c9672df9af35b07e71dd18f1e60ff5357af6477ac34e594" exitCode=0 Sep 10 16:06:54.856002 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:54.855677 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" event={"ID":"28b2e6aa-ff3b-4c7b-9833-015403fd698b","Type":"ContainerDied","Data":"3dfeb1ff935e205b6c9672df9af35b07e71dd18f1e60ff5357af6477ac34e594"} Sep 10 16:06:54.856002 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:54.855725 2574 scope.go:117] "RemoveContainer" containerID="d1f83bacf651f0de765826f098b265f36ed603c609fe899b5b6b7158427723e8" Sep 10 16:06:54.856002 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:54.855923 2574 scope.go:117] "RemoveContainer" containerID="3dfeb1ff935e205b6c9672df9af35b07e71dd18f1e60ff5357af6477ac34e594" Sep 10 16:06:54.856148 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:06:54.856126 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:06:55.861883 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:06:55.861856 2574 scope.go:117] "RemoveContainer" containerID="3dfeb1ff935e205b6c9672df9af35b07e71dd18f1e60ff5357af6477ac34e594" Sep 10 16:06:55.862261 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:06:55.862042 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:07:00.954729 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:00.954697 2574 scope.go:117] "RemoveContainer" containerID="3bec6131abcfc5fea0865aec1cff307299324a5baf8ba34a1fb2e7eda3657b60" Sep 10 16:07:00.955168 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:07:00.954869 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:07:02.296606 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:02.296556 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:07:02.296997 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:02.296638 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:07:02.296997 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:02.296675 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:07:02.296997 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:02.296686 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:07:02.296997 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:02.296959 2574 scope.go:117] "RemoveContainer" containerID="3dfeb1ff935e205b6c9672df9af35b07e71dd18f1e60ff5357af6477ac34e594" Sep 10 16:07:02.297158 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:07:02.297137 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:07:02.894526 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:02.894491 2574 scope.go:117] "RemoveContainer" containerID="3dfeb1ff935e205b6c9672df9af35b07e71dd18f1e60ff5357af6477ac34e594" Sep 10 16:07:02.894697 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:07:02.894681 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:07:13.950961 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:13.950932 2574 scope.go:117] "RemoveContainer" containerID="3dfeb1ff935e205b6c9672df9af35b07e71dd18f1e60ff5357af6477ac34e594" Sep 10 16:07:14.949176 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:14.949144 2574 generic.go:356] "Generic (PLEG): container finished" podID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" containerID="1c4e0c9c0e7b35512dd03f00870de07a0fb1dafa0cb65e63fc403b7fefa5a4fa" exitCode=0 Sep 10 16:07:14.949344 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:14.949220 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" event={"ID":"28b2e6aa-ff3b-4c7b-9833-015403fd698b","Type":"ContainerDied","Data":"1c4e0c9c0e7b35512dd03f00870de07a0fb1dafa0cb65e63fc403b7fefa5a4fa"} Sep 10 16:07:14.949344 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:14.949280 2574 scope.go:117] "RemoveContainer" containerID="3dfeb1ff935e205b6c9672df9af35b07e71dd18f1e60ff5357af6477ac34e594" Sep 10 16:07:14.949636 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:14.949621 2574 scope.go:117] "RemoveContainer" containerID="1c4e0c9c0e7b35512dd03f00870de07a0fb1dafa0cb65e63fc403b7fefa5a4fa" Sep 10 16:07:14.949806 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:07:14.949789 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:07:15.951242 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:15.951212 2574 scope.go:117] "RemoveContainer" containerID="3bec6131abcfc5fea0865aec1cff307299324a5baf8ba34a1fb2e7eda3657b60" Sep 10 16:07:15.951613 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:07:15.951437 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:07:22.296438 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:22.296389 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:07:22.296867 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:22.296465 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:07:22.296867 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:22.296503 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:07:22.296867 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:22.296513 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:07:22.296867 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:22.296756 2574 scope.go:117] "RemoveContainer" containerID="1c4e0c9c0e7b35512dd03f00870de07a0fb1dafa0cb65e63fc403b7fefa5a4fa" Sep 10 16:07:22.297018 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:07:22.296911 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:07:22.984784 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:22.984714 2574 scope.go:117] "RemoveContainer" containerID="1c4e0c9c0e7b35512dd03f00870de07a0fb1dafa0cb65e63fc403b7fefa5a4fa" Sep 10 16:07:22.984985 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:07:22.984957 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:07:30.953286 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:30.953254 2574 scope.go:117] "RemoveContainer" containerID="3bec6131abcfc5fea0865aec1cff307299324a5baf8ba34a1fb2e7eda3657b60" Sep 10 16:07:32.024552 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:32.024519 2574 generic.go:356] "Generic (PLEG): container finished" podID="a2280d16-1f62-4fd2-8871-ffa8336618d4" containerID="3505732d5bd76a9cf517f5885bba9debf7cd9b175359e22dc2e82db46fb8fef0" exitCode=0 Sep 10 16:07:32.025042 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:32.024594 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" event={"ID":"a2280d16-1f62-4fd2-8871-ffa8336618d4","Type":"ContainerDied","Data":"3505732d5bd76a9cf517f5885bba9debf7cd9b175359e22dc2e82db46fb8fef0"} Sep 10 16:07:32.025042 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:32.024651 2574 scope.go:117] "RemoveContainer" containerID="3bec6131abcfc5fea0865aec1cff307299324a5baf8ba34a1fb2e7eda3657b60" Sep 10 16:07:32.025042 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:32.024988 2574 scope.go:117] "RemoveContainer" containerID="3505732d5bd76a9cf517f5885bba9debf7cd9b175359e22dc2e82db46fb8fef0" Sep 10 16:07:32.025279 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:07:32.025255 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:07:36.951355 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:36.951319 2574 scope.go:117] "RemoveContainer" containerID="1c4e0c9c0e7b35512dd03f00870de07a0fb1dafa0cb65e63fc403b7fefa5a4fa" Sep 10 16:07:37.097877 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:37.097846 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:07:37.098019 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:37.097903 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:07:37.098019 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:37.097919 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:07:37.098019 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:37.097932 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:07:37.098304 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:37.098291 2574 scope.go:117] "RemoveContainer" containerID="3505732d5bd76a9cf517f5885bba9debf7cd9b175359e22dc2e82db46fb8fef0" Sep 10 16:07:37.098477 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:07:37.098462 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:07:38.054050 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:38.054021 2574 generic.go:356] "Generic (PLEG): container finished" podID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" containerID="ed1b55528e1e2223d78b2077901924ca816aacb10a2605ec69a72df58f0eee32" exitCode=0 Sep 10 16:07:38.054511 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:38.054065 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" event={"ID":"28b2e6aa-ff3b-4c7b-9833-015403fd698b","Type":"ContainerDied","Data":"ed1b55528e1e2223d78b2077901924ca816aacb10a2605ec69a72df58f0eee32"} Sep 10 16:07:38.054511 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:38.054106 2574 scope.go:117] "RemoveContainer" containerID="1c4e0c9c0e7b35512dd03f00870de07a0fb1dafa0cb65e63fc403b7fefa5a4fa" Sep 10 16:07:38.054511 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:38.054451 2574 scope.go:117] "RemoveContainer" containerID="ed1b55528e1e2223d78b2077901924ca816aacb10a2605ec69a72df58f0eee32" Sep 10 16:07:38.054671 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:07:38.054628 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:07:42.297277 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:42.297241 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:07:42.297654 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:42.297291 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:07:42.297654 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:42.297303 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:07:42.297654 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:42.297312 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:07:42.297654 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:42.297634 2574 scope.go:117] "RemoveContainer" containerID="ed1b55528e1e2223d78b2077901924ca816aacb10a2605ec69a72df58f0eee32" Sep 10 16:07:42.297805 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:07:42.297786 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:07:47.951386 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:47.951300 2574 scope.go:117] "RemoveContainer" containerID="3505732d5bd76a9cf517f5885bba9debf7cd9b175359e22dc2e82db46fb8fef0" Sep 10 16:07:47.951842 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:07:47.951545 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:07:56.951412 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:07:56.951376 2574 scope.go:117] "RemoveContainer" containerID="ed1b55528e1e2223d78b2077901924ca816aacb10a2605ec69a72df58f0eee32" Sep 10 16:07:56.951855 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:07:56.951589 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:08:00.953226 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:00.953183 2574 scope.go:117] "RemoveContainer" containerID="3505732d5bd76a9cf517f5885bba9debf7cd9b175359e22dc2e82db46fb8fef0" Sep 10 16:08:00.953610 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:08:00.953384 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:08:10.953599 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:10.953565 2574 scope.go:117] "RemoveContainer" containerID="ed1b55528e1e2223d78b2077901924ca816aacb10a2605ec69a72df58f0eee32" Sep 10 16:08:10.954040 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:08:10.953807 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:08:11.951341 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:11.951310 2574 scope.go:117] "RemoveContainer" containerID="3505732d5bd76a9cf517f5885bba9debf7cd9b175359e22dc2e82db46fb8fef0" Sep 10 16:08:11.951514 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:08:11.951482 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:08:24.951670 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:24.951635 2574 scope.go:117] "RemoveContainer" containerID="3505732d5bd76a9cf517f5885bba9debf7cd9b175359e22dc2e82db46fb8fef0" Sep 10 16:08:24.952159 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:08:24.951789 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:08:25.950977 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:25.950940 2574 scope.go:117] "RemoveContainer" containerID="ed1b55528e1e2223d78b2077901924ca816aacb10a2605ec69a72df58f0eee32" Sep 10 16:08:26.274104 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:26.274076 2574 generic.go:356] "Generic (PLEG): container finished" podID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" containerID="587170757df27cf4b20ff664383026f082ac1615c98df17e0308169f73921eef" exitCode=0 Sep 10 16:08:26.274494 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:26.274149 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" event={"ID":"28b2e6aa-ff3b-4c7b-9833-015403fd698b","Type":"ContainerDied","Data":"587170757df27cf4b20ff664383026f082ac1615c98df17e0308169f73921eef"} Sep 10 16:08:26.274494 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:26.274212 2574 scope.go:117] "RemoveContainer" containerID="ed1b55528e1e2223d78b2077901924ca816aacb10a2605ec69a72df58f0eee32" Sep 10 16:08:26.274593 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:26.274535 2574 scope.go:117] "RemoveContainer" containerID="587170757df27cf4b20ff664383026f082ac1615c98df17e0308169f73921eef" Sep 10 16:08:26.274723 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:08:26.274703 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:08:32.296963 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:32.296925 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:08:32.297469 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:32.296980 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:08:32.297469 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:32.296996 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:08:32.297469 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:32.297009 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:08:32.297469 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:32.297427 2574 scope.go:117] "RemoveContainer" containerID="587170757df27cf4b20ff664383026f082ac1615c98df17e0308169f73921eef" Sep 10 16:08:32.297665 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:08:32.297626 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:08:39.951652 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:39.951620 2574 scope.go:117] "RemoveContainer" containerID="3505732d5bd76a9cf517f5885bba9debf7cd9b175359e22dc2e82db46fb8fef0" Sep 10 16:08:39.952017 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:08:39.951794 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:08:43.951382 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:43.951348 2574 scope.go:117] "RemoveContainer" containerID="587170757df27cf4b20ff664383026f082ac1615c98df17e0308169f73921eef" Sep 10 16:08:43.951931 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:08:43.951586 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:08:51.951716 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:51.951685 2574 scope.go:117] "RemoveContainer" containerID="3505732d5bd76a9cf517f5885bba9debf7cd9b175359e22dc2e82db46fb8fef0" Sep 10 16:08:52.393295 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:52.393260 2574 generic.go:356] "Generic (PLEG): container finished" podID="a2280d16-1f62-4fd2-8871-ffa8336618d4" containerID="42dfcfe08bf4f9a26f0d4d05ab90ef3234a573ba49e3d2af79156761ec9f3b43" exitCode=0 Sep 10 16:08:52.393477 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:52.393299 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" event={"ID":"a2280d16-1f62-4fd2-8871-ffa8336618d4","Type":"ContainerDied","Data":"42dfcfe08bf4f9a26f0d4d05ab90ef3234a573ba49e3d2af79156761ec9f3b43"} Sep 10 16:08:52.393477 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:52.393359 2574 scope.go:117] "RemoveContainer" containerID="3505732d5bd76a9cf517f5885bba9debf7cd9b175359e22dc2e82db46fb8fef0" Sep 10 16:08:52.393776 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:52.393756 2574 scope.go:117] "RemoveContainer" containerID="42dfcfe08bf4f9a26f0d4d05ab90ef3234a573ba49e3d2af79156761ec9f3b43" Sep 10 16:08:52.393957 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:08:52.393938 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:08:57.097888 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:57.097843 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:08:57.098346 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:57.097919 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:08:57.098346 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:57.097941 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:08:57.098346 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:57.097960 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" Sep 10 16:08:57.098459 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:57.098408 2574 scope.go:117] "RemoveContainer" containerID="42dfcfe08bf4f9a26f0d4d05ab90ef3234a573ba49e3d2af79156761ec9f3b43" Sep 10 16:08:57.098625 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:08:57.098604 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:08:57.951320 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:08:57.951287 2574 scope.go:117] "RemoveContainer" containerID="587170757df27cf4b20ff664383026f082ac1615c98df17e0308169f73921eef" Sep 10 16:08:57.951485 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:08:57.951437 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:09:10.953084 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:09:10.953043 2574 scope.go:117] "RemoveContainer" containerID="42dfcfe08bf4f9a26f0d4d05ab90ef3234a573ba49e3d2af79156761ec9f3b43" Sep 10 16:09:10.953496 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:09:10.953314 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:09:11.951211 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:09:11.951163 2574 scope.go:117] "RemoveContainer" containerID="587170757df27cf4b20ff664383026f082ac1615c98df17e0308169f73921eef" Sep 10 16:09:11.951382 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:09:11.951359 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:09:23.951392 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:09:23.951360 2574 scope.go:117] "RemoveContainer" containerID="42dfcfe08bf4f9a26f0d4d05ab90ef3234a573ba49e3d2af79156761ec9f3b43" Sep 10 16:09:23.951794 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:09:23.951546 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:09:25.950779 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:09:25.950747 2574 scope.go:117] "RemoveContainer" containerID="587170757df27cf4b20ff664383026f082ac1615c98df17e0308169f73921eef" Sep 10 16:09:25.951227 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:09:25.950909 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:09:34.951058 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:09:34.951028 2574 scope.go:117] "RemoveContainer" containerID="42dfcfe08bf4f9a26f0d4d05ab90ef3234a573ba49e3d2af79156761ec9f3b43" Sep 10 16:09:34.951489 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:09:34.951227 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:09:37.951565 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:09:37.951531 2574 scope.go:117] "RemoveContainer" containerID="587170757df27cf4b20ff664383026f082ac1615c98df17e0308169f73921eef" Sep 10 16:09:37.951950 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:09:37.951696 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:09:48.951686 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:09:48.951654 2574 scope.go:117] "RemoveContainer" containerID="42dfcfe08bf4f9a26f0d4d05ab90ef3234a573ba49e3d2af79156761ec9f3b43" Sep 10 16:09:48.952129 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:09:48.951831 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:09:52.950901 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:09:52.950868 2574 scope.go:117] "RemoveContainer" containerID="587170757df27cf4b20ff664383026f082ac1615c98df17e0308169f73921eef" Sep 10 16:09:53.671068 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:09:53.671028 2574 generic.go:356] "Generic (PLEG): container finished" podID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" containerID="27d59fbacac3995f131485278dea91b403ae3b3e4763836f44dab967a8d44f72" exitCode=0 Sep 10 16:09:53.671294 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:09:53.671107 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" event={"ID":"28b2e6aa-ff3b-4c7b-9833-015403fd698b","Type":"ContainerDied","Data":"27d59fbacac3995f131485278dea91b403ae3b3e4763836f44dab967a8d44f72"} Sep 10 16:09:53.671294 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:09:53.671168 2574 scope.go:117] "RemoveContainer" containerID="587170757df27cf4b20ff664383026f082ac1615c98df17e0308169f73921eef" Sep 10 16:09:53.671568 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:09:53.671551 2574 scope.go:117] "RemoveContainer" containerID="27d59fbacac3995f131485278dea91b403ae3b3e4763836f44dab967a8d44f72" Sep 10 16:09:53.671754 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:09:53.671731 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:10:00.952952 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:00.952924 2574 scope.go:117] "RemoveContainer" containerID="42dfcfe08bf4f9a26f0d4d05ab90ef3234a573ba49e3d2af79156761ec9f3b43" Sep 10 16:10:00.953342 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:10:00.953094 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:10:02.296748 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:02.296706 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:10:02.296748 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:02.296760 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:10:02.297158 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:02.296772 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:10:02.297158 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:02.296782 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" Sep 10 16:10:02.297158 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:02.297144 2574 scope.go:117] "RemoveContainer" containerID="27d59fbacac3995f131485278dea91b403ae3b3e4763836f44dab967a8d44f72" Sep 10 16:10:02.297351 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:10:02.297332 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:10:12.951455 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:12.951417 2574 scope.go:117] "RemoveContainer" containerID="42dfcfe08bf4f9a26f0d4d05ab90ef3234a573ba49e3d2af79156761ec9f3b43" Sep 10 16:10:12.951843 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:10:12.951631 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:10:15.950990 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:15.950954 2574 scope.go:117] "RemoveContainer" containerID="27d59fbacac3995f131485278dea91b403ae3b3e4763836f44dab967a8d44f72" Sep 10 16:10:15.951372 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:10:15.951124 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:10:19.040482 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:19.040452 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-f69bf_903a9282-5ecc-4afa-8934-65065d8cc77b/manager/0.log" Sep 10 16:10:19.165028 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:19.164998 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-95csb_555484fb-9d21-4693-ba1b-eabe2acdb302/manager/0.log" Sep 10 16:10:19.415834 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:19.415808 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tf86h_428131af-5c52-4344-add7-4fa536de9ceb/server/0.log" Sep 10 16:10:19.966605 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:19.966571 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5995b6f449-s8jhs_da5efc8a-fb82-4828-9f3b-4a727df73896/copy-manifests/0.log" Sep 10 16:10:19.973902 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:19.973871 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5995b6f449-s8jhs_da5efc8a-fb82-4828-9f3b-4a727df73896/manager/0.log" Sep 10 16:10:22.259021 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:22.258967 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd_eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8/istio-proxy/0.log" Sep 10 16:10:22.623204 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:22.623179 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-89dd5bbbb-rkc6f_08e19084-b74f-42e0-a592-3a641e061eaa/kube-auth-proxy/0.log" Sep 10 16:10:23.555095 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:23.555056 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-6685d86975-7lxqw_a2280d16-1f62-4fd2-8871-ffa8336618d4/main/5.log" Sep 10 16:10:24.125795 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:24.125762 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_28b2e6aa-ff3b-4c7b-9833-015403fd698b/main/5.log" Sep 10 16:10:26.951764 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:26.951717 2574 scope.go:117] "RemoveContainer" containerID="42dfcfe08bf4f9a26f0d4d05ab90ef3234a573ba49e3d2af79156761ec9f3b43" Sep 10 16:10:26.952163 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:10:26.951920 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:10:27.951704 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:27.951668 2574 scope.go:117] "RemoveContainer" containerID="27d59fbacac3995f131485278dea91b403ae3b3e4763836f44dab967a8d44f72" Sep 10 16:10:27.951917 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:10:27.951888 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:10:32.567318 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:32.567276 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fhhc7_66e6345d-9054-4ab2-b8e0-daa7d5ee2eb1/global-pull-secret-syncer/0.log" Sep 10 16:10:32.747485 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:32.747450 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rq6n2_b33761b3-5ecd-4b98-b888-08eee34b615b/konnectivity-agent/0.log" Sep 10 16:10:32.862865 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:32.862836 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-28.ec2.internal_4d77bdb88bdde64701cb8de72170bcf6/haproxy/0.log" Sep 10 16:10:38.956390 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:38.956359 2574 scope.go:117] "RemoveContainer" containerID="27d59fbacac3995f131485278dea91b403ae3b3e4763836f44dab967a8d44f72" Sep 10 16:10:38.956875 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:38.956458 2574 scope.go:117] "RemoveContainer" containerID="42dfcfe08bf4f9a26f0d4d05ab90ef3234a573ba49e3d2af79156761ec9f3b43" Sep 10 16:10:38.956875 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:10:38.956515 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:10:38.956875 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:10:38.956662 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:10:40.239290 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:40.239206 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-56dbc7db6-ntz5s_4d381e46-01fb-4af8-9823-1277f1b8b4f2/metrics-server/0.log" Sep 10 16:10:40.280363 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:40.280311 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-lj555_89e54772-0be1-41b4-9e8b-de76ed6f3d15/monitoring-plugin/0.log" Sep 10 16:10:40.440842 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:40.440809 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vr76q_e44edc3b-301e-4678-b853-3f1db51d5b4a/node-exporter/0.log" Sep 10 16:10:40.472899 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:40.472869 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vr76q_e44edc3b-301e-4678-b853-3f1db51d5b4a/kube-rbac-proxy/0.log" Sep 10 16:10:40.505616 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:40.505552 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vr76q_e44edc3b-301e-4678-b853-3f1db51d5b4a/init-textfile/0.log" Sep 10 16:10:41.008120 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:41.008091 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-j855c_e7c71378-f202-454a-8a67-bb49ecf3371e/prometheus-operator/0.log" Sep 10 16:10:41.052851 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:41.052818 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-j855c_e7c71378-f202-454a-8a67-bb49ecf3371e/kube-rbac-proxy/0.log" Sep 10 16:10:41.130796 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:41.130768 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-744cf969cd-q46zs_0ccabcf2-cbb9-4112-9ded-b8f18f507a6c/telemeter-client/0.log" Sep 10 16:10:41.160914 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:41.160881 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-744cf969cd-q46zs_0ccabcf2-cbb9-4112-9ded-b8f18f507a6c/reload/0.log" Sep 10 16:10:41.206167 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:41.206141 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-744cf969cd-q46zs_0ccabcf2-cbb9-4112-9ded-b8f18f507a6c/kube-rbac-proxy/0.log" Sep 10 16:10:41.247897 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:41.247869 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67bfd8b8d7-46lr2_62c03299-34e0-4a90-a13c-d067cdc7c019/thanos-query/0.log" Sep 10 16:10:41.275568 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:41.275501 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67bfd8b8d7-46lr2_62c03299-34e0-4a90-a13c-d067cdc7c019/kube-rbac-proxy-web/0.log" Sep 10 16:10:41.304995 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:41.304967 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67bfd8b8d7-46lr2_62c03299-34e0-4a90-a13c-d067cdc7c019/kube-rbac-proxy/0.log" Sep 10 16:10:41.340507 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:41.340482 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67bfd8b8d7-46lr2_62c03299-34e0-4a90-a13c-d067cdc7c019/prom-label-proxy/0.log" Sep 10 16:10:41.373736 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:41.373709 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67bfd8b8d7-46lr2_62c03299-34e0-4a90-a13c-d067cdc7c019/kube-rbac-proxy-rules/0.log" Sep 10 16:10:41.402753 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:41.402731 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67bfd8b8d7-46lr2_62c03299-34e0-4a90-a13c-d067cdc7c019/kube-rbac-proxy-metrics/0.log" Sep 10 16:10:42.601880 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.601844 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n"] Sep 10 16:10:42.605242 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.605225 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:42.608431 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.608412 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2427l\"/\"default-dockercfg-sq2jl\"" Sep 10 16:10:42.608738 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.608717 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2427l\"/\"kube-root-ca.crt\"" Sep 10 16:10:42.609428 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.609411 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2427l\"/\"openshift-service-ca.crt\"" Sep 10 16:10:42.629398 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.629372 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n"] Sep 10 16:10:42.735396 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.735367 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4wln\" (UniqueName: \"kubernetes.io/projected/a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7-kube-api-access-g4wln\") pod \"perf-node-gather-daemonset-tqk5n\" (UID: \"a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7\") " pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:42.735565 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.735401 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7-podres\") pod \"perf-node-gather-daemonset-tqk5n\" (UID: \"a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7\") " pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:42.735565 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.735488 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7-proc\") pod \"perf-node-gather-daemonset-tqk5n\" (UID: \"a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7\") " pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:42.735565 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.735510 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7-sys\") pod \"perf-node-gather-daemonset-tqk5n\" (UID: \"a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7\") " pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:42.735565 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.735533 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7-lib-modules\") pod \"perf-node-gather-daemonset-tqk5n\" (UID: \"a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7\") " pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:42.837021 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.836981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4wln\" (UniqueName: \"kubernetes.io/projected/a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7-kube-api-access-g4wln\") pod \"perf-node-gather-daemonset-tqk5n\" (UID: \"a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7\") " pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:42.837237 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.837114 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7-podres\") pod \"perf-node-gather-daemonset-tqk5n\" (UID: \"a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7\") " pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:42.837308 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.837286 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7-proc\") pod \"perf-node-gather-daemonset-tqk5n\" (UID: \"a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7\") " pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:42.837359 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.837308 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7-podres\") pod \"perf-node-gather-daemonset-tqk5n\" (UID: \"a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7\") " pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:42.837359 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.837331 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7-sys\") pod \"perf-node-gather-daemonset-tqk5n\" (UID: \"a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7\") " pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:42.837462 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.837362 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7-lib-modules\") pod \"perf-node-gather-daemonset-tqk5n\" (UID: \"a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7\") " pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:42.837462 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.837375 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7-proc\") pod \"perf-node-gather-daemonset-tqk5n\" (UID: \"a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7\") " pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:42.837462 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.837431 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7-sys\") pod \"perf-node-gather-daemonset-tqk5n\" (UID: \"a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7\") " pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:42.837562 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.837464 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7-lib-modules\") pod \"perf-node-gather-daemonset-tqk5n\" (UID: \"a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7\") " pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:42.848095 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.848074 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4wln\" (UniqueName: \"kubernetes.io/projected/a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7-kube-api-access-g4wln\") pod \"perf-node-gather-daemonset-tqk5n\" (UID: \"a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7\") " pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:42.936585 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:42.936463 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:43.232159 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:43.232070 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n"] Sep 10 16:10:43.236869 ip-10-0-131-28 kubenswrapper[2574]: W0910 16:10:43.236845 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda1cc770d_00a8_4dc9_945e_b0d7c55d2bd7.slice/crio-47d2aca8545d7d5bbc7aa5cd93246bd070ec7ff8fa17549be476854713d799b1 WatchSource:0}: Error finding container 47d2aca8545d7d5bbc7aa5cd93246bd070ec7ff8fa17549be476854713d799b1: Status 404 returned error can't find the container with id 47d2aca8545d7d5bbc7aa5cd93246bd070ec7ff8fa17549be476854713d799b1 Sep 10 16:10:43.906263 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:43.906223 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" event={"ID":"a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7","Type":"ContainerStarted","Data":"0e999c9c8480fe425f16f367898c9677422365103344c130281d5aeb55e553b3"} Sep 10 16:10:43.906646 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:43.906283 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" event={"ID":"a1cc770d-00a8-4dc9-945e-b0d7c55d2bd7","Type":"ContainerStarted","Data":"47d2aca8545d7d5bbc7aa5cd93246bd070ec7ff8fa17549be476854713d799b1"} Sep 10 16:10:43.906646 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:43.906307 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:43.927717 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:43.927670 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" podStartSLOduration=1.9276560200000001 podStartE2EDuration="1.92765602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:10:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:10:43.926229818 +0000 UTC m=+893.480225708" watchObservedRunningTime="2026-09-10 16:10:43.92765602 +0000 UTC m=+893.481651925" Sep 10 16:10:44.108839 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:44.108809 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-9wcbs_d6f95f07-6a03-40a9-ae59-938b52381d1d/download-server/0.log" Sep 10 16:10:45.864694 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:45.864663 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bxxvm_c3c0436a-0d7f-4f5e-a82a-c688e37206dc/dns/0.log" Sep 10 16:10:45.888307 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:45.888280 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bxxvm_c3c0436a-0d7f-4f5e-a82a-c688e37206dc/kube-rbac-proxy/0.log" Sep 10 16:10:45.967591 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:45.967566 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-28np2_023336c2-9df2-43ed-a744-b6d63753fc2a/dns-node-resolver/0.log" Sep 10 16:10:46.650588 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:46.650554 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8d56ddb9b-8tk2d_8475d2ca-192b-4325-97ef-36db65d43acd/registry/0.log" Sep 10 16:10:46.700893 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:46.700863 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qdj56_e4beb35b-8f19-446b-8344-511819233a1f/node-ca/0.log" Sep 10 16:10:47.735490 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:47.735458 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd_eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8/istio-proxy/0.log" Sep 10 16:10:47.867459 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:47.867427 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-89dd5bbbb-rkc6f_08e19084-b74f-42e0-a592-3a641e061eaa/kube-auth-proxy/0.log" Sep 10 16:10:48.731987 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:48.731955 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zvh9n_4d6ca140-781c-47f6-8fba-c82e3f0dcb11/serve-healthcheck-canary/0.log" Sep 10 16:10:49.450021 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:49.449992 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qpvf4_5185c4fa-fd82-464f-a9ad-73e3512b7bf6/kube-rbac-proxy/0.log" Sep 10 16:10:49.474298 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:49.474270 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qpvf4_5185c4fa-fd82-464f-a9ad-73e3512b7bf6/exporter/0.log" Sep 10 16:10:49.496949 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:49.496923 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qpvf4_5185c4fa-fd82-464f-a9ad-73e3512b7bf6/extractor/0.log" Sep 10 16:10:49.920253 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:49.920222 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2427l/perf-node-gather-daemonset-tqk5n" Sep 10 16:10:50.908235 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:50.908187 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2r27m_9feb0e61-fa46-4164-9ab2-cbfdd536205b/ovn-acl-logging/0.log" Sep 10 16:10:50.910392 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:50.910368 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2r27m_9feb0e61-fa46-4164-9ab2-cbfdd536205b/ovn-acl-logging/0.log" Sep 10 16:10:51.858047 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:51.857977 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-f69bf_903a9282-5ecc-4afa-8934-65065d8cc77b/manager/0.log" Sep 10 16:10:51.915413 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:51.915366 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-95csb_555484fb-9d21-4693-ba1b-eabe2acdb302/manager/0.log" Sep 10 16:10:51.951470 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:51.951441 2574 scope.go:117] "RemoveContainer" containerID="42dfcfe08bf4f9a26f0d4d05ab90ef3234a573ba49e3d2af79156761ec9f3b43" Sep 10 16:10:51.951627 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:10:51.951608 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-7lxqw_llm(a2280d16-1f62-4fd2-8871-ffa8336618d4)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-7lxqw" podUID="a2280d16-1f62-4fd2-8871-ffa8336618d4" Sep 10 16:10:51.996060 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:51.996035 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tf86h_428131af-5c52-4344-add7-4fa536de9ceb/server/0.log" Sep 10 16:10:52.324713 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:52.324616 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5995b6f449-s8jhs_da5efc8a-fb82-4828-9f3b-4a727df73896/manager/0.log" Sep 10 16:10:52.361433 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:52.361410 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5995b6f449-s8jhs_da5efc8a-fb82-4828-9f3b-4a727df73896/copy-manifests/0.log" Sep 10 16:10:53.698400 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:53.698378 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b9559cd76-bbsv5_ed004f00-a1f8-44d9-8f4b-9fe7ff55fcfa/manager/0.log" Sep 10 16:10:53.832117 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:53.832091 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd_eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8/istio-proxy/0.log" Sep 10 16:10:53.945439 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:53.945386 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-89dd5bbbb-rkc6f_08e19084-b74f-42e0-a592-3a641e061eaa/kube-auth-proxy/0.log" Sep 10 16:10:53.951461 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:53.951408 2574 scope.go:117] "RemoveContainer" containerID="27d59fbacac3995f131485278dea91b403ae3b3e4763836f44dab967a8d44f72" Sep 10 16:10:53.951590 ip-10-0-131-28 kubenswrapper[2574]: E0910 16:10:53.951573 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx_llm(28b2e6aa-ff3b-4c7b-9833-015403fd698b)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jgqcx" podUID="28b2e6aa-ff3b-4c7b-9833-015403fd698b" Sep 10 16:10:55.384675 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:55.384647 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-74bsd_eec1184f-cf7a-4eaf-8646-9ab3fcc7d6a8/istio-proxy/0.log" Sep 10 16:10:55.480218 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:55.480170 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-89dd5bbbb-rkc6f_08e19084-b74f-42e0-a592-3a641e061eaa/kube-auth-proxy/0.log" Sep 10 16:10:59.013163 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:59.013138 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-mdl9f_81c6ad20-f2f2-478e-992d-d774c64ace8f/migrator/0.log" Sep 10 16:10:59.043001 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:10:59.042973 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-mdl9f_81c6ad20-f2f2-478e-992d-d774c64ace8f/graceful-termination/0.log" Sep 10 16:11:00.440457 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:11:00.440432 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltdqc_a1c164f8-7f7a-46da-9b51-3b43f80aae6c/kube-multus-additional-cni-plugins/0.log" Sep 10 16:11:00.467116 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:11:00.467085 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltdqc_a1c164f8-7f7a-46da-9b51-3b43f80aae6c/egress-router-binary-copy/0.log" Sep 10 16:11:00.488839 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:11:00.488812 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltdqc_a1c164f8-7f7a-46da-9b51-3b43f80aae6c/cni-plugins/0.log" Sep 10 16:11:00.510166 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:11:00.510142 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltdqc_a1c164f8-7f7a-46da-9b51-3b43f80aae6c/bond-cni-plugin/0.log" Sep 10 16:11:00.532934 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:11:00.532909 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltdqc_a1c164f8-7f7a-46da-9b51-3b43f80aae6c/routeoverride-cni/0.log" Sep 10 16:11:00.560083 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:11:00.560059 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltdqc_a1c164f8-7f7a-46da-9b51-3b43f80aae6c/whereabouts-cni-bincopy/0.log" Sep 10 16:11:00.581182 ip-10-0-131-28 kubenswrapper[2574]: I0910 16:11:00.581161 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltdqc_a1c164f8-7f7a-46da-9b51-3b43f80aae6c/whereabouts-cni/0.log"