Jun 03 03:20:16.021895 ip-10-0-130-55 systemd[1]: Starting Kubernetes Kubelet... Jun 03 03:20:16.533181 ip-10-0-130-55 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 03:20:16.533181 ip-10-0-130-55 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 03:20:16.533181 ip-10-0-130-55 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 03:20:16.533181 ip-10-0-130-55 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 03:20:16.533181 ip-10-0-130-55 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 03:20:16.536190 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.536089 2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 03:20:16.540065 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540049 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 03:20:16.540065 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540065 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540070 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540074 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540079 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540083 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540087 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540089 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540092 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540096 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540100 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540109 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540112 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540116 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540119 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540121 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540124 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540127 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540129 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540132 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 03:20:16.540137 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540135 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540138 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540141 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540144 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540147 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540149 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540152 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540154 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540157 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540159 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540162 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540165 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540167 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540170 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540172 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540175 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540178 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540182 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540184 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540186 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 03:20:16.540604 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540189 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540191 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540193 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540196 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540198 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540200 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540203 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540205 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540207 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540209 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540212 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540214 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540217 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540219 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540222 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540225 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540228 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540231 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540233 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540236 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 03:20:16.541083 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540238 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540241 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540243 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540246 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540248 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540251 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540254 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540256 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540258 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540261 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540264 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540267 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540269 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540272 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540274 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540276 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540279 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540281 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540283 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540287 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 03:20:16.541592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540290 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540292 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540294 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540297 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540299 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540302 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540700 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540705 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540708 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540710 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540713 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540715 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540718 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540720 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540723 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540725 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540728 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540731 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540733 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540735 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 03:20:16.542075 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540738 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540741 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540744 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540746 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540748 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540751 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540753 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540756 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540758 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540760 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540763 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540765 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540767 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540770 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540772 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540774 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540777 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540779 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540782 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540785 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 03:20:16.542574 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540787 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540790 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540792 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540795 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540797 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540801 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540804 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540807 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540810 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540812 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540815 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540818 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540821 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540824 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540827 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540829 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540832 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540834 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540836 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540840 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 03:20:16.543093 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540842 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540845 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540847 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540849 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540852 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540854 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540856 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540859 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540861 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540864 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540867 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540871 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540873 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540875 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540878 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540880 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540883 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540885 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540887 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540891 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 03:20:16.543624 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540893 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540895 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540898 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540901 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540904 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540907 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540909 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540912 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540914 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540917 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540919 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.540922 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541914 2575 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541925 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541933 2575 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541937 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541942 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541945 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541949 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541953 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541956 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 03:20:16.544127 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541959 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541964 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541968 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541971 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541974 2575 flags.go:64] FLAG: --cgroup-root="" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541977 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541980 2575 flags.go:64] FLAG: --client-ca-file="" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541983 2575 flags.go:64] FLAG: --cloud-config="" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541985 2575 flags.go:64] FLAG: --cloud-provider="external" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541988 2575 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541992 2575 flags.go:64] FLAG: --cluster-domain="" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541995 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.541998 2575 flags.go:64] FLAG: --config-dir="" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542001 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542004 2575 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542008 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542011 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542014 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542018 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542021 2575 flags.go:64] FLAG: --contention-profiling="false" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542024 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542027 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542030 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542033 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542037 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 03:20:16.544652 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542040 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542043 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542045 2575 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542048 2575 flags.go:64] FLAG: --enable-server="true" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542052 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542056 2575 flags.go:64] FLAG: --event-burst="100" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542060 2575 flags.go:64] FLAG: --event-qps="50" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542063 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542066 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542068 2575 flags.go:64] FLAG: --eviction-hard="" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542072 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542075 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542078 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542081 2575 flags.go:64] FLAG: --eviction-soft="" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542084 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542087 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542090 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542093 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542096 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542098 2575 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542102 2575 flags.go:64] FLAG: --feature-gates="" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542105 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542108 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542111 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542114 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542117 2575 flags.go:64] FLAG: --healthz-port="10248" Jun 03 03:20:16.545278 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542120 2575 flags.go:64] FLAG: --help="false" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542123 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-130-55.ec2.internal" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542126 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542129 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542132 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542135 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542138 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542141 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542144 2575 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542147 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542151 2575 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542153 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542157 2575 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542160 2575 flags.go:64] FLAG: --kube-reserved="" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542163 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542165 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542168 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542171 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542174 2575 flags.go:64] FLAG: --lock-file="" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542178 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542181 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542184 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542189 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 03:20:16.545910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542192 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542195 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542198 2575 flags.go:64] FLAG: --logging-format="text" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542200 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542204 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542206 2575 flags.go:64] FLAG: --manifest-url="" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542209 2575 flags.go:64] FLAG: --manifest-url-header="" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542214 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542216 2575 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542221 2575 flags.go:64] FLAG: --max-pods="110" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542224 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542227 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542230 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542234 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542236 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542239 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542242 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542249 2575 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542252 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542255 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542259 2575 flags.go:64] FLAG: --pod-cidr="" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542262 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542268 2575 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542271 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 03:20:16.546496 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542274 2575 flags.go:64] FLAG: --pods-per-core="0" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542277 2575 flags.go:64] FLAG: --port="10250" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542280 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542283 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0de498884c51ae5a9" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542286 2575 flags.go:64] FLAG: --qos-reserved="" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542289 2575 flags.go:64] FLAG: --read-only-port="10255" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542292 2575 flags.go:64] FLAG: --register-node="true" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542294 2575 flags.go:64] FLAG: --register-schedulable="true" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542297 2575 flags.go:64] FLAG: --register-with-taints="" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542301 2575 flags.go:64] FLAG: --registry-burst="10" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542303 2575 flags.go:64] FLAG: --registry-qps="5" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542306 2575 flags.go:64] FLAG: --reserved-cpus="" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542309 2575 flags.go:64] FLAG: --reserved-memory="" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542312 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542315 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542319 2575 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542322 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542324 2575 flags.go:64] FLAG: --runonce="false" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542328 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542330 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542339 2575 flags.go:64] FLAG: --seccomp-default="false" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542343 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542345 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542348 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542352 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542354 2575 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 03:20:16.547119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542357 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542361 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542363 2575 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542366 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542369 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542372 2575 flags.go:64] FLAG: --system-cgroups="" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542375 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542380 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542383 2575 flags.go:64] FLAG: --tls-cert-file="" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542386 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542390 2575 flags.go:64] FLAG: --tls-min-version="" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542392 2575 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542395 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542398 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542400 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542404 2575 flags.go:64] FLAG: --v="2" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542408 2575 flags.go:64] FLAG: --version="false" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542412 2575 flags.go:64] FLAG: --vmodule="" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542416 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.542419 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542513 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542517 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542520 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542524 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 03:20:16.547758 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542527 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542529 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542535 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542539 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542542 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542544 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542547 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542562 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542564 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542567 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542570 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542572 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542577 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542580 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542582 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542585 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542588 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542591 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542594 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542596 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 03:20:16.548329 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542599 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542601 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542604 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542606 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542609 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542611 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542614 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542616 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542619 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542621 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542624 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542626 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542629 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542632 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542636 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542639 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542642 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542646 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542649 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 03:20:16.548941 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542652 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542655 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542658 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542660 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542662 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542666 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542669 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542671 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542674 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542678 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542681 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542684 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542687 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542690 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542692 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542695 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542697 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542700 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542702 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 03:20:16.549434 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542704 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542707 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542709 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542712 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542714 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542717 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542719 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542722 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542725 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542728 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542730 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542733 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542735 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542738 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542740 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542743 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542746 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542748 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542752 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542754 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 03:20:16.549926 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542757 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 03:20:16.550592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542759 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 03:20:16.550592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542762 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 03:20:16.550592 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.542765 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 03:20:16.550592 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.543720 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 03:20:16.552207 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.552070 2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 03:20:16.552207 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.552207 2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552260 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552265 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552268 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552272 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552274 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552278 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552281 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552284 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552286 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552289 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552292 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552295 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552297 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552300 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552303 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552305 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552308 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552310 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552313 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 03:20:16.552343 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552316 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552318 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552320 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552323 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552325 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552329 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552331 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552336 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552341 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552345 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552348 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552351 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552354 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552357 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552361 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552365 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552368 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552370 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552373 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 03:20:16.552944 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552375 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552378 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552381 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552383 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552386 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552388 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552390 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552393 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552395 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552398 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552400 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552402 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552405 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552408 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552411 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552414 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552416 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552419 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552421 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552424 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552426 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 03:20:16.553419 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552429 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552431 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552433 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552436 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552438 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552441 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552443 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552445 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552448 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552450 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552453 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552455 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552458 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552461 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552463 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552465 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552468 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552471 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552473 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552476 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 03:20:16.553985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552479 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 03:20:16.554471 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552481 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 03:20:16.554471 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552483 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 03:20:16.554471 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552486 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 03:20:16.554471 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552489 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 03:20:16.554471 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552492 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 03:20:16.554471 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552495 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 03:20:16.554471 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.552500 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 03:20:16.554471 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552616 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 03:20:16.554471 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552622 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 03:20:16.554471 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552625 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 03:20:16.554471 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552628 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 03:20:16.554471 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552630 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 03:20:16.554471 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552633 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 03:20:16.554471 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552636 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 03:20:16.554471 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552638 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 03:20:16.554471 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552641 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552643 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552645 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552648 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552650 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552653 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552655 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552658 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552660 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552663 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552665 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552668 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552670 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552674 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552678 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552680 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552682 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552685 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552687 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552690 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 03:20:16.554895 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552692 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552695 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552698 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552701 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552704 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552708 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552711 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552713 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552716 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552719 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552721 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552724 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552726 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552728 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552731 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552734 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552736 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552738 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552741 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 03:20:16.555408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552743 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552745 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552748 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552750 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552753 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552756 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552758 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552760 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552764 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552766 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552769 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552771 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552774 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552776 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552779 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552781 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552784 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552786 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552789 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552791 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 03:20:16.555973 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552793 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552796 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552798 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552801 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552803 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552805 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552809 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552812 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552814 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552817 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552819 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552822 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552824 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552827 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552829 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552831 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552834 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552836 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 03:20:16.556475 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:16.552839 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 03:20:16.556929 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.552844 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 03:20:16.556929 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.552969 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 03:20:16.558224 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.558208 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 03:20:16.559370 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.559354 2575 server.go:1019] "Starting client certificate rotation" Jun 03 03:20:16.559840 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.559464 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 03:20:16.559840 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.559503 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 03:20:16.587747 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.587713 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 03:20:16.589584 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.589547 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 03:20:16.609509 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.609488 2575 log.go:25] "Validated CRI v1 runtime API" Jun 03 03:20:16.616656 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.616634 2575 log.go:25] "Validated CRI v1 image API" Jun 03 03:20:16.619824 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.619805 2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 03:20:16.625030 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.625006 2575 fs.go:135] Filesystem UUIDs: map[6c7f13c3-2594-48fa-aec6-2e6087aeb3bd:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bc58ebcf-6f8f-473c-8ed3-6914fc74efbe:/dev/nvme0n1p3] Jun 03 03:20:16.625144 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.625027 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 03:20:16.627197 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.627179 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 03:20:16.629402 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.629294 2575 manager.go:217] Machine: {Timestamp:2026-06-03 03:20:16.628792743 +0000 UTC m=+0.470374351 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106500 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25eb793c92d26c01837fc9a0ef5ff3 SystemUUID:ec25eb79-3c92-d26c-0183-7fc9a0ef5ff3 BootID:c144924a-0db3-4fa6-ba2a-204849c5a139 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6c:36:b7:50:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6c:36:b7:50:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:1a:04:c9:76:71 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 03:20:16.631254 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.631242 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 03:20:16.631404 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.631391 2575 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 03:20:16.633602 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.633572 2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 03:20:16.633752 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.633605 2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-55.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 03:20:16.633802 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.633762 2575 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 03:20:16.633802 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.633770 2575 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 03:20:16.633802 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.633777 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 03:20:16.634598 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.634587 2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 03:20:16.636360 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.636347 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 03 03:20:16.636493 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.636484 2575 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 03:20:16.639374 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.639362 2575 kubelet.go:491] "Attempting to sync node with API server" Jun 03 03:20:16.639418 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.639378 2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 03:20:16.639418 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.639390 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 03:20:16.639418 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.639401 2575 kubelet.go:397] "Adding apiserver pod source" Jun 03 03:20:16.639418 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.639410 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 03:20:16.640702 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.640689 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 03:20:16.640746 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.640709 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 03:20:16.648804 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.648784 2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 03:20:16.651413 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.651392 2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 03:20:16.653725 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.653706 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 03:20:16.653725 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.653728 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 03:20:16.653892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.653737 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 03:20:16.653892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.653744 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 03:20:16.653892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.653757 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 03:20:16.653892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.653765 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 03:20:16.653892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.653783 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 03:20:16.653892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.653791 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 03:20:16.653892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.653802 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 03:20:16.653892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.653810 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 03:20:16.653892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.653827 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 03:20:16.653892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.653836 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 03:20:16.653892 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:16.653858 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 03:20:16.654179 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:16.653874 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-55.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 03:20:16.655725 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.655713 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 03:20:16.655778 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.655730 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 03:20:16.657667 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.657643 2575 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-55.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 03:20:16.659016 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.658999 2575 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 03:20:16.659096 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.659060 2575 server.go:1295] "Started kubelet" Jun 03 03:20:16.659159 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.659112 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 03:20:16.659263 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.659209 2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 03:20:16.659306 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.659283 2575 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 03:20:16.659870 ip-10-0-130-55 systemd[1]: Started Kubernetes Kubelet. Jun 03 03:20:16.660830 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.660813 2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 03:20:16.660908 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.660884 2575 server.go:317] "Adding debug handlers to kubelet server" Jun 03 03:20:16.663174 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.663140 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ptqpj" Jun 03 03:20:16.667247 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.667229 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 03:20:16.667767 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.667749 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 03:20:16.667904 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.667889 2575 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 03:20:16.667966 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.667905 2575 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 03:20:16.668059 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.668047 2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 03:20:16.670026 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.670004 2575 reconstruct.go:97] "Volume reconstruction finished" Jun 03 03:20:16.670026 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.670026 2575 reconciler.go:26] "Reconciler: start to sync state" Jun 03 03:20:16.670154 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:16.670105 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-55.ec2.internal\" not found" Jun 03 03:20:16.670605 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.670579 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ptqpj" Jun 03 03:20:16.671005 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.670987 2575 factory.go:55] Registering systemd factory Jun 03 03:20:16.671114 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.671104 2575 factory.go:223] Registration of the systemd container factory successfully Jun 03 03:20:16.671633 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.671609 2575 factory.go:153] Registering CRI-O factory Jun 03 03:20:16.671633 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.671634 2575 factory.go:223] Registration of the crio container factory successfully Jun 03 03:20:16.671775 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.671709 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 03:20:16.671830 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:16.671777 2575 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 03:20:16.671877 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.671859 2575 factory.go:103] Registering Raw factory Jun 03 03:20:16.671927 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.671896 2575 manager.go:1196] Started watching for new ooms in manager Jun 03 03:20:16.674230 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.674209 2575 manager.go:319] Starting recovery of all containers Jun 03 03:20:16.676672 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.676646 2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:16.678466 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:16.678442 2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-55.ec2.internal\" not found" node="ip-10-0-130-55.ec2.internal" Jun 03 03:20:16.685789 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.685770 2575 manager.go:324] Recovery completed Jun 03 03:20:16.690229 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.690213 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:16.692432 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.692417 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:16.692510 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.692445 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:16.692510 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.692460 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:16.693037 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.693023 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 03:20:16.693037 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.693035 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 03:20:16.693134 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.693052 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 03 03:20:16.696896 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.696881 2575 policy_none.go:49] "None policy: Start" Jun 03 03:20:16.696950 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.696899 2575 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 03:20:16.696950 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.696909 2575 state_mem.go:35] "Initializing new in-memory state store" Jun 03 03:20:16.730244 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.730218 2575 manager.go:341] "Starting Device Plugin manager" Jun 03 03:20:16.757583 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:16.730281 2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 03:20:16.757583 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.730295 2575 server.go:85] "Starting device plugin registration server" Jun 03 03:20:16.757583 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.730601 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 03:20:16.757583 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.730615 2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 03:20:16.757583 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.730832 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 03:20:16.757583 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.730911 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 03:20:16.757583 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.730917 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 03:20:16.757583 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:16.731691 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 03:20:16.757583 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:16.731738 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-55.ec2.internal\" not found" Jun 03 03:20:16.776123 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.776092 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 03:20:16.777410 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.777383 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 03:20:16.777410 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.777407 2575 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 03:20:16.777646 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.777425 2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 03:20:16.777646 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.777433 2575 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 03:20:16.777646 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:16.777536 2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 03:20:16.780415 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.780393 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:16.830982 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.830942 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:16.832023 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.832005 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:16.832126 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.832033 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:16.832126 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.832044 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:16.832126 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.832067 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-55.ec2.internal" Jun 03 03:20:16.844607 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.844582 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-55.ec2.internal" Jun 03 03:20:16.844717 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:16.844613 2575 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-55.ec2.internal\": node \"ip-10-0-130-55.ec2.internal\" not found" Jun 03 03:20:16.859499 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:16.859470 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-55.ec2.internal\" not found" Jun 03 03:20:16.877781 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.877750 2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-55.ec2.internal"] Jun 03 03:20:16.877847 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.877837 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:16.878801 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.878783 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:16.878892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.878814 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:16.878892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.878825 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:16.879906 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.879894 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:16.880100 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.880087 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal" Jun 03 03:20:16.880146 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.880133 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:16.880700 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.880682 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:16.880700 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.880693 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:16.880854 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.880710 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:16.880854 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.880714 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:16.880854 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.880720 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:16.880854 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.880723 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:16.881738 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.881725 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-55.ec2.internal" Jun 03 03:20:16.881782 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.881749 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 03:20:16.882358 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.882344 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasSufficientMemory" Jun 03 03:20:16.882449 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.882371 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 03:20:16.882449 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.882386 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeHasSufficientPID" Jun 03 03:20:16.908530 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:16.908498 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-55.ec2.internal\" not found" node="ip-10-0-130-55.ec2.internal" Jun 03 03:20:16.914010 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:16.913986 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-55.ec2.internal\" not found" node="ip-10-0-130-55.ec2.internal" Jun 03 03:20:16.959643 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:16.959601 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-55.ec2.internal\" not found" Jun 03 03:20:16.971050 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.971023 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a6d08139769a8777bdfc7de0fef4e9c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal\" (UID: \"a6d08139769a8777bdfc7de0fef4e9c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal" Jun 03 03:20:16.971114 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.971056 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6d08139769a8777bdfc7de0fef4e9c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal\" (UID: \"a6d08139769a8777bdfc7de0fef4e9c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal" Jun 03 03:20:16.971114 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:16.971077 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e6a6970212cff9ea79f77794f10d402-config\") pod \"kube-apiserver-proxy-ip-10-0-130-55.ec2.internal\" (UID: \"9e6a6970212cff9ea79f77794f10d402\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-55.ec2.internal" Jun 03 03:20:17.060184 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:17.060122 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-55.ec2.internal\" not found" Jun 03 03:20:17.071593 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.071538 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a6d08139769a8777bdfc7de0fef4e9c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal\" (UID: \"a6d08139769a8777bdfc7de0fef4e9c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal" Jun 03 03:20:17.071593 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.071577 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a6d08139769a8777bdfc7de0fef4e9c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal\" (UID: \"a6d08139769a8777bdfc7de0fef4e9c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal" Jun 03 03:20:17.071674 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.071626 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6d08139769a8777bdfc7de0fef4e9c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal\" (UID: \"a6d08139769a8777bdfc7de0fef4e9c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal" Jun 03 03:20:17.071674 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.071646 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e6a6970212cff9ea79f77794f10d402-config\") pod \"kube-apiserver-proxy-ip-10-0-130-55.ec2.internal\" (UID: \"9e6a6970212cff9ea79f77794f10d402\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-55.ec2.internal" Jun 03 03:20:17.071736 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.071679 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e6a6970212cff9ea79f77794f10d402-config\") pod \"kube-apiserver-proxy-ip-10-0-130-55.ec2.internal\" (UID: \"9e6a6970212cff9ea79f77794f10d402\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-55.ec2.internal" Jun 03 03:20:17.071736 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.071719 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6d08139769a8777bdfc7de0fef4e9c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal\" (UID: \"a6d08139769a8777bdfc7de0fef4e9c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal" Jun 03 03:20:17.160965 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:17.160927 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-55.ec2.internal\" not found" Jun 03 03:20:17.211477 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.211446 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal" Jun 03 03:20:17.216945 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.216925 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-55.ec2.internal" Jun 03 03:20:17.261490 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:17.261454 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-55.ec2.internal\" not found" Jun 03 03:20:17.361984 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:17.361931 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-55.ec2.internal\" not found" Jun 03 03:20:17.462486 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:17.462441 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-55.ec2.internal\" not found" Jun 03 03:20:17.518179 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.518154 2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:17.559239 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.559202 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 03:20:17.559917 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.559374 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 03:20:17.559917 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.559406 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 03:20:17.559917 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.559417 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 03:20:17.568297 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.568272 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal" Jun 03 03:20:17.593241 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.593213 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 03:20:17.595264 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.595248 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-55.ec2.internal" Jun 03 03:20:17.603059 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.603036 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 03:20:17.640208 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.640179 2575 apiserver.go:52] "Watching apiserver" Jun 03 03:20:17.649005 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.648978 2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 03:20:17.650292 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.650260 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-9cklm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal","openshift-multus/multus-p5fc9","openshift-network-diagnostics/network-check-target-vsqpb","openshift-image-registry/node-ca-rkbr5","openshift-multus/multus-additional-cni-plugins-5fkcf","openshift-multus/network-metrics-daemon-trw96","openshift-network-operator/iptables-alerter-kkw69","openshift-ovn-kubernetes/ovnkube-node-nn4q2","kube-system/konnectivity-agent-ndjrl","kube-system/kube-apiserver-proxy-ip-10-0-130-55.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc","openshift-cluster-node-tuning-operator/tuned-wqt9g"] Jun 03 03:20:17.655144 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.655113 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ndjrl" Jun 03 03:20:17.657407 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.657203 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:17.657519 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.657257 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 03:20:17.657519 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:17.657482 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:17.657519 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.657336 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 03:20:17.657703 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.657320 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xqwwh\"" Jun 03 03:20:17.659373 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.659352 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.659478 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.659456 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.661355 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.661337 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.661785 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.661766 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 03:20:17.661899 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.661790 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 03:20:17.661899 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.661796 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 03:20:17.661899 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.661811 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 03:20:17.662027 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.661907 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 03:20:17.662082 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.662028 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q5ttq\"" Jun 03 03:20:17.662136 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.662118 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 03:20:17.662180 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.662164 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 03:20:17.662398 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.662386 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cldvj\"" Jun 03 03:20:17.662988 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.662975 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8nl7n\"" Jun 03 03:20:17.663115 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.663105 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 03:20:17.665198 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.665184 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rkbr5" Jun 03 03:20:17.667057 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.667036 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 03:20:17.667156 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.667057 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 03:20:17.667319 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.667304 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 03:20:17.667390 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.667318 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:17.667390 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:17.667376 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:17.667517 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.667501 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c9hnt\"" Jun 03 03:20:17.667632 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.667615 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 03:20:17.671164 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.670543 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kkw69" Jun 03 03:20:17.671164 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.671051 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.672972 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.672952 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xwlvx\"" Jun 03 03:20:17.673044 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.672991 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 03:20:17.673252 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.673225 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 03:15:16 +0000 UTC" deadline="2028-03-08 17:31:38.452373092 +0000 UTC" Jun 03 03:20:17.673311 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.673256 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15470h11m20.779120901s" Jun 03 03:20:17.673311 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.673267 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 03:20:17.674058 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.673936 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-62jq7\"" Jun 03 03:20:17.674058 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674039 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6bc4f112-f25e-439c-b288-0788f935ade9-os-release\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.674213 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674076 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-var-lib-kubelet\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.674213 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674119 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrbrj\" (UniqueName: \"kubernetes.io/projected/3aa52479-3df9-4b2a-a0df-df97785477a5-kube-api-access-mrbrj\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.674213 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674151 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a178226-0867-48c5-a3a6-098104eb77e4-iptables-alerter-script\") pod \"iptables-alerter-kkw69\" (UID: \"9a178226-0867-48c5-a3a6-098104eb77e4\") " pod="openshift-network-operator/iptables-alerter-kkw69" Jun 03 03:20:17.674213 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674186 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j4qp\" (UniqueName: \"kubernetes.io/projected/4801abc1-ec7f-43ab-a2e1-2cbac19f58cb-kube-api-access-7j4qp\") pod \"node-ca-rkbr5\" (UID: \"4801abc1-ec7f-43ab-a2e1-2cbac19f58cb\") " pod="openshift-image-registry/node-ca-rkbr5" Jun 03 03:20:17.674406 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674218 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-var-lib-cni-bin\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.674406 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674329 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bc4f112-f25e-439c-b288-0788f935ade9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.674406 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674368 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-tuned\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.674567 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674430 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-system-cni-dir\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.674567 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674457 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnjb6\" (UniqueName: \"kubernetes.io/projected/0085db10-4407-48e2-b27f-2abf8391ee43-kube-api-access-cnjb6\") pod \"network-metrics-daemon-trw96\" (UID: \"0085db10-4407-48e2-b27f-2abf8391ee43\") " pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:17.674567 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674490 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9cklm" Jun 03 03:20:17.674567 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-kubelet\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.674567 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674533 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbb3a2ed-ce99-479a-979b-4968e52096ce-konnectivity-ca\") pod \"konnectivity-agent-ndjrl\" (UID: \"dbb3a2ed-ce99-479a-979b-4968e52096ce\") " pod="kube-system/konnectivity-agent-ndjrl" Jun 03 03:20:17.674799 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674579 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bc4f112-f25e-439c-b288-0788f935ade9-system-cni-dir\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.674851 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674798 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-sysconfig\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.674851 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674838 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-var-lib-cni-multus\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.674949 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674879 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-etc-kubernetes\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.674949 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674911 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs\") pod \"network-metrics-daemon-trw96\" (UID: \"0085db10-4407-48e2-b27f-2abf8391ee43\") " pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:17.675041 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.674978 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-etc-openvswitch\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.676380 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676361 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 03:20:17.676461 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676435 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 03:20:17.676668 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.675008 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-kubernetes\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.676668 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676587 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aa52479-3df9-4b2a-a0df-df97785477a5-tmp\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.676668 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676634 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 03:20:17.676668 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676643 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8aa8e984-793a-41cf-81a8-6b25a478ada3-ovnkube-config\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.676668 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676660 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 03:20:17.676929 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676673 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bc4f112-f25e-439c-b288-0788f935ade9-cni-binary-copy\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.676929 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676701 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-lib-modules\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.676929 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676726 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx448\" (UniqueName: \"kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448\") pod \"network-check-target-vsqpb\" (UID: \"5316cd63-ebbf-456a-99d6-a20a009eeeac\") " pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:17.676929 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676749 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-run-netns\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.676929 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676756 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 03:20:17.676929 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676770 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-var-lib-openvswitch\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.676929 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676797 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 03:20:17.676929 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676795 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8aa8e984-793a-41cf-81a8-6b25a478ada3-ovnkube-script-lib\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.676929 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676873 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 03:20:17.676929 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676885 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 03:20:17.677306 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676991 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 03:20:17.677306 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.676991 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-sysctl-d\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.677306 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677066 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-run-netns\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.677306 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677087 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-slash\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.677306 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr452\" (UniqueName: \"kubernetes.io/projected/8aa8e984-793a-41cf-81a8-6b25a478ada3-kube-api-access-lr452\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.677306 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677113 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dcch9\"" Jun 03 03:20:17.677306 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677150 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-hostroot\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.677306 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgp5r\" (UniqueName: \"kubernetes.io/projected/90b86af7-646d-4288-9773-965f3ef2ac98-kube-api-access-bgp5r\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.677306 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brngx\" (UniqueName: \"kubernetes.io/projected/9a178226-0867-48c5-a3a6-098104eb77e4-kube-api-access-brngx\") pod \"iptables-alerter-kkw69\" (UID: \"9a178226-0867-48c5-a3a6-098104eb77e4\") " pod="openshift-network-operator/iptables-alerter-kkw69" Jun 03 03:20:17.677306 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677297 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4801abc1-ec7f-43ab-a2e1-2cbac19f58cb-host\") pod \"node-ca-rkbr5\" (UID: \"4801abc1-ec7f-43ab-a2e1-2cbac19f58cb\") " pod="openshift-image-registry/node-ca-rkbr5" Jun 03 03:20:17.677647 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677349 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4801abc1-ec7f-43ab-a2e1-2cbac19f58cb-serviceca\") pod \"node-ca-rkbr5\" (UID: \"4801abc1-ec7f-43ab-a2e1-2cbac19f58cb\") " pod="openshift-image-registry/node-ca-rkbr5" Jun 03 03:20:17.677647 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677371 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-systemd-units\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.677647 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677387 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-run-ovn\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.677647 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677401 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-node-log\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.677647 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677415 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbb3a2ed-ce99-479a-979b-4968e52096ce-agent-certs\") pod \"konnectivity-agent-ndjrl\" (UID: \"dbb3a2ed-ce99-479a-979b-4968e52096ce\") " pod="kube-system/konnectivity-agent-ndjrl" Jun 03 03:20:17.677647 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677429 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-host\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.677647 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677457 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-cni-netd\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.677647 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677490 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-run\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.677647 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677518 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-run-k8s-cni-cncf-io\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.677647 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677546 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-var-lib-kubelet\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.677647 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677584 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a178226-0867-48c5-a3a6-098104eb77e4-host-slash\") pod \"iptables-alerter-kkw69\" (UID: \"9a178226-0867-48c5-a3a6-098104eb77e4\") " pod="openshift-network-operator/iptables-alerter-kkw69" Jun 03 03:20:17.677647 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677610 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-run-openvswitch\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.677647 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677645 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-cni-bin\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.678032 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677672 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bc4f112-f25e-439c-b288-0788f935ade9-cnibin\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.678032 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677697 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-modprobe-d\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.678032 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677726 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-multus-socket-dir-parent\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.678032 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677745 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-run-multus-certs\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.678032 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677768 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-run-systemd\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.678032 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z4dx\" (UniqueName: \"kubernetes.io/projected/6bc4f112-f25e-439c-b288-0788f935ade9-kube-api-access-6z4dx\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.678032 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677799 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-cnibin\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.678032 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677829 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-multus-conf-dir\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.678032 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677861 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.678032 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677904 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6bc4f112-f25e-439c-b288-0788f935ade9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.678032 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677927 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6bc4f112-f25e-439c-b288-0788f935ade9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.678032 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677942 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-sys\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.678032 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.677979 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-os-release\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.678032 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.678028 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8aa8e984-793a-41cf-81a8-6b25a478ada3-ovn-node-metrics-cert\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.678458 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.678049 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-systemd\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.678458 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.678066 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90b86af7-646d-4288-9773-965f3ef2ac98-cni-binary-copy\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.678458 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.678088 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/90b86af7-646d-4288-9773-965f3ef2ac98-multus-daemon-config\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.678458 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.678111 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-log-socket\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.678458 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.678135 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-sysctl-conf\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.678458 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.678151 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-multus-cni-dir\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.678458 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.678173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-run-ovn-kubernetes\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.678458 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.678197 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8aa8e984-793a-41cf-81a8-6b25a478ada3-env-overrides\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.678458 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.678403 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 03:20:17.678755 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.678634 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.680435 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.680417 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 03:20:17.680676 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.680660 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j2tz8\"" Jun 03 03:20:17.680743 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.680692 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 03:20:17.680784 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.680666 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 03:20:17.698526 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.698502 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-clzhk" Jun 03 03:20:17.705613 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.705592 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-clzhk" Jun 03 03:20:17.770544 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.770486 2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 03:20:17.770738 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:17.770715 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e6a6970212cff9ea79f77794f10d402.slice/crio-24460136c11e1496877c5caa893acfbb65c566e7beb9788c61bdbd4016bcf3a8 WatchSource:0}: Error finding container 24460136c11e1496877c5caa893acfbb65c566e7beb9788c61bdbd4016bcf3a8: Status 404 returned error can't find the container with id 24460136c11e1496877c5caa893acfbb65c566e7beb9788c61bdbd4016bcf3a8 Jun 03 03:20:17.770924 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:17.770908 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d08139769a8777bdfc7de0fef4e9c3.slice/crio-795ebb1f5fc391c1ac918b0b7bded2ececa3f0a86c0afe526810fc88861117c7 WatchSource:0}: Error finding container 795ebb1f5fc391c1ac918b0b7bded2ececa3f0a86c0afe526810fc88861117c7: Status 404 returned error can't find the container with id 795ebb1f5fc391c1ac918b0b7bded2ececa3f0a86c0afe526810fc88861117c7 Jun 03 03:20:17.774000 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.773985 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 03:20:17.779109 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779083 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-socket-dir\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.779211 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779181 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-run-ovn-kubernetes\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.779271 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779231 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8aa8e984-793a-41cf-81a8-6b25a478ada3-env-overrides\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.780070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779263 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-run-ovn-kubernetes\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.780070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779280 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6bc4f112-f25e-439c-b288-0788f935ade9-os-release\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.780070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779309 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-var-lib-kubelet\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.780070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779327 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mrbrj\" (UniqueName: \"kubernetes.io/projected/3aa52479-3df9-4b2a-a0df-df97785477a5-kube-api-access-mrbrj\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.780070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779342 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a178226-0867-48c5-a3a6-098104eb77e4-iptables-alerter-script\") pod \"iptables-alerter-kkw69\" (UID: \"9a178226-0867-48c5-a3a6-098104eb77e4\") " pod="openshift-network-operator/iptables-alerter-kkw69" Jun 03 03:20:17.780070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779358 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7j4qp\" (UniqueName: \"kubernetes.io/projected/4801abc1-ec7f-43ab-a2e1-2cbac19f58cb-kube-api-access-7j4qp\") pod \"node-ca-rkbr5\" (UID: \"4801abc1-ec7f-43ab-a2e1-2cbac19f58cb\") " pod="openshift-image-registry/node-ca-rkbr5" Jun 03 03:20:17.780070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779372 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-var-lib-cni-bin\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.780070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779375 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6bc4f112-f25e-439c-b288-0788f935ade9-os-release\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.780070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779389 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-registration-dir\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.780070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779427 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-etc-selinux\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.780070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779460 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bc4f112-f25e-439c-b288-0788f935ade9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.780070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779490 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-tuned\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.780070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779513 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-system-cni-dir\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.780070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779538 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cnjb6\" (UniqueName: \"kubernetes.io/projected/0085db10-4407-48e2-b27f-2abf8391ee43-kube-api-access-cnjb6\") pod \"network-metrics-daemon-trw96\" (UID: \"0085db10-4407-48e2-b27f-2abf8391ee43\") " pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:17.780070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779581 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-kubelet\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.780070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779606 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbb3a2ed-ce99-479a-979b-4968e52096ce-konnectivity-ca\") pod \"konnectivity-agent-ndjrl\" (UID: \"dbb3a2ed-ce99-479a-979b-4968e52096ce\") " pod="kube-system/konnectivity-agent-ndjrl" Jun 03 03:20:17.780070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779633 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bc4f112-f25e-439c-b288-0788f935ade9-system-cni-dir\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.780892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779657 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-sysconfig\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.780892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779681 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-var-lib-cni-multus\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.780892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779705 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-etc-kubernetes\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.780892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779738 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70e80cc4-7c78-4606-a320-d3cc0ac6452a-tmp-dir\") pod \"node-resolver-9cklm\" (UID: \"70e80cc4-7c78-4606-a320-d3cc0ac6452a\") " pod="openshift-dns/node-resolver-9cklm" Jun 03 03:20:17.780892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779764 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs\") pod \"network-metrics-daemon-trw96\" (UID: \"0085db10-4407-48e2-b27f-2abf8391ee43\") " pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:17.780892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779789 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-etc-openvswitch\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.780892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779813 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-kubernetes\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.780892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779837 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aa52479-3df9-4b2a-a0df-df97785477a5-tmp\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.780892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779893 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-device-dir\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.780892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779921 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8aa8e984-793a-41cf-81a8-6b25a478ada3-ovnkube-config\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.780892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779946 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bc4f112-f25e-439c-b288-0788f935ade9-cni-binary-copy\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.780892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779963 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a178226-0867-48c5-a3a6-098104eb77e4-iptables-alerter-script\") pod \"iptables-alerter-kkw69\" (UID: \"9a178226-0867-48c5-a3a6-098104eb77e4\") " pod="openshift-network-operator/iptables-alerter-kkw69" Jun 03 03:20:17.780892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780009 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8aa8e984-793a-41cf-81a8-6b25a478ada3-env-overrides\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.780892 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:17.780119 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:17.780892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780161 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-sysconfig\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.780892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779460 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-var-lib-cni-bin\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.780892 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780188 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-lib-modules\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.781958 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:17.780205 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs podName:0085db10-4407-48e2-b27f-2abf8391ee43 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:18.280157325 +0000 UTC m=+2.121738922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs") pod "network-metrics-daemon-trw96" (UID: "0085db10-4407-48e2-b27f-2abf8391ee43") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:17.781958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780119 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-etc-kubernetes\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.781958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779968 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-lib-modules\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.781958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780248 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-sys-fs\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.781958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780254 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-etc-openvswitch\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.781958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780114 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bc4f112-f25e-439c-b288-0788f935ade9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.781958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780016 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-var-lib-cni-multus\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.781958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780306 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-kubernetes\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.781958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780339 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4bnj\" (UniqueName: \"kubernetes.io/projected/308df474-5a5d-4432-8e04-e462f1e4cb53-kube-api-access-s4bnj\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.781958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780358 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-system-cni-dir\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.781958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.779513 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-var-lib-kubelet\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.781958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780373 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bx448\" (UniqueName: \"kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448\") pod \"network-check-target-vsqpb\" (UID: \"5316cd63-ebbf-456a-99d6-a20a009eeeac\") " pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:17.781958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780467 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bc4f112-f25e-439c-b288-0788f935ade9-system-cni-dir\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.781958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780533 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-kubelet\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.781958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780710 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 03:20:17.781958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780802 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bc4f112-f25e-439c-b288-0788f935ade9-cni-binary-copy\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.781958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780852 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-run-netns\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780881 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-var-lib-openvswitch\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780888 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbb3a2ed-ce99-479a-979b-4968e52096ce-konnectivity-ca\") pod \"konnectivity-agent-ndjrl\" (UID: \"dbb3a2ed-ce99-479a-979b-4968e52096ce\") " pod="kube-system/konnectivity-agent-ndjrl" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780905 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8aa8e984-793a-41cf-81a8-6b25a478ada3-ovnkube-script-lib\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780929 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-sysctl-d\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780947 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-var-lib-openvswitch\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780957 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-run-netns\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780985 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-slash\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780930 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-run-netns\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781015 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lr452\" (UniqueName: \"kubernetes.io/projected/8aa8e984-793a-41cf-81a8-6b25a478ada3-kube-api-access-lr452\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781024 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-slash\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.780988 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-run-netns\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781040 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-hostroot\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781066 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgp5r\" (UniqueName: \"kubernetes.io/projected/90b86af7-646d-4288-9773-965f3ef2ac98-kube-api-access-bgp5r\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781067 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-sysctl-d\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781106 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brngx\" (UniqueName: \"kubernetes.io/projected/9a178226-0867-48c5-a3a6-098104eb77e4-kube-api-access-brngx\") pod \"iptables-alerter-kkw69\" (UID: \"9a178226-0867-48c5-a3a6-098104eb77e4\") " pod="openshift-network-operator/iptables-alerter-kkw69" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781133 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-hostroot\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781140 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fxxq\" (UniqueName: \"kubernetes.io/projected/70e80cc4-7c78-4606-a320-d3cc0ac6452a-kube-api-access-4fxxq\") pod \"node-resolver-9cklm\" (UID: \"70e80cc4-7c78-4606-a320-d3cc0ac6452a\") " pod="openshift-dns/node-resolver-9cklm" Jun 03 03:20:17.782740 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781296 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4801abc1-ec7f-43ab-a2e1-2cbac19f58cb-host\") pod \"node-ca-rkbr5\" (UID: \"4801abc1-ec7f-43ab-a2e1-2cbac19f58cb\") " pod="openshift-image-registry/node-ca-rkbr5" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781375 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4801abc1-ec7f-43ab-a2e1-2cbac19f58cb-serviceca\") pod \"node-ca-rkbr5\" (UID: \"4801abc1-ec7f-43ab-a2e1-2cbac19f58cb\") " pod="openshift-image-registry/node-ca-rkbr5" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781390 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4801abc1-ec7f-43ab-a2e1-2cbac19f58cb-host\") pod \"node-ca-rkbr5\" (UID: \"4801abc1-ec7f-43ab-a2e1-2cbac19f58cb\") " pod="openshift-image-registry/node-ca-rkbr5" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781405 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-systemd-units\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781446 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-run-ovn\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781473 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-node-log\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781497 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbb3a2ed-ce99-479a-979b-4968e52096ce-agent-certs\") pod \"konnectivity-agent-ndjrl\" (UID: \"dbb3a2ed-ce99-479a-979b-4968e52096ce\") " pod="kube-system/konnectivity-agent-ndjrl" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781540 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-systemd-units\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781593 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-host\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781620 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-cni-netd\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781644 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-run\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781666 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-run-k8s-cni-cncf-io\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781689 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-var-lib-kubelet\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781713 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a178226-0867-48c5-a3a6-098104eb77e4-host-slash\") pod \"iptables-alerter-kkw69\" (UID: \"9a178226-0867-48c5-a3a6-098104eb77e4\") " pod="openshift-network-operator/iptables-alerter-kkw69" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781738 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-run-openvswitch\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781762 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-cni-bin\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781788 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bc4f112-f25e-439c-b288-0788f935ade9-cnibin\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781815 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-modprobe-d\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.783533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781841 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-multus-socket-dir-parent\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.784346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781868 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-run-multus-certs\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.784346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781887 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8aa8e984-793a-41cf-81a8-6b25a478ada3-ovnkube-config\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.784346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781900 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.784346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781939 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/70e80cc4-7c78-4606-a320-d3cc0ac6452a-hosts-file\") pod \"node-resolver-9cklm\" (UID: \"70e80cc4-7c78-4606-a320-d3cc0ac6452a\") " pod="openshift-dns/node-resolver-9cklm" Jun 03 03:20:17.784346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781967 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-run-systemd\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.784346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.781992 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6z4dx\" (UniqueName: \"kubernetes.io/projected/6bc4f112-f25e-439c-b288-0788f935ade9-kube-api-access-6z4dx\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.784346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782004 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8aa8e984-793a-41cf-81a8-6b25a478ada3-ovnkube-script-lib\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.784346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782016 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-cnibin\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.784346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782059 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-cnibin\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.784346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782079 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-multus-conf-dir\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.784346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782105 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-run-systemd\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.784346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782109 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.784346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782139 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6bc4f112-f25e-439c-b288-0788f935ade9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.784346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782166 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6bc4f112-f25e-439c-b288-0788f935ade9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.784346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782192 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-sys\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.784346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782214 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-os-release\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.784346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782308 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8aa8e984-793a-41cf-81a8-6b25a478ada3-ovn-node-metrics-cert\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782313 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4801abc1-ec7f-43ab-a2e1-2cbac19f58cb-serviceca\") pod \"node-ca-rkbr5\" (UID: \"4801abc1-ec7f-43ab-a2e1-2cbac19f58cb\") " pod="openshift-image-registry/node-ca-rkbr5" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782358 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-systemd\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782388 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-host\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782453 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782456 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-cni-netd\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782464 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-host-cni-bin\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782502 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-run-openvswitch\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782509 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bc4f112-f25e-439c-b288-0788f935ade9-cnibin\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782577 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-run\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782617 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-run-k8s-cni-cncf-io\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782623 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-modprobe-d\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782663 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a178226-0867-48c5-a3a6-098104eb77e4-host-slash\") pod \"iptables-alerter-kkw69\" (UID: \"9a178226-0867-48c5-a3a6-098104eb77e4\") " pod="openshift-network-operator/iptables-alerter-kkw69" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782711 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-run-ovn\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782741 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-var-lib-kubelet\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782750 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-node-log\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782403 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90b86af7-646d-4288-9773-965f3ef2ac98-cni-binary-copy\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782779 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-multus-socket-dir-parent\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.785129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782791 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/90b86af7-646d-4288-9773-965f3ef2ac98-multus-daemon-config\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782800 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-os-release\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782712 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-host-run-multus-certs\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782865 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-log-socket\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782922 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-sysctl-conf\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782875 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-systemd\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.782867 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-sys\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.783025 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-multus-conf-dir\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.783042 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-sysctl-conf\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.783077 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8aa8e984-793a-41cf-81a8-6b25a478ada3-log-socket\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.783467 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6bc4f112-f25e-439c-b288-0788f935ade9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.783590 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/90b86af7-646d-4288-9773-965f3ef2ac98-multus-daemon-config\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.783644 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-multus-cni-dir\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.783743 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90b86af7-646d-4288-9773-965f3ef2ac98-multus-cni-dir\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.783935 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6bc4f112-f25e-439c-b288-0788f935ade9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.783964 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-55.ec2.internal" event={"ID":"9e6a6970212cff9ea79f77794f10d402","Type":"ContainerStarted","Data":"24460136c11e1496877c5caa893acfbb65c566e7beb9788c61bdbd4016bcf3a8"} Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.784202 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3aa52479-3df9-4b2a-a0df-df97785477a5-etc-tuned\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.784251 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aa52479-3df9-4b2a-a0df-df97785477a5-tmp\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.785816 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.785051 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90b86af7-646d-4288-9773-965f3ef2ac98-cni-binary-copy\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.786391 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.785249 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal" event={"ID":"a6d08139769a8777bdfc7de0fef4e9c3","Type":"ContainerStarted","Data":"795ebb1f5fc391c1ac918b0b7bded2ececa3f0a86c0afe526810fc88861117c7"} Jun 03 03:20:17.786391 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.785686 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8aa8e984-793a-41cf-81a8-6b25a478ada3-ovn-node-metrics-cert\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.786391 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.785755 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbb3a2ed-ce99-479a-979b-4968e52096ce-agent-certs\") pod \"konnectivity-agent-ndjrl\" (UID: \"dbb3a2ed-ce99-479a-979b-4968e52096ce\") " pod="kube-system/konnectivity-agent-ndjrl" Jun 03 03:20:17.787405 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:17.787384 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:17.787501 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:17.787409 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:17.787501 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:17.787423 2575 projected.go:194] Error preparing data for projected volume kube-api-access-bx448 for pod openshift-network-diagnostics/network-check-target-vsqpb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:17.787501 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:17.787485 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448 podName:5316cd63-ebbf-456a-99d6-a20a009eeeac nodeName:}" failed. No retries permitted until 2026-06-03 03:20:18.287467394 +0000 UTC m=+2.129048992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bx448" (UniqueName: "kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448") pod "network-check-target-vsqpb" (UID: "5316cd63-ebbf-456a-99d6-a20a009eeeac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:17.789051 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.788963 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrbrj\" (UniqueName: \"kubernetes.io/projected/3aa52479-3df9-4b2a-a0df-df97785477a5-kube-api-access-mrbrj\") pod \"tuned-wqt9g\" (UID: \"3aa52479-3df9-4b2a-a0df-df97785477a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:17.789144 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.789120 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j4qp\" (UniqueName: \"kubernetes.io/projected/4801abc1-ec7f-43ab-a2e1-2cbac19f58cb-kube-api-access-7j4qp\") pod \"node-ca-rkbr5\" (UID: \"4801abc1-ec7f-43ab-a2e1-2cbac19f58cb\") " pod="openshift-image-registry/node-ca-rkbr5" Jun 03 03:20:17.790004 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.789979 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brngx\" (UniqueName: \"kubernetes.io/projected/9a178226-0867-48c5-a3a6-098104eb77e4-kube-api-access-brngx\") pod \"iptables-alerter-kkw69\" (UID: \"9a178226-0867-48c5-a3a6-098104eb77e4\") " pod="openshift-network-operator/iptables-alerter-kkw69" Jun 03 03:20:17.790753 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.790713 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr452\" (UniqueName: \"kubernetes.io/projected/8aa8e984-793a-41cf-81a8-6b25a478ada3-kube-api-access-lr452\") pod \"ovnkube-node-nn4q2\" (UID: \"8aa8e984-793a-41cf-81a8-6b25a478ada3\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:17.790753 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.790737 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z4dx\" (UniqueName: \"kubernetes.io/projected/6bc4f112-f25e-439c-b288-0788f935ade9-kube-api-access-6z4dx\") pod \"multus-additional-cni-plugins-5fkcf\" (UID: \"6bc4f112-f25e-439c-b288-0788f935ade9\") " pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:17.790849 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.790755 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgp5r\" (UniqueName: \"kubernetes.io/projected/90b86af7-646d-4288-9773-965f3ef2ac98-kube-api-access-bgp5r\") pod \"multus-p5fc9\" (UID: \"90b86af7-646d-4288-9773-965f3ef2ac98\") " pod="openshift-multus/multus-p5fc9" Jun 03 03:20:17.791080 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.791062 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnjb6\" (UniqueName: \"kubernetes.io/projected/0085db10-4407-48e2-b27f-2abf8391ee43-kube-api-access-cnjb6\") pod \"network-metrics-daemon-trw96\" (UID: \"0085db10-4407-48e2-b27f-2abf8391ee43\") " pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:17.884447 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884326 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4fxxq\" (UniqueName: \"kubernetes.io/projected/70e80cc4-7c78-4606-a320-d3cc0ac6452a-kube-api-access-4fxxq\") pod \"node-resolver-9cklm\" (UID: \"70e80cc4-7c78-4606-a320-d3cc0ac6452a\") " pod="openshift-dns/node-resolver-9cklm" Jun 03 03:20:17.884447 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884365 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.884447 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884382 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/70e80cc4-7c78-4606-a320-d3cc0ac6452a-hosts-file\") pod \"node-resolver-9cklm\" (UID: \"70e80cc4-7c78-4606-a320-d3cc0ac6452a\") " pod="openshift-dns/node-resolver-9cklm" Jun 03 03:20:17.884447 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884418 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-socket-dir\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.884778 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884474 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-registration-dir\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.884778 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884484 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/70e80cc4-7c78-4606-a320-d3cc0ac6452a-hosts-file\") pod \"node-resolver-9cklm\" (UID: \"70e80cc4-7c78-4606-a320-d3cc0ac6452a\") " pod="openshift-dns/node-resolver-9cklm" Jun 03 03:20:17.884778 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884502 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-etc-selinux\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.884778 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884480 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.884778 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884583 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-registration-dir\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.884778 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884612 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70e80cc4-7c78-4606-a320-d3cc0ac6452a-tmp-dir\") pod \"node-resolver-9cklm\" (UID: \"70e80cc4-7c78-4606-a320-d3cc0ac6452a\") " pod="openshift-dns/node-resolver-9cklm" Jun 03 03:20:17.884778 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884612 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-socket-dir\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.884778 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884672 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-device-dir\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.884778 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884713 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-etc-selinux\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.884778 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884715 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-sys-fs\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.884778 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884748 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s4bnj\" (UniqueName: \"kubernetes.io/projected/308df474-5a5d-4432-8e04-e462f1e4cb53-kube-api-access-s4bnj\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.885305 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884784 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-device-dir\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.885305 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884802 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/308df474-5a5d-4432-8e04-e462f1e4cb53-sys-fs\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.885305 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.884881 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70e80cc4-7c78-4606-a320-d3cc0ac6452a-tmp-dir\") pod \"node-resolver-9cklm\" (UID: \"70e80cc4-7c78-4606-a320-d3cc0ac6452a\") " pod="openshift-dns/node-resolver-9cklm" Jun 03 03:20:17.892798 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.892774 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fxxq\" (UniqueName: \"kubernetes.io/projected/70e80cc4-7c78-4606-a320-d3cc0ac6452a-kube-api-access-4fxxq\") pod \"node-resolver-9cklm\" (UID: \"70e80cc4-7c78-4606-a320-d3cc0ac6452a\") " pod="openshift-dns/node-resolver-9cklm" Jun 03 03:20:17.892893 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.892845 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4bnj\" (UniqueName: \"kubernetes.io/projected/308df474-5a5d-4432-8e04-e462f1e4cb53-kube-api-access-s4bnj\") pod \"aws-ebs-csi-driver-node-bvqtc\" (UID: \"308df474-5a5d-4432-8e04-e462f1e4cb53\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:17.982975 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.982938 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ndjrl" Jun 03 03:20:17.989289 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:17.989251 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb3a2ed_ce99_479a_979b_4968e52096ce.slice/crio-000973329f99f46cbac22cfe3629df3a5d804cfeb056428794ef2daa4139295d WatchSource:0}: Error finding container 000973329f99f46cbac22cfe3629df3a5d804cfeb056428794ef2daa4139295d: Status 404 returned error can't find the container with id 000973329f99f46cbac22cfe3629df3a5d804cfeb056428794ef2daa4139295d Jun 03 03:20:17.998927 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:17.998903 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5fkcf" Jun 03 03:20:18.004885 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:18.004861 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bc4f112_f25e_439c_b288_0788f935ade9.slice/crio-13cdad7459d2d174a5a41bc71283a248e9663855667931ec98fe8d5bbfa503cb WatchSource:0}: Error finding container 13cdad7459d2d174a5a41bc71283a248e9663855667931ec98fe8d5bbfa503cb: Status 404 returned error can't find the container with id 13cdad7459d2d174a5a41bc71283a248e9663855667931ec98fe8d5bbfa503cb Jun 03 03:20:18.018530 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.018491 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" Jun 03 03:20:18.025459 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:18.025428 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa52479_3df9_4b2a_a0df_df97785477a5.slice/crio-9df8480e5c3b1c50abedc9d041a7b3682dac74210aab0c38ee0588b349d5a00e WatchSource:0}: Error finding container 9df8480e5c3b1c50abedc9d041a7b3682dac74210aab0c38ee0588b349d5a00e: Status 404 returned error can't find the container with id 9df8480e5c3b1c50abedc9d041a7b3682dac74210aab0c38ee0588b349d5a00e Jun 03 03:20:18.031352 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.031330 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p5fc9" Jun 03 03:20:18.038876 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:18.038852 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b86af7_646d_4288_9773_965f3ef2ac98.slice/crio-7111a96001a8bdd10db88cbe8de06fe000919a548b98bec099617797ab6e67b2 WatchSource:0}: Error finding container 7111a96001a8bdd10db88cbe8de06fe000919a548b98bec099617797ab6e67b2: Status 404 returned error can't find the container with id 7111a96001a8bdd10db88cbe8de06fe000919a548b98bec099617797ab6e67b2 Jun 03 03:20:18.049433 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.049412 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rkbr5" Jun 03 03:20:18.055251 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:18.055221 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4801abc1_ec7f_43ab_a2e1_2cbac19f58cb.slice/crio-cb10198c365109fd981bb784426fbc6cec0183205c6b0e96e1c0ff1e509daa9c WatchSource:0}: Error finding container cb10198c365109fd981bb784426fbc6cec0183205c6b0e96e1c0ff1e509daa9c: Status 404 returned error can't find the container with id cb10198c365109fd981bb784426fbc6cec0183205c6b0e96e1c0ff1e509daa9c Jun 03 03:20:18.077531 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.077510 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kkw69" Jun 03 03:20:18.083432 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:18.083407 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a178226_0867_48c5_a3a6_098104eb77e4.slice/crio-8e97ac5e88aa4d07ec8d71f335cc43474aae14392ac3f9b019c9ea67bae5ff28 WatchSource:0}: Error finding container 8e97ac5e88aa4d07ec8d71f335cc43474aae14392ac3f9b019c9ea67bae5ff28: Status 404 returned error can't find the container with id 8e97ac5e88aa4d07ec8d71f335cc43474aae14392ac3f9b019c9ea67bae5ff28 Jun 03 03:20:18.084818 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.084804 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:18.090625 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:18.090596 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aa8e984_793a_41cf_81a8_6b25a478ada3.slice/crio-5aa3cecdcdafc01e45632a582971030b62a5f49aec4399cc7218ff086d84c777 WatchSource:0}: Error finding container 5aa3cecdcdafc01e45632a582971030b62a5f49aec4399cc7218ff086d84c777: Status 404 returned error can't find the container with id 5aa3cecdcdafc01e45632a582971030b62a5f49aec4399cc7218ff086d84c777 Jun 03 03:20:18.095900 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.095877 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9cklm" Jun 03 03:20:18.100452 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.100437 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" Jun 03 03:20:18.102577 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:18.102532 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e80cc4_7c78_4606_a320_d3cc0ac6452a.slice/crio-6d0bf1138d5439210e046e5c07a87b46a8627f73516a7e878f62cccfbf340d64 WatchSource:0}: Error finding container 6d0bf1138d5439210e046e5c07a87b46a8627f73516a7e878f62cccfbf340d64: Status 404 returned error can't find the container with id 6d0bf1138d5439210e046e5c07a87b46a8627f73516a7e878f62cccfbf340d64 Jun 03 03:20:18.107487 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:18.107467 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308df474_5a5d_4432_8e04_e462f1e4cb53.slice/crio-0861f327e9fdbc4307f379d311dbfafa2460cd642475544708a905ffa03c87c3 WatchSource:0}: Error finding container 0861f327e9fdbc4307f379d311dbfafa2460cd642475544708a905ffa03c87c3: Status 404 returned error can't find the container with id 0861f327e9fdbc4307f379d311dbfafa2460cd642475544708a905ffa03c87c3 Jun 03 03:20:18.177995 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.177914 2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:18.287166 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.287123 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs\") pod \"network-metrics-daemon-trw96\" (UID: \"0085db10-4407-48e2-b27f-2abf8391ee43\") " pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:18.287350 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:18.287269 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:18.287350 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:18.287346 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs podName:0085db10-4407-48e2-b27f-2abf8391ee43 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:19.287327239 +0000 UTC m=+3.128908850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs") pod "network-metrics-daemon-trw96" (UID: "0085db10-4407-48e2-b27f-2abf8391ee43") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:18.388163 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.388129 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bx448\" (UniqueName: \"kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448\") pod \"network-check-target-vsqpb\" (UID: \"5316cd63-ebbf-456a-99d6-a20a009eeeac\") " pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:18.388330 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:18.388307 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:18.388330 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:18.388330 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:18.388440 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:18.388343 2575 projected.go:194] Error preparing data for projected volume kube-api-access-bx448 for pod openshift-network-diagnostics/network-check-target-vsqpb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:18.388440 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:18.388411 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448 podName:5316cd63-ebbf-456a-99d6-a20a009eeeac nodeName:}" failed. No retries permitted until 2026-06-03 03:20:19.388390941 +0000 UTC m=+3.229972550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bx448" (UniqueName: "kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448") pod "network-check-target-vsqpb" (UID: "5316cd63-ebbf-456a-99d6-a20a009eeeac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:18.706569 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.706512 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 03:15:17 +0000 UTC" deadline="2028-02-29 09:22:20.302389232 +0000 UTC" Jun 03 03:20:18.706569 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.706567 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15270h2m1.595825942s" Jun 03 03:20:18.767598 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.767371 2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:18.780910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.780787 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:18.780910 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:18.780904 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:18.798318 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.798277 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" event={"ID":"308df474-5a5d-4432-8e04-e462f1e4cb53","Type":"ContainerStarted","Data":"0861f327e9fdbc4307f379d311dbfafa2460cd642475544708a905ffa03c87c3"} Jun 03 03:20:18.805510 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.805451 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9cklm" event={"ID":"70e80cc4-7c78-4606-a320-d3cc0ac6452a","Type":"ContainerStarted","Data":"6d0bf1138d5439210e046e5c07a87b46a8627f73516a7e878f62cccfbf340d64"} Jun 03 03:20:18.814811 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.814752 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" event={"ID":"8aa8e984-793a-41cf-81a8-6b25a478ada3","Type":"ContainerStarted","Data":"5aa3cecdcdafc01e45632a582971030b62a5f49aec4399cc7218ff086d84c777"} Jun 03 03:20:18.817273 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.817226 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kkw69" event={"ID":"9a178226-0867-48c5-a3a6-098104eb77e4","Type":"ContainerStarted","Data":"8e97ac5e88aa4d07ec8d71f335cc43474aae14392ac3f9b019c9ea67bae5ff28"} Jun 03 03:20:18.829909 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.829871 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rkbr5" event={"ID":"4801abc1-ec7f-43ab-a2e1-2cbac19f58cb","Type":"ContainerStarted","Data":"cb10198c365109fd981bb784426fbc6cec0183205c6b0e96e1c0ff1e509daa9c"} Jun 03 03:20:18.835711 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.835667 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p5fc9" event={"ID":"90b86af7-646d-4288-9773-965f3ef2ac98","Type":"ContainerStarted","Data":"7111a96001a8bdd10db88cbe8de06fe000919a548b98bec099617797ab6e67b2"} Jun 03 03:20:18.846769 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.846724 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5fkcf" event={"ID":"6bc4f112-f25e-439c-b288-0788f935ade9","Type":"ContainerStarted","Data":"13cdad7459d2d174a5a41bc71283a248e9663855667931ec98fe8d5bbfa503cb"} Jun 03 03:20:18.855367 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.855326 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ndjrl" event={"ID":"dbb3a2ed-ce99-479a-979b-4968e52096ce","Type":"ContainerStarted","Data":"000973329f99f46cbac22cfe3629df3a5d804cfeb056428794ef2daa4139295d"} Jun 03 03:20:18.859443 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.859407 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" event={"ID":"3aa52479-3df9-4b2a-a0df-df97785477a5","Type":"ContainerStarted","Data":"9df8480e5c3b1c50abedc9d041a7b3682dac74210aab0c38ee0588b349d5a00e"} Jun 03 03:20:18.975489 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:18.975406 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:19.215062 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:19.215028 2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 03:20:19.294276 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:19.294239 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs\") pod \"network-metrics-daemon-trw96\" (UID: \"0085db10-4407-48e2-b27f-2abf8391ee43\") " pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:19.294462 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:19.294442 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:19.294541 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:19.294513 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs podName:0085db10-4407-48e2-b27f-2abf8391ee43 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:21.29449509 +0000 UTC m=+5.136076694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs") pod "network-metrics-daemon-trw96" (UID: "0085db10-4407-48e2-b27f-2abf8391ee43") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:19.396765 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:19.396102 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bx448\" (UniqueName: \"kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448\") pod \"network-check-target-vsqpb\" (UID: \"5316cd63-ebbf-456a-99d6-a20a009eeeac\") " pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:19.396765 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:19.396272 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:19.396765 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:19.396293 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:19.396765 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:19.396305 2575 projected.go:194] Error preparing data for projected volume kube-api-access-bx448 for pod openshift-network-diagnostics/network-check-target-vsqpb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:19.396765 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:19.396367 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448 podName:5316cd63-ebbf-456a-99d6-a20a009eeeac nodeName:}" failed. No retries permitted until 2026-06-03 03:20:21.39634883 +0000 UTC m=+5.237930432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bx448" (UniqueName: "kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448") pod "network-check-target-vsqpb" (UID: "5316cd63-ebbf-456a-99d6-a20a009eeeac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:19.709886 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:19.709763 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 03:15:17 +0000 UTC" deadline="2028-02-20 06:08:41.113018992 +0000 UTC" Jun 03 03:20:19.709886 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:19.709804 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15050h48m21.403218176s" Jun 03 03:20:19.778519 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:19.777997 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:19.778519 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:19.778150 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:20.782943 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:20.782908 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:20.783658 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:20.783035 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:21.312484 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:21.312421 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs\") pod \"network-metrics-daemon-trw96\" (UID: \"0085db10-4407-48e2-b27f-2abf8391ee43\") " pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:21.312670 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:21.312606 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:21.312744 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:21.312673 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs podName:0085db10-4407-48e2-b27f-2abf8391ee43 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:25.312653413 +0000 UTC m=+9.154235012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs") pod "network-metrics-daemon-trw96" (UID: "0085db10-4407-48e2-b27f-2abf8391ee43") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:21.412948 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:21.412905 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bx448\" (UniqueName: \"kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448\") pod \"network-check-target-vsqpb\" (UID: \"5316cd63-ebbf-456a-99d6-a20a009eeeac\") " pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:21.413207 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:21.413121 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:21.413207 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:21.413138 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:21.413207 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:21.413148 2575 projected.go:194] Error preparing data for projected volume kube-api-access-bx448 for pod openshift-network-diagnostics/network-check-target-vsqpb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:21.413207 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:21.413206 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448 podName:5316cd63-ebbf-456a-99d6-a20a009eeeac nodeName:}" failed. No retries permitted until 2026-06-03 03:20:25.413184102 +0000 UTC m=+9.254765699 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bx448" (UniqueName: "kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448") pod "network-check-target-vsqpb" (UID: "5316cd63-ebbf-456a-99d6-a20a009eeeac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:21.778422 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:21.778385 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:21.778614 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:21.778538 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:22.782119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:22.782090 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:22.782636 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:22.782215 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:23.778982 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:23.778436 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:23.778982 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:23.778604 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:24.778426 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:24.778389 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:24.778902 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:24.778529 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:25.344189 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:25.344150 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs\") pod \"network-metrics-daemon-trw96\" (UID: \"0085db10-4407-48e2-b27f-2abf8391ee43\") " pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:25.344367 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:25.344316 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:25.344409 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:25.344382 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs podName:0085db10-4407-48e2-b27f-2abf8391ee43 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:33.344361388 +0000 UTC m=+17.185942990 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs") pod "network-metrics-daemon-trw96" (UID: "0085db10-4407-48e2-b27f-2abf8391ee43") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:25.444855 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:25.444809 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bx448\" (UniqueName: \"kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448\") pod \"network-check-target-vsqpb\" (UID: \"5316cd63-ebbf-456a-99d6-a20a009eeeac\") " pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:25.445031 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:25.444963 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:25.445031 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:25.444981 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:25.445031 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:25.444990 2575 projected.go:194] Error preparing data for projected volume kube-api-access-bx448 for pod openshift-network-diagnostics/network-check-target-vsqpb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:25.445202 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:25.445055 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448 podName:5316cd63-ebbf-456a-99d6-a20a009eeeac nodeName:}" failed. No retries permitted until 2026-06-03 03:20:33.445042589 +0000 UTC m=+17.286624185 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bx448" (UniqueName: "kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448") pod "network-check-target-vsqpb" (UID: "5316cd63-ebbf-456a-99d6-a20a009eeeac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:25.639613 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:25.639522 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-n6xjh"] Jun 03 03:20:25.641694 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:25.641671 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:25.641841 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:25.641759 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6xjh" podUID="ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27" Jun 03 03:20:25.747875 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:25.747836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-kubelet-config\") pod \"global-pull-secret-syncer-n6xjh\" (UID: \"ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27\") " pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:25.748029 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:25.747911 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-dbus\") pod \"global-pull-secret-syncer-n6xjh\" (UID: \"ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27\") " pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:25.748029 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:25.747942 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret\") pod \"global-pull-secret-syncer-n6xjh\" (UID: \"ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27\") " pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:25.777782 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:25.777746 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:25.777956 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:25.777870 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:25.849099 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:25.849064 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-kubelet-config\") pod \"global-pull-secret-syncer-n6xjh\" (UID: \"ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27\") " pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:25.849579 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:25.849127 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-dbus\") pod \"global-pull-secret-syncer-n6xjh\" (UID: \"ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27\") " pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:25.849579 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:25.849151 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret\") pod \"global-pull-secret-syncer-n6xjh\" (UID: \"ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27\") " pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:25.849579 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:25.849322 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 03:20:25.849579 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:25.849392 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret podName:ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:26.349371713 +0000 UTC m=+10.190953325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret") pod "global-pull-secret-syncer-n6xjh" (UID: "ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27") : object "kube-system"/"original-pull-secret" not registered Jun 03 03:20:25.849796 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:25.849660 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-kubelet-config\") pod \"global-pull-secret-syncer-n6xjh\" (UID: \"ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27\") " pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:25.849796 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:25.849734 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-dbus\") pod \"global-pull-secret-syncer-n6xjh\" (UID: \"ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27\") " pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:26.353331 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:26.353253 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret\") pod \"global-pull-secret-syncer-n6xjh\" (UID: \"ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27\") " pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:26.353532 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:26.353434 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 03:20:26.353532 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:26.353515 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret podName:ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:27.353492895 +0000 UTC m=+11.195074496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret") pod "global-pull-secret-syncer-n6xjh" (UID: "ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27") : object "kube-system"/"original-pull-secret" not registered Jun 03 03:20:26.778775 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:26.778735 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:26.778937 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:26.778875 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:27.360831 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:27.360792 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret\") pod \"global-pull-secret-syncer-n6xjh\" (UID: \"ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27\") " pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:27.361291 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:27.360954 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 03:20:27.361291 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:27.361039 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret podName:ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:29.361024384 +0000 UTC m=+13.202605997 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret") pod "global-pull-secret-syncer-n6xjh" (UID: "ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27") : object "kube-system"/"original-pull-secret" not registered Jun 03 03:20:27.778493 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:27.778446 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:27.778678 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:27.778617 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6xjh" podUID="ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27" Jun 03 03:20:27.778678 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:27.778458 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:27.778814 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:27.778775 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:28.778321 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:28.778280 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:28.778774 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:28.778418 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:29.373695 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:29.373604 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret\") pod \"global-pull-secret-syncer-n6xjh\" (UID: \"ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27\") " pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:29.373843 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:29.373732 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 03:20:29.373843 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:29.373786 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret podName:ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:33.373773011 +0000 UTC m=+17.215354619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret") pod "global-pull-secret-syncer-n6xjh" (UID: "ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27") : object "kube-system"/"original-pull-secret" not registered Jun 03 03:20:29.778200 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:29.778169 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:29.778372 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:29.778175 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:29.778372 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:29.778300 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6xjh" podUID="ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27" Jun 03 03:20:29.778807 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:29.778386 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:30.778388 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:30.778349 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:30.778877 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:30.778483 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:31.778420 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:31.778372 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:31.778859 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:31.778372 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:31.778859 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:31.778569 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6xjh" podUID="ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27" Jun 03 03:20:31.778859 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:31.778569 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:32.778543 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:32.778506 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:32.778996 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:32.778646 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:33.403257 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:33.403212 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs\") pod \"network-metrics-daemon-trw96\" (UID: \"0085db10-4407-48e2-b27f-2abf8391ee43\") " pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:33.403499 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:33.403272 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret\") pod \"global-pull-secret-syncer-n6xjh\" (UID: \"ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27\") " pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:33.403499 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:33.403349 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:33.403499 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:33.403392 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 03:20:33.403499 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:33.403432 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs podName:0085db10-4407-48e2-b27f-2abf8391ee43 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:49.403412623 +0000 UTC m=+33.244994234 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs") pod "network-metrics-daemon-trw96" (UID: "0085db10-4407-48e2-b27f-2abf8391ee43") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:33.403499 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:33.403455 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret podName:ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:41.403444752 +0000 UTC m=+25.245026352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret") pod "global-pull-secret-syncer-n6xjh" (UID: "ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27") : object "kube-system"/"original-pull-secret" not registered Jun 03 03:20:33.504479 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:33.504435 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bx448\" (UniqueName: \"kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448\") pod \"network-check-target-vsqpb\" (UID: \"5316cd63-ebbf-456a-99d6-a20a009eeeac\") " pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:33.504677 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:33.504652 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:33.504677 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:33.504671 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:33.504782 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:33.504685 2575 projected.go:194] Error preparing data for projected volume kube-api-access-bx448 for pod openshift-network-diagnostics/network-check-target-vsqpb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:33.504782 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:33.504742 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448 podName:5316cd63-ebbf-456a-99d6-a20a009eeeac nodeName:}" failed. No retries permitted until 2026-06-03 03:20:49.504722782 +0000 UTC m=+33.346304379 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bx448" (UniqueName: "kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448") pod "network-check-target-vsqpb" (UID: "5316cd63-ebbf-456a-99d6-a20a009eeeac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:33.778467 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:33.778434 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:33.778664 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:33.778489 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:33.778664 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:33.778589 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6xjh" podUID="ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27" Jun 03 03:20:33.779036 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:33.778706 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:34.778637 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:34.778601 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:34.778828 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:34.778736 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:35.777722 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:35.777685 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:35.777984 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:35.777694 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:35.777984 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:35.777826 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6xjh" podUID="ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27" Jun 03 03:20:35.777984 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:35.777879 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:36.779077 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:36.779037 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:36.779476 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:36.779159 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:37.778340 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:37.778078 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:37.778340 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:37.778224 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:37.778663 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:37.778077 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:37.778747 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:37.778721 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6xjh" podUID="ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27" Jun 03 03:20:37.904276 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:37.903754 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p5fc9" event={"ID":"90b86af7-646d-4288-9773-965f3ef2ac98","Type":"ContainerStarted","Data":"edcb10bddeb3e19deaa736961f3b5ffda84cee8a858f16571cea1f27f65de777"} Jun 03 03:20:37.905172 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:37.905147 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-55.ec2.internal" event={"ID":"9e6a6970212cff9ea79f77794f10d402","Type":"ContainerStarted","Data":"6e91e09564acb289dda55549fd38e02f7a0f587219544ed1eb8d05b93dcd6419"} Jun 03 03:20:37.906595 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:37.906573 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" event={"ID":"3aa52479-3df9-4b2a-a0df-df97785477a5","Type":"ContainerStarted","Data":"75b37cca3fc7bfa24ca513667d4cf64779e75e064245df4bbf9ed2540fd5c4b0"} Jun 03 03:20:37.930679 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:37.930387 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-p5fc9" podStartSLOduration=1.318385736 podStartE2EDuration="20.930368197s" podCreationTimestamp="2026-06-03 03:20:17 +0000 UTC" firstStartedPulling="2026-06-03 03:20:18.040452839 +0000 UTC m=+1.882034437" lastFinishedPulling="2026-06-03 03:20:37.652435297 +0000 UTC m=+21.494016898" observedRunningTime="2026-06-03 03:20:37.917508324 +0000 UTC m=+21.759089938" watchObservedRunningTime="2026-06-03 03:20:37.930368197 +0000 UTC m=+21.771949813" Jun 03 03:20:37.935730 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:37.935403 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wqt9g" podStartSLOduration=2.319265972 podStartE2EDuration="21.935382185s" podCreationTimestamp="2026-06-03 03:20:16 +0000 UTC" firstStartedPulling="2026-06-03 03:20:18.026976125 +0000 UTC m=+1.868557723" lastFinishedPulling="2026-06-03 03:20:37.643092327 +0000 UTC m=+21.484673936" observedRunningTime="2026-06-03 03:20:37.930339766 +0000 UTC m=+21.771921385" watchObservedRunningTime="2026-06-03 03:20:37.935382185 +0000 UTC m=+21.776963802" Jun 03 03:20:37.944827 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:37.944693 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-55.ec2.internal" podStartSLOduration=20.944671719 podStartE2EDuration="20.944671719s" podCreationTimestamp="2026-06-03 03:20:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:20:37.944511053 +0000 UTC m=+21.786092669" watchObservedRunningTime="2026-06-03 03:20:37.944671719 +0000 UTC m=+21.786253337" Jun 03 03:20:38.778257 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.778056 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:38.778454 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:38.778325 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:38.910310 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.910270 2575 generic.go:358] "Generic (PLEG): container finished" podID="a6d08139769a8777bdfc7de0fef4e9c3" containerID="ba9593811d7b7e8f09a4aadcf0f72a6b94ce420a0c9e472452f164a19d7aad87" exitCode=0 Jun 03 03:20:38.910978 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.910365 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal" event={"ID":"a6d08139769a8777bdfc7de0fef4e9c3","Type":"ContainerDied","Data":"ba9593811d7b7e8f09a4aadcf0f72a6b94ce420a0c9e472452f164a19d7aad87"} Jun 03 03:20:38.911947 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.911906 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" event={"ID":"308df474-5a5d-4432-8e04-e462f1e4cb53","Type":"ContainerStarted","Data":"45c8687048170ca13818f911627338de0af5bb42863cafc0300fb2dca224f171"} Jun 03 03:20:38.914513 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.913643 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9cklm" event={"ID":"70e80cc4-7c78-4606-a320-d3cc0ac6452a","Type":"ContainerStarted","Data":"2f04ce7dfae7af153873295b9c19377a0371c13156a914f93019b61efcb6c6c2"} Jun 03 03:20:38.917957 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.917935 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:20:38.918294 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.918270 2575 generic.go:358] "Generic (PLEG): container finished" podID="8aa8e984-793a-41cf-81a8-6b25a478ada3" containerID="65e1f1ffdc86667bbae74ebfde4ca4d7a3077c36b3eecef9380a0a0a54504a0e" exitCode=1 Jun 03 03:20:38.918416 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.918339 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" event={"ID":"8aa8e984-793a-41cf-81a8-6b25a478ada3","Type":"ContainerStarted","Data":"e07e56e82b977956f4fdd61d3dbf51a5a6ef04b3e0183d41e43d91791a5ed845"} Jun 03 03:20:38.918416 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.918367 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" event={"ID":"8aa8e984-793a-41cf-81a8-6b25a478ada3","Type":"ContainerStarted","Data":"71ba07e38c280152e8eb7b23c64cf54497d3275035f16460d135a5acd19d7a45"} Jun 03 03:20:38.918416 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.918384 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" event={"ID":"8aa8e984-793a-41cf-81a8-6b25a478ada3","Type":"ContainerStarted","Data":"04eabb88c0f29d81a7c9a1aa65d379bcf2cdd66f2ec88257596c2b4b31eebe6b"} Jun 03 03:20:38.918416 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.918395 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" event={"ID":"8aa8e984-793a-41cf-81a8-6b25a478ada3","Type":"ContainerStarted","Data":"457636b1c089952aa2db5a62cab56d86540433f7c4f5350eb0d77ae59aad748b"} Jun 03 03:20:38.918604 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.918407 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" event={"ID":"8aa8e984-793a-41cf-81a8-6b25a478ada3","Type":"ContainerDied","Data":"65e1f1ffdc86667bbae74ebfde4ca4d7a3077c36b3eecef9380a0a0a54504a0e"} Jun 03 03:20:38.918604 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.918454 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" event={"ID":"8aa8e984-793a-41cf-81a8-6b25a478ada3","Type":"ContainerStarted","Data":"68d1d7d1808eba3f5933302670c3ecb484bec1bce655487c6edbfb14370fafe1"} Jun 03 03:20:38.919733 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.919708 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rkbr5" event={"ID":"4801abc1-ec7f-43ab-a2e1-2cbac19f58cb","Type":"ContainerStarted","Data":"aec2fdc707c3d02247c3e01685f2ca20a0d83545dc2252fe5bea5c0422b09586"} Jun 03 03:20:38.921761 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.921220 2575 generic.go:358] "Generic (PLEG): container finished" podID="6bc4f112-f25e-439c-b288-0788f935ade9" containerID="c2e850314dd52a62a73b2b127a1ec126be38c0e59301cb3e75c0c666c4cdfef3" exitCode=0 Jun 03 03:20:38.921761 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.921317 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5fkcf" event={"ID":"6bc4f112-f25e-439c-b288-0788f935ade9","Type":"ContainerDied","Data":"c2e850314dd52a62a73b2b127a1ec126be38c0e59301cb3e75c0c666c4cdfef3"} Jun 03 03:20:38.922667 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.922586 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ndjrl" event={"ID":"dbb3a2ed-ce99-479a-979b-4968e52096ce","Type":"ContainerStarted","Data":"4d6ac304882b5ae29a060acdde86540cab41d2635397c8ec9fb3b296a7fc60e6"} Jun 03 03:20:38.997029 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.996982 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ndjrl" podStartSLOduration=3.369582313 podStartE2EDuration="22.996967372s" podCreationTimestamp="2026-06-03 03:20:16 +0000 UTC" firstStartedPulling="2026-06-03 03:20:17.992820085 +0000 UTC m=+1.834401695" lastFinishedPulling="2026-06-03 03:20:37.620205157 +0000 UTC m=+21.461786754" observedRunningTime="2026-06-03 03:20:38.996798586 +0000 UTC m=+22.838380204" watchObservedRunningTime="2026-06-03 03:20:38.996967372 +0000 UTC m=+22.838548989" Jun 03 03:20:38.997423 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:38.997393 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rkbr5" podStartSLOduration=10.826710165 podStartE2EDuration="21.997384727s" podCreationTimestamp="2026-06-03 03:20:17 +0000 UTC" firstStartedPulling="2026-06-03 03:20:18.056727508 +0000 UTC m=+1.898309109" lastFinishedPulling="2026-06-03 03:20:29.227402076 +0000 UTC m=+13.068983671" observedRunningTime="2026-06-03 03:20:38.972202641 +0000 UTC m=+22.813784256" watchObservedRunningTime="2026-06-03 03:20:38.997384727 +0000 UTC m=+22.838966347" Jun 03 03:20:39.011089 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:39.011032 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-9cklm" podStartSLOduration=2.49520781 podStartE2EDuration="22.01101502s" podCreationTimestamp="2026-06-03 03:20:17 +0000 UTC" firstStartedPulling="2026-06-03 03:20:18.104360025 +0000 UTC m=+1.945941620" lastFinishedPulling="2026-06-03 03:20:37.620167234 +0000 UTC m=+21.461748830" observedRunningTime="2026-06-03 03:20:39.010763291 +0000 UTC m=+22.852344909" watchObservedRunningTime="2026-06-03 03:20:39.01101502 +0000 UTC m=+22.852596638" Jun 03 03:20:39.778827 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:39.778616 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:39.778991 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:39.778953 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:39.778991 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:39.778628 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:39.779133 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:39.779066 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6xjh" podUID="ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27" Jun 03 03:20:39.816971 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:39.816944 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 03:20:39.926990 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:39.926940 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" event={"ID":"308df474-5a5d-4432-8e04-e462f1e4cb53","Type":"ContainerStarted","Data":"9b495a146328a9522f3b7b2e540d249180809c88a842f68ed1d924c435cf7757"} Jun 03 03:20:39.928426 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:39.928395 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kkw69" event={"ID":"9a178226-0867-48c5-a3a6-098104eb77e4","Type":"ContainerStarted","Data":"98e972879336cf0c332ce178302fc483fea30c0ec2f77d8be33deeb128b4cdd9"} Jun 03 03:20:39.930409 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:39.930372 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal" event={"ID":"a6d08139769a8777bdfc7de0fef4e9c3","Type":"ContainerStarted","Data":"c8df2cd6b3bd4844d7b41fb883380993bdd2ce2e8368536ef8e272f884b131bd"} Jun 03 03:20:39.955632 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:39.955517 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kkw69" podStartSLOduration=3.79895321 podStartE2EDuration="22.95550372s" podCreationTimestamp="2026-06-03 03:20:17 +0000 UTC" firstStartedPulling="2026-06-03 03:20:18.084873919 +0000 UTC m=+1.926455514" lastFinishedPulling="2026-06-03 03:20:37.241424409 +0000 UTC m=+21.083006024" observedRunningTime="2026-06-03 03:20:39.943597153 +0000 UTC m=+23.785178770" watchObservedRunningTime="2026-06-03 03:20:39.95550372 +0000 UTC m=+23.797085337" Jun 03 03:20:39.955946 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:39.955922 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-55.ec2.internal" podStartSLOduration=22.955916659 podStartE2EDuration="22.955916659s" podCreationTimestamp="2026-06-03 03:20:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:20:39.955640618 +0000 UTC m=+23.797222256" watchObservedRunningTime="2026-06-03 03:20:39.955916659 +0000 UTC m=+23.797498274" Jun 03 03:20:40.743038 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:40.742920 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T03:20:39.816968909Z","UUID":"4882d694-3e1e-4b74-b195-534f3e87c4ae","Handler":null,"Name":"","Endpoint":""} Jun 03 03:20:40.744601 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:40.744581 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 03:20:40.744601 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:40.744605 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 03:20:40.778488 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:40.778451 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:40.778669 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:40.778566 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:40.934903 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:40.934843 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:20:40.935436 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:40.935208 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" event={"ID":"8aa8e984-793a-41cf-81a8-6b25a478ada3","Type":"ContainerStarted","Data":"40f4e69a2c185cd9e8563315375385bfad019c1fbe4bd0937402f8850ac6d71f"} Jun 03 03:20:41.024086 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:41.024053 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ndjrl" Jun 03 03:20:41.024734 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:41.024701 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ndjrl" Jun 03 03:20:41.463245 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:41.463207 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret\") pod \"global-pull-secret-syncer-n6xjh\" (UID: \"ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27\") " pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:41.463413 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:41.463334 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 03:20:41.463413 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:41.463396 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret podName:ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:57.463377208 +0000 UTC m=+41.304958806 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret") pod "global-pull-secret-syncer-n6xjh" (UID: "ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27") : object "kube-system"/"original-pull-secret" not registered Jun 03 03:20:41.778545 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:41.778512 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:41.778722 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:41.778583 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:41.778722 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:41.778672 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6xjh" podUID="ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27" Jun 03 03:20:41.778875 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:41.778831 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:41.939157 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:41.939111 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" event={"ID":"308df474-5a5d-4432-8e04-e462f1e4cb53","Type":"ContainerStarted","Data":"ffe1dfa6ece178f7f14443ea5de408d1e2f896a27f4d492d360f774914d91713"} Jun 03 03:20:41.954306 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:41.954256 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bvqtc" podStartSLOduration=2.021680826 podStartE2EDuration="24.954239545s" podCreationTimestamp="2026-06-03 03:20:17 +0000 UTC" firstStartedPulling="2026-06-03 03:20:18.109029608 +0000 UTC m=+1.950611204" lastFinishedPulling="2026-06-03 03:20:41.041588326 +0000 UTC m=+24.883169923" observedRunningTime="2026-06-03 03:20:41.954037269 +0000 UTC m=+25.795618901" watchObservedRunningTime="2026-06-03 03:20:41.954239545 +0000 UTC m=+25.795821162" Jun 03 03:20:42.778205 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:42.778164 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:42.778358 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:42.778295 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:43.778670 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:43.778629 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:43.779121 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:43.778765 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6xjh" podUID="ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27" Jun 03 03:20:43.779121 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:43.778629 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:43.779200 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:43.779117 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:44.778194 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:44.778018 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:44.778399 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:44.778271 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:44.951371 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:44.951343 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:20:44.951830 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:44.951647 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" event={"ID":"8aa8e984-793a-41cf-81a8-6b25a478ada3","Type":"ContainerStarted","Data":"a8ae7a04949921223ed113bf08df42c4f60a7ba5df0a4b7c07f9844d86bc8e2c"} Jun 03 03:20:44.951973 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:44.951954 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:44.952206 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:44.952184 2575 scope.go:117] "RemoveContainer" containerID="65e1f1ffdc86667bbae74ebfde4ca4d7a3077c36b3eecef9380a0a0a54504a0e" Jun 03 03:20:44.953388 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:44.953354 2575 generic.go:358] "Generic (PLEG): container finished" podID="6bc4f112-f25e-439c-b288-0788f935ade9" containerID="b9392985bb263aa50afb1d64b0fcde9a565327e6a9fd01b58b86060d4fd4e3d3" exitCode=0 Jun 03 03:20:44.953457 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:44.953383 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5fkcf" event={"ID":"6bc4f112-f25e-439c-b288-0788f935ade9","Type":"ContainerDied","Data":"b9392985bb263aa50afb1d64b0fcde9a565327e6a9fd01b58b86060d4fd4e3d3"} Jun 03 03:20:44.969044 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:44.969023 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:45.574863 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:45.574821 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ndjrl" Jun 03 03:20:45.575056 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:45.574981 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 03:20:45.575534 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:45.575462 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ndjrl" Jun 03 03:20:45.777842 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:45.777809 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:45.778032 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:45.777818 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:45.778032 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:45.777947 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6xjh" podUID="ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27" Jun 03 03:20:45.778032 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:45.777999 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:45.959674 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:45.959601 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:20:45.960028 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:45.959961 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" event={"ID":"8aa8e984-793a-41cf-81a8-6b25a478ada3","Type":"ContainerStarted","Data":"e1a1185c421cd602c14382b56e13d3a39a28920d22eb86dd84048fde4eebf1af"} Jun 03 03:20:45.960175 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:45.960155 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:45.960263 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:45.960185 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:45.975722 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:45.975691 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:20:45.982380 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:45.982334 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" podStartSLOduration=9.224095931 podStartE2EDuration="28.982320663s" podCreationTimestamp="2026-06-03 03:20:17 +0000 UTC" firstStartedPulling="2026-06-03 03:20:18.092153578 +0000 UTC m=+1.933735173" lastFinishedPulling="2026-06-03 03:20:37.850378306 +0000 UTC m=+21.691959905" observedRunningTime="2026-06-03 03:20:45.981928188 +0000 UTC m=+29.823509807" watchObservedRunningTime="2026-06-03 03:20:45.982320663 +0000 UTC m=+29.823902319" Jun 03 03:20:46.289119 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:46.289085 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n6xjh"] Jun 03 03:20:46.289287 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:46.289230 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:46.289368 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:46.289340 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6xjh" podUID="ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27" Jun 03 03:20:46.290116 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:46.290090 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vsqpb"] Jun 03 03:20:46.290258 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:46.290244 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:46.290355 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:46.290338 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:46.292630 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:46.292607 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-trw96"] Jun 03 03:20:46.292728 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:46.292697 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:46.292803 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:46.292787 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:46.963957 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:46.963926 2575 generic.go:358] "Generic (PLEG): container finished" podID="6bc4f112-f25e-439c-b288-0788f935ade9" containerID="365d49987000c218213c2b0d03acaf9c51147a8d3dc187189cd535b48646a32f" exitCode=0 Jun 03 03:20:46.964408 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:46.964020 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5fkcf" event={"ID":"6bc4f112-f25e-439c-b288-0788f935ade9","Type":"ContainerDied","Data":"365d49987000c218213c2b0d03acaf9c51147a8d3dc187189cd535b48646a32f"} Jun 03 03:20:47.778445 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:47.778405 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:47.778620 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:47.778456 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:47.778620 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:47.778534 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:47.778620 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:47.778580 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6xjh" podUID="ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27" Jun 03 03:20:47.778757 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:47.778622 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:47.778757 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:47.778707 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:48.969706 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:48.969624 2575 generic.go:358] "Generic (PLEG): container finished" podID="6bc4f112-f25e-439c-b288-0788f935ade9" containerID="88a352ec8b8504c01ee39bbb01b6489e4eed8424f49885881ddfde9098193569" exitCode=0 Jun 03 03:20:48.969706 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:48.969670 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5fkcf" event={"ID":"6bc4f112-f25e-439c-b288-0788f935ade9","Type":"ContainerDied","Data":"88a352ec8b8504c01ee39bbb01b6489e4eed8424f49885881ddfde9098193569"} Jun 03 03:20:49.422449 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:49.422410 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs\") pod \"network-metrics-daemon-trw96\" (UID: \"0085db10-4407-48e2-b27f-2abf8391ee43\") " pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:49.422655 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:49.422588 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:49.422698 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:49.422655 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs podName:0085db10-4407-48e2-b27f-2abf8391ee43 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:21.422640308 +0000 UTC m=+65.264221907 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs") pod "network-metrics-daemon-trw96" (UID: "0085db10-4407-48e2-b27f-2abf8391ee43") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 03:20:49.523539 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:49.523502 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bx448\" (UniqueName: \"kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448\") pod \"network-check-target-vsqpb\" (UID: \"5316cd63-ebbf-456a-99d6-a20a009eeeac\") " pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:49.523758 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:49.523692 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 03:20:49.523758 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:49.523716 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 03:20:49.523758 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:49.523732 2575 projected.go:194] Error preparing data for projected volume kube-api-access-bx448 for pod openshift-network-diagnostics/network-check-target-vsqpb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:49.523913 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:49.523799 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448 podName:5316cd63-ebbf-456a-99d6-a20a009eeeac nodeName:}" failed. No retries permitted until 2026-06-03 03:21:21.523779989 +0000 UTC m=+65.365361583 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bx448" (UniqueName: "kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448") pod "network-check-target-vsqpb" (UID: "5316cd63-ebbf-456a-99d6-a20a009eeeac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 03:20:49.778034 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:49.778000 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:49.778234 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:49.778128 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vsqpb" podUID="5316cd63-ebbf-456a-99d6-a20a009eeeac" Jun 03 03:20:49.778234 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:49.778169 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:49.778234 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:49.778224 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6xjh" podUID="ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27" Jun 03 03:20:49.778397 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:49.778261 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:49.778397 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:49.778310 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:20:50.453656 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.453622 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-55.ec2.internal" event="NodeReady" Jun 03 03:20:50.454105 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.453791 2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 03:20:50.484112 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.484072 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn"] Jun 03 03:20:50.508795 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.508765 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75669d8948-dszd5"] Jun 03 03:20:50.508977 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.508943 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" Jun 03 03:20:50.511005 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.510975 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 03:20:50.511365 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.511342 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wrcsp\"" Jun 03 03:20:50.511365 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.511356 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 03:20:50.526919 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.526864 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn"] Jun 03 03:20:50.526919 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.526911 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2s2h7"] Jun 03 03:20:50.527123 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.527008 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.529615 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.529252 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 03:20:50.529615 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.529329 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 03:20:50.529615 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.529360 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-96wwc\"" Jun 03 03:20:50.529833 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.529689 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 03:20:50.533839 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.533819 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 03:20:50.541243 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.541220 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75669d8948-dszd5"] Jun 03 03:20:50.541243 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.541246 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2s2h7"] Jun 03 03:20:50.541421 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.541376 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2s2h7" Jun 03 03:20:50.543904 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.543882 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 03:20:50.543904 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.543904 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 03:20:50.544059 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.543986 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 03:20:50.544130 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.544116 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7jxzs\"" Jun 03 03:20:50.597397 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.596473 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hqjbr"] Jun 03 03:20:50.616301 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.616267 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hqjbr"] Jun 03 03:20:50.616484 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.616346 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hqjbr" Jun 03 03:20:50.618541 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.618515 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 03:20:50.618749 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.618605 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 03:20:50.619013 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.618991 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kzhg4\"" Jun 03 03:20:50.632335 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.632303 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/423d5b41-b980-48e8-865c-3dcb26d8b0af-trusted-ca\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.632463 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.632345 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert\") pod \"ingress-canary-2s2h7\" (UID: \"9338190d-d545-403e-888a-43929db2a9ec\") " pod="openshift-ingress-canary/ingress-canary-2s2h7" Jun 03 03:20:50.632463 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.632370 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/46717f80-0839-4cb3-86d2-db4812b785a0-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-zw6wn\" (UID: \"46717f80-0839-4cb3-86d2-db4812b785a0\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" Jun 03 03:20:50.632463 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.632400 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-zw6wn\" (UID: \"46717f80-0839-4cb3-86d2-db4812b785a0\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" Jun 03 03:20:50.632463 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.632423 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-bound-sa-token\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.632463 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.632440 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/423d5b41-b980-48e8-865c-3dcb26d8b0af-image-registry-private-configuration\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.632677 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.632546 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.632677 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.632601 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gb9z\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-kube-api-access-4gb9z\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.632677 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.632644 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/423d5b41-b980-48e8-865c-3dcb26d8b0af-installation-pull-secrets\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.632677 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.632675 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/423d5b41-b980-48e8-865c-3dcb26d8b0af-ca-trust-extracted\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.632849 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.632710 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2gqv\" (UniqueName: \"kubernetes.io/projected/9338190d-d545-403e-888a-43929db2a9ec-kube-api-access-s2gqv\") pod \"ingress-canary-2s2h7\" (UID: \"9338190d-d545-403e-888a-43929db2a9ec\") " pod="openshift-ingress-canary/ingress-canary-2s2h7" Jun 03 03:20:50.632849 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.632742 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-certificates\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.733380 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.733337 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/423d5b41-b980-48e8-865c-3dcb26d8b0af-installation-pull-secrets\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.733380 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.733387 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65e090c5-86cd-4b86-aca5-0d341af5171b-config-volume\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:20:50.733665 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.733411 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/423d5b41-b980-48e8-865c-3dcb26d8b0af-ca-trust-extracted\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.733665 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.733433 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2gqv\" (UniqueName: \"kubernetes.io/projected/9338190d-d545-403e-888a-43929db2a9ec-kube-api-access-s2gqv\") pod \"ingress-canary-2s2h7\" (UID: \"9338190d-d545-403e-888a-43929db2a9ec\") " pod="openshift-ingress-canary/ingress-canary-2s2h7" Jun 03 03:20:50.733665 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.733450 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65e090c5-86cd-4b86-aca5-0d341af5171b-tmp-dir\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:20:50.733665 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.733507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4kt9\" (UniqueName: \"kubernetes.io/projected/65e090c5-86cd-4b86-aca5-0d341af5171b-kube-api-access-r4kt9\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:20:50.733665 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.733641 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-certificates\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.733872 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.733678 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/423d5b41-b980-48e8-865c-3dcb26d8b0af-trusted-ca\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.733872 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.733706 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert\") pod \"ingress-canary-2s2h7\" (UID: \"9338190d-d545-403e-888a-43929db2a9ec\") " pod="openshift-ingress-canary/ingress-canary-2s2h7" Jun 03 03:20:50.733872 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.733741 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/46717f80-0839-4cb3-86d2-db4812b785a0-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-zw6wn\" (UID: \"46717f80-0839-4cb3-86d2-db4812b785a0\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" Jun 03 03:20:50.733872 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.733772 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-zw6wn\" (UID: \"46717f80-0839-4cb3-86d2-db4812b785a0\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" Jun 03 03:20:50.733872 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.733801 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-bound-sa-token\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.733872 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.733825 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:20:50.733872 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:50.733829 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:20:50.733872 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.733854 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/423d5b41-b980-48e8-865c-3dcb26d8b0af-image-registry-private-configuration\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.734222 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:50.733886 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert podName:9338190d-d545-403e-888a-43929db2a9ec nodeName:}" failed. No retries permitted until 2026-06-03 03:20:51.233866647 +0000 UTC m=+35.075448249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert") pod "ingress-canary-2s2h7" (UID: "9338190d-d545-403e-888a-43929db2a9ec") : secret "canary-serving-cert" not found Jun 03 03:20:50.734222 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.733949 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.734222 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.733976 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4gb9z\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-kube-api-access-4gb9z\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.734378 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:50.734294 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 03:20:50.734378 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:50.734308 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75669d8948-dszd5: secret "image-registry-tls" not found Jun 03 03:20:50.734378 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:50.734348 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls podName:423d5b41-b980-48e8-865c-3dcb26d8b0af nodeName:}" failed. No retries permitted until 2026-06-03 03:20:51.23433572 +0000 UTC m=+35.075917315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls") pod "image-registry-75669d8948-dszd5" (UID: "423d5b41-b980-48e8-865c-3dcb26d8b0af") : secret "image-registry-tls" not found Jun 03 03:20:50.734378 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:50.734371 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 03:20:50.734597 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:50.734445 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert podName:46717f80-0839-4cb3-86d2-db4812b785a0 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:51.234435646 +0000 UTC m=+35.076017255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-zw6wn" (UID: "46717f80-0839-4cb3-86d2-db4812b785a0") : secret "networking-console-plugin-cert" not found Jun 03 03:20:50.734597 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.734517 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/46717f80-0839-4cb3-86d2-db4812b785a0-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-zw6wn\" (UID: \"46717f80-0839-4cb3-86d2-db4812b785a0\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" Jun 03 03:20:50.735585 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.734793 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/423d5b41-b980-48e8-865c-3dcb26d8b0af-ca-trust-extracted\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.735585 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.735122 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-certificates\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.735876 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.735857 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/423d5b41-b980-48e8-865c-3dcb26d8b0af-trusted-ca\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.738190 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.738169 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/423d5b41-b980-48e8-865c-3dcb26d8b0af-image-registry-private-configuration\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.738350 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.738215 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/423d5b41-b980-48e8-865c-3dcb26d8b0af-installation-pull-secrets\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.745447 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.745420 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-bound-sa-token\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.745802 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.745778 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2gqv\" (UniqueName: \"kubernetes.io/projected/9338190d-d545-403e-888a-43929db2a9ec-kube-api-access-s2gqv\") pod \"ingress-canary-2s2h7\" (UID: \"9338190d-d545-403e-888a-43929db2a9ec\") " pod="openshift-ingress-canary/ingress-canary-2s2h7" Jun 03 03:20:50.745900 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.745831 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gb9z\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-kube-api-access-4gb9z\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:50.835357 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.835312 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:20:50.835600 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.835436 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65e090c5-86cd-4b86-aca5-0d341af5171b-config-volume\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:20:50.835600 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.835480 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65e090c5-86cd-4b86-aca5-0d341af5171b-tmp-dir\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:20:50.835600 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:50.835488 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:20:50.835600 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.835505 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r4kt9\" (UniqueName: \"kubernetes.io/projected/65e090c5-86cd-4b86-aca5-0d341af5171b-kube-api-access-r4kt9\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:20:50.835600 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:50.835587 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls podName:65e090c5-86cd-4b86-aca5-0d341af5171b nodeName:}" failed. No retries permitted until 2026-06-03 03:20:51.335547207 +0000 UTC m=+35.177128822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls") pod "dns-default-hqjbr" (UID: "65e090c5-86cd-4b86-aca5-0d341af5171b") : secret "dns-default-metrics-tls" not found Jun 03 03:20:50.835919 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.835897 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65e090c5-86cd-4b86-aca5-0d341af5171b-tmp-dir\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:20:50.836055 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.836036 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65e090c5-86cd-4b86-aca5-0d341af5171b-config-volume\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:20:50.843659 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:50.843622 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4kt9\" (UniqueName: \"kubernetes.io/projected/65e090c5-86cd-4b86-aca5-0d341af5171b-kube-api-access-r4kt9\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:20:51.238898 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:51.238862 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-zw6wn\" (UID: \"46717f80-0839-4cb3-86d2-db4812b785a0\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" Jun 03 03:20:51.239109 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:51.238953 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:51.239109 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:51.239027 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert\") pod \"ingress-canary-2s2h7\" (UID: \"9338190d-d545-403e-888a-43929db2a9ec\") " pod="openshift-ingress-canary/ingress-canary-2s2h7" Jun 03 03:20:51.239109 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:51.239034 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 03:20:51.239109 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:51.239091 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 03:20:51.239109 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:51.239106 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75669d8948-dszd5: secret "image-registry-tls" not found Jun 03 03:20:51.239109 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:51.239112 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert podName:46717f80-0839-4cb3-86d2-db4812b785a0 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:52.239091225 +0000 UTC m=+36.080672839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-zw6wn" (UID: "46717f80-0839-4cb3-86d2-db4812b785a0") : secret "networking-console-plugin-cert" not found Jun 03 03:20:51.239387 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:51.239124 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:20:51.239387 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:51.239153 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls podName:423d5b41-b980-48e8-865c-3dcb26d8b0af nodeName:}" failed. No retries permitted until 2026-06-03 03:20:52.239142412 +0000 UTC m=+36.080724006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls") pod "image-registry-75669d8948-dszd5" (UID: "423d5b41-b980-48e8-865c-3dcb26d8b0af") : secret "image-registry-tls" not found Jun 03 03:20:51.239387 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:51.239176 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert podName:9338190d-d545-403e-888a-43929db2a9ec nodeName:}" failed. No retries permitted until 2026-06-03 03:20:52.239159303 +0000 UTC m=+36.080740915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert") pod "ingress-canary-2s2h7" (UID: "9338190d-d545-403e-888a-43929db2a9ec") : secret "canary-serving-cert" not found Jun 03 03:20:51.340116 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:51.340076 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:20:51.340313 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:51.340240 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:20:51.340372 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:51.340314 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls podName:65e090c5-86cd-4b86-aca5-0d341af5171b nodeName:}" failed. No retries permitted until 2026-06-03 03:20:52.34029732 +0000 UTC m=+36.181878915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls") pod "dns-default-hqjbr" (UID: "65e090c5-86cd-4b86-aca5-0d341af5171b") : secret "dns-default-metrics-tls" not found Jun 03 03:20:51.777837 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:51.777801 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:51.778280 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:51.777805 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:20:51.778280 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:51.777805 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:20:51.780130 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:51.780109 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 03:20:51.780240 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:51.780127 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 03:20:51.780924 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:51.780905 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 03:20:51.781041 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:51.780941 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qcjrn\"" Jun 03 03:20:51.781041 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:51.780961 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bwf2t\"" Jun 03 03:20:51.781041 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:51.781011 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 03:20:52.249473 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:52.249377 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-zw6wn\" (UID: \"46717f80-0839-4cb3-86d2-db4812b785a0\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" Jun 03 03:20:52.249800 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:52.249471 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:52.249800 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:52.249539 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert\") pod \"ingress-canary-2s2h7\" (UID: \"9338190d-d545-403e-888a-43929db2a9ec\") " pod="openshift-ingress-canary/ingress-canary-2s2h7" Jun 03 03:20:52.249800 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:52.249565 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 03:20:52.249800 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:52.249656 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:20:52.249800 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:52.249659 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 03:20:52.249800 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:52.249681 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75669d8948-dszd5: secret "image-registry-tls" not found Jun 03 03:20:52.249800 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:52.249695 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert podName:46717f80-0839-4cb3-86d2-db4812b785a0 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:54.249671867 +0000 UTC m=+38.091253465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-zw6wn" (UID: "46717f80-0839-4cb3-86d2-db4812b785a0") : secret "networking-console-plugin-cert" not found Jun 03 03:20:52.249800 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:52.249718 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert podName:9338190d-d545-403e-888a-43929db2a9ec nodeName:}" failed. No retries permitted until 2026-06-03 03:20:54.249708214 +0000 UTC m=+38.091289815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert") pod "ingress-canary-2s2h7" (UID: "9338190d-d545-403e-888a-43929db2a9ec") : secret "canary-serving-cert" not found Jun 03 03:20:52.249800 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:52.249733 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls podName:423d5b41-b980-48e8-865c-3dcb26d8b0af nodeName:}" failed. No retries permitted until 2026-06-03 03:20:54.249725435 +0000 UTC m=+38.091307043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls") pod "image-registry-75669d8948-dszd5" (UID: "423d5b41-b980-48e8-865c-3dcb26d8b0af") : secret "image-registry-tls" not found Jun 03 03:20:52.350638 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:52.350603 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:20:52.350822 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:52.350773 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:20:52.350886 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:52.350856 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls podName:65e090c5-86cd-4b86-aca5-0d341af5171b nodeName:}" failed. No retries permitted until 2026-06-03 03:20:54.350835007 +0000 UTC m=+38.192416607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls") pod "dns-default-hqjbr" (UID: "65e090c5-86cd-4b86-aca5-0d341af5171b") : secret "dns-default-metrics-tls" not found Jun 03 03:20:54.265756 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.265714 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert\") pod \"ingress-canary-2s2h7\" (UID: \"9338190d-d545-403e-888a-43929db2a9ec\") " pod="openshift-ingress-canary/ingress-canary-2s2h7" Jun 03 03:20:54.266238 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.265777 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-zw6wn\" (UID: \"46717f80-0839-4cb3-86d2-db4812b785a0\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" Jun 03 03:20:54.266238 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.265839 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:54.266238 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:54.265881 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:20:54.266238 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:54.265892 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 03:20:54.266238 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:54.265951 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 03:20:54.266238 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:54.265965 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert podName:9338190d-d545-403e-888a-43929db2a9ec nodeName:}" failed. No retries permitted until 2026-06-03 03:20:58.265944751 +0000 UTC m=+42.107526345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert") pod "ingress-canary-2s2h7" (UID: "9338190d-d545-403e-888a-43929db2a9ec") : secret "canary-serving-cert" not found Jun 03 03:20:54.266238 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:54.265967 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75669d8948-dszd5: secret "image-registry-tls" not found Jun 03 03:20:54.266238 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:54.265986 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert podName:46717f80-0839-4cb3-86d2-db4812b785a0 nodeName:}" failed. No retries permitted until 2026-06-03 03:20:58.265975905 +0000 UTC m=+42.107557499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-zw6wn" (UID: "46717f80-0839-4cb3-86d2-db4812b785a0") : secret "networking-console-plugin-cert" not found Jun 03 03:20:54.266238 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:54.266019 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls podName:423d5b41-b980-48e8-865c-3dcb26d8b0af nodeName:}" failed. No retries permitted until 2026-06-03 03:20:58.266000683 +0000 UTC m=+42.107582315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls") pod "image-registry-75669d8948-dszd5" (UID: "423d5b41-b980-48e8-865c-3dcb26d8b0af") : secret "image-registry-tls" not found Jun 03 03:20:54.366235 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.366197 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:20:54.366418 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:54.366322 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:20:54.366418 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:54.366399 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls podName:65e090c5-86cd-4b86-aca5-0d341af5171b nodeName:}" failed. No retries permitted until 2026-06-03 03:20:58.366380657 +0000 UTC m=+42.207962252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls") pod "dns-default-hqjbr" (UID: "65e090c5-86cd-4b86-aca5-0d341af5171b") : secret "dns-default-metrics-tls" not found Jun 03 03:20:54.864373 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.864335 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c568bdbb6-x54f8"] Jun 03 03:20:54.870157 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.870125 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c568bdbb6-x54f8" Jun 03 03:20:54.874099 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.873108 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 03:20:54.874099 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.873182 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 03:20:54.874099 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.873620 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 03:20:54.874099 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.873664 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 03:20:54.874099 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.873671 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wc6dc\"" Jun 03 03:20:54.874099 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.874046 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2"] Jun 03 03:20:54.876595 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.876568 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb"] Jun 03 03:20:54.876755 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.876737 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" Jun 03 03:20:54.878795 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.878771 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 03 03:20:54.880060 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.879716 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c568bdbb6-x54f8"] Jun 03 03:20:54.880060 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.879853 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:54.882467 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.882444 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 03:20:54.882593 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.882479 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 03:20:54.882737 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.882721 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 03:20:54.882803 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.882756 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 03:20:54.885473 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.885451 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb"] Jun 03 03:20:54.887869 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.887845 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2"] Jun 03 03:20:54.971373 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.971334 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-ca\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:54.971585 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.971436 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td9ds\" (UniqueName: \"kubernetes.io/projected/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-kube-api-access-td9ds\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:54.971585 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.971465 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cad83c53-8505-48a1-b0d4-15c0d8fe567c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7656595bf8-vlvk2\" (UID: \"cad83c53-8505-48a1-b0d4-15c0d8fe567c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" Jun 03 03:20:54.971585 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.971498 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:54.971585 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.971514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2lp2\" (UniqueName: \"kubernetes.io/projected/cad83c53-8505-48a1-b0d4-15c0d8fe567c-kube-api-access-f2lp2\") pod \"klusterlet-addon-workmgr-7656595bf8-vlvk2\" (UID: \"cad83c53-8505-48a1-b0d4-15c0d8fe567c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" Jun 03 03:20:54.971758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.971642 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/124f9b5d-77a6-44fa-99b7-ce4eab67a00e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c568bdbb6-x54f8\" (UID: \"124f9b5d-77a6-44fa-99b7-ce4eab67a00e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c568bdbb6-x54f8" Jun 03 03:20:54.971758 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.971744 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:54.971827 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.971782 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:54.971827 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.971810 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cad83c53-8505-48a1-b0d4-15c0d8fe567c-tmp\") pod \"klusterlet-addon-workmgr-7656595bf8-vlvk2\" (UID: \"cad83c53-8505-48a1-b0d4-15c0d8fe567c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" Jun 03 03:20:54.971898 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.971842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78286\" (UniqueName: \"kubernetes.io/projected/124f9b5d-77a6-44fa-99b7-ce4eab67a00e-kube-api-access-78286\") pod \"managed-serviceaccount-addon-agent-7c568bdbb6-x54f8\" (UID: \"124f9b5d-77a6-44fa-99b7-ce4eab67a00e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c568bdbb6-x54f8" Jun 03 03:20:54.971947 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:54.971896 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-hub\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:55.073132 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.073091 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:55.073132 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.073139 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2lp2\" (UniqueName: \"kubernetes.io/projected/cad83c53-8505-48a1-b0d4-15c0d8fe567c-kube-api-access-f2lp2\") pod \"klusterlet-addon-workmgr-7656595bf8-vlvk2\" (UID: \"cad83c53-8505-48a1-b0d4-15c0d8fe567c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" Jun 03 03:20:55.073378 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.073164 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/124f9b5d-77a6-44fa-99b7-ce4eab67a00e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c568bdbb6-x54f8\" (UID: \"124f9b5d-77a6-44fa-99b7-ce4eab67a00e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c568bdbb6-x54f8" Jun 03 03:20:55.073378 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.073350 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:55.073492 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.073407 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:55.073492 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.073442 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cad83c53-8505-48a1-b0d4-15c0d8fe567c-tmp\") pod \"klusterlet-addon-workmgr-7656595bf8-vlvk2\" (UID: \"cad83c53-8505-48a1-b0d4-15c0d8fe567c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" Jun 03 03:20:55.073616 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.073491 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78286\" (UniqueName: \"kubernetes.io/projected/124f9b5d-77a6-44fa-99b7-ce4eab67a00e-kube-api-access-78286\") pod \"managed-serviceaccount-addon-agent-7c568bdbb6-x54f8\" (UID: \"124f9b5d-77a6-44fa-99b7-ce4eab67a00e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c568bdbb6-x54f8" Jun 03 03:20:55.073616 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.073539 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-hub\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:55.073616 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.073596 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-ca\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:55.073761 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.073674 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-td9ds\" (UniqueName: \"kubernetes.io/projected/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-kube-api-access-td9ds\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:55.073761 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.073704 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cad83c53-8505-48a1-b0d4-15c0d8fe567c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7656595bf8-vlvk2\" (UID: \"cad83c53-8505-48a1-b0d4-15c0d8fe567c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" Jun 03 03:20:55.073951 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.073928 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cad83c53-8505-48a1-b0d4-15c0d8fe567c-tmp\") pod \"klusterlet-addon-workmgr-7656595bf8-vlvk2\" (UID: \"cad83c53-8505-48a1-b0d4-15c0d8fe567c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" Jun 03 03:20:55.074076 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.074037 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:55.077701 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.077634 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:55.077701 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.077632 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-ca\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:55.077838 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.077722 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-hub\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:55.077838 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.077761 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cad83c53-8505-48a1-b0d4-15c0d8fe567c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7656595bf8-vlvk2\" (UID: \"cad83c53-8505-48a1-b0d4-15c0d8fe567c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" Jun 03 03:20:55.077838 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.077777 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/124f9b5d-77a6-44fa-99b7-ce4eab67a00e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c568bdbb6-x54f8\" (UID: \"124f9b5d-77a6-44fa-99b7-ce4eab67a00e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c568bdbb6-x54f8" Jun 03 03:20:55.079100 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.079078 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:55.081335 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.081312 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2lp2\" (UniqueName: \"kubernetes.io/projected/cad83c53-8505-48a1-b0d4-15c0d8fe567c-kube-api-access-f2lp2\") pod \"klusterlet-addon-workmgr-7656595bf8-vlvk2\" (UID: \"cad83c53-8505-48a1-b0d4-15c0d8fe567c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" Jun 03 03:20:55.082087 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.082068 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78286\" (UniqueName: \"kubernetes.io/projected/124f9b5d-77a6-44fa-99b7-ce4eab67a00e-kube-api-access-78286\") pod \"managed-serviceaccount-addon-agent-7c568bdbb6-x54f8\" (UID: \"124f9b5d-77a6-44fa-99b7-ce4eab67a00e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c568bdbb6-x54f8" Jun 03 03:20:55.082175 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.082126 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td9ds\" (UniqueName: \"kubernetes.io/projected/8efd4f8b-9e8b-4688-8480-3f4f9c9c291a-kube-api-access-td9ds\") pod \"cluster-proxy-proxy-agent-7ff64b9564-v22jb\" (UID: \"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:55.191957 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.191853 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c568bdbb6-x54f8" Jun 03 03:20:55.199880 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.199849 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" Jun 03 03:20:55.206679 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:55.206651 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:20:56.162907 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:56.162650 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c568bdbb6-x54f8"] Jun 03 03:20:56.166401 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:56.166371 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb"] Jun 03 03:20:56.179111 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:56.179085 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2"] Jun 03 03:20:56.225490 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:56.225435 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod124f9b5d_77a6_44fa_99b7_ce4eab67a00e.slice/crio-02e14d569657bbf05e71b60de965bc27bbc8bcc108826448573f4c7c5443c544 WatchSource:0}: Error finding container 02e14d569657bbf05e71b60de965bc27bbc8bcc108826448573f4c7c5443c544: Status 404 returned error can't find the container with id 02e14d569657bbf05e71b60de965bc27bbc8bcc108826448573f4c7c5443c544 Jun 03 03:20:56.226221 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:56.226045 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8efd4f8b_9e8b_4688_8480_3f4f9c9c291a.slice/crio-0b28d984112f3f0f0ee32e7750490a8ff65deb3686b58700a7a660346bafc3e1 WatchSource:0}: Error finding container 0b28d984112f3f0f0ee32e7750490a8ff65deb3686b58700a7a660346bafc3e1: Status 404 returned error can't find the container with id 0b28d984112f3f0f0ee32e7750490a8ff65deb3686b58700a7a660346bafc3e1 Jun 03 03:20:56.227045 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:56.227015 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad83c53_8505_48a1_b0d4_15c0d8fe567c.slice/crio-f81404958de328d3edaec3eb96789dacb1363fd455c9b1c502f5f1a7c9dd136b WatchSource:0}: Error finding container f81404958de328d3edaec3eb96789dacb1363fd455c9b1c502f5f1a7c9dd136b: Status 404 returned error can't find the container with id f81404958de328d3edaec3eb96789dacb1363fd455c9b1c502f5f1a7c9dd136b Jun 03 03:20:56.987511 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:56.987475 2575 generic.go:358] "Generic (PLEG): container finished" podID="6bc4f112-f25e-439c-b288-0788f935ade9" containerID="0fea38ea6e848c34ade0113dfadfeabb5eaccc00b8d984b2dab9e6b8a0769361" exitCode=0 Jun 03 03:20:56.987718 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:56.987577 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5fkcf" event={"ID":"6bc4f112-f25e-439c-b288-0788f935ade9","Type":"ContainerDied","Data":"0fea38ea6e848c34ade0113dfadfeabb5eaccc00b8d984b2dab9e6b8a0769361"} Jun 03 03:20:56.988569 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:56.988532 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c568bdbb6-x54f8" event={"ID":"124f9b5d-77a6-44fa-99b7-ce4eab67a00e","Type":"ContainerStarted","Data":"02e14d569657bbf05e71b60de965bc27bbc8bcc108826448573f4c7c5443c544"} Jun 03 03:20:56.989573 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:56.989536 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" event={"ID":"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a","Type":"ContainerStarted","Data":"0b28d984112f3f0f0ee32e7750490a8ff65deb3686b58700a7a660346bafc3e1"} Jun 03 03:20:56.990559 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:56.990530 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" event={"ID":"cad83c53-8505-48a1-b0d4-15c0d8fe567c","Type":"ContainerStarted","Data":"f81404958de328d3edaec3eb96789dacb1363fd455c9b1c502f5f1a7c9dd136b"} Jun 03 03:20:57.494299 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:57.494264 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret\") pod \"global-pull-secret-syncer-n6xjh\" (UID: \"ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27\") " pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:57.504084 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:57.504052 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27-original-pull-secret\") pod \"global-pull-secret-syncer-n6xjh\" (UID: \"ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27\") " pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:57.787633 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:57.787589 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6xjh" Jun 03 03:20:57.976115 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:57.976084 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n6xjh"] Jun 03 03:20:57.978764 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:20:57.978732 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae02a8fa_2d15_40f8_8fad_88bcfc0ebb27.slice/crio-d8ae4bf87c8d567f5796377f2c565eb0b2abf614aa4f4482dc007a71faee9040 WatchSource:0}: Error finding container d8ae4bf87c8d567f5796377f2c565eb0b2abf614aa4f4482dc007a71faee9040: Status 404 returned error can't find the container with id d8ae4bf87c8d567f5796377f2c565eb0b2abf614aa4f4482dc007a71faee9040 Jun 03 03:20:57.994611 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:57.994575 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n6xjh" event={"ID":"ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27","Type":"ContainerStarted","Data":"d8ae4bf87c8d567f5796377f2c565eb0b2abf614aa4f4482dc007a71faee9040"} Jun 03 03:20:57.999977 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:57.999084 2575 generic.go:358] "Generic (PLEG): container finished" podID="6bc4f112-f25e-439c-b288-0788f935ade9" containerID="92737065efe6d79a5007ed8e36996f44bfc5d785e8019bd2012e39e32f0c76ee" exitCode=0 Jun 03 03:20:57.999977 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:57.999162 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5fkcf" event={"ID":"6bc4f112-f25e-439c-b288-0788f935ade9","Type":"ContainerDied","Data":"92737065efe6d79a5007ed8e36996f44bfc5d785e8019bd2012e39e32f0c76ee"} Jun 03 03:20:58.301402 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:58.300958 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:20:58.301402 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:58.301050 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert\") pod \"ingress-canary-2s2h7\" (UID: \"9338190d-d545-403e-888a-43929db2a9ec\") " pod="openshift-ingress-canary/ingress-canary-2s2h7" Jun 03 03:20:58.301402 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:58.301128 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-zw6wn\" (UID: \"46717f80-0839-4cb3-86d2-db4812b785a0\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" Jun 03 03:20:58.301402 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:58.301206 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 03:20:58.301402 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:58.301235 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75669d8948-dszd5: secret "image-registry-tls" not found Jun 03 03:20:58.301402 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:58.301299 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:20:58.301402 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:58.301316 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls podName:423d5b41-b980-48e8-865c-3dcb26d8b0af nodeName:}" failed. No retries permitted until 2026-06-03 03:21:06.301292104 +0000 UTC m=+50.142873713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls") pod "image-registry-75669d8948-dszd5" (UID: "423d5b41-b980-48e8-865c-3dcb26d8b0af") : secret "image-registry-tls" not found Jun 03 03:20:58.301402 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:58.301330 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 03:20:58.301402 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:58.301358 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert podName:9338190d-d545-403e-888a-43929db2a9ec nodeName:}" failed. No retries permitted until 2026-06-03 03:21:06.301341399 +0000 UTC m=+50.142923000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert") pod "ingress-canary-2s2h7" (UID: "9338190d-d545-403e-888a-43929db2a9ec") : secret "canary-serving-cert" not found Jun 03 03:20:58.301402 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:58.301381 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert podName:46717f80-0839-4cb3-86d2-db4812b785a0 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:06.301367074 +0000 UTC m=+50.142948673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-zw6wn" (UID: "46717f80-0839-4cb3-86d2-db4812b785a0") : secret "networking-console-plugin-cert" not found Jun 03 03:20:58.402142 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:58.402051 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:20:58.402303 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:58.402263 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:20:58.402368 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:20:58.402348 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls podName:65e090c5-86cd-4b86-aca5-0d341af5171b nodeName:}" failed. No retries permitted until 2026-06-03 03:21:06.402326077 +0000 UTC m=+50.243907692 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls") pod "dns-default-hqjbr" (UID: "65e090c5-86cd-4b86-aca5-0d341af5171b") : secret "dns-default-metrics-tls" not found Jun 03 03:20:59.008772 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:59.008721 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5fkcf" event={"ID":"6bc4f112-f25e-439c-b288-0788f935ade9","Type":"ContainerStarted","Data":"c99413765238893db263cfd1b62500576220682a3b3268e617455d6b66a41408"} Jun 03 03:20:59.029990 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:20:59.029924 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5fkcf" podStartSLOduration=4.77973572 podStartE2EDuration="43.029906083s" podCreationTimestamp="2026-06-03 03:20:16 +0000 UTC" firstStartedPulling="2026-06-03 03:20:18.00707556 +0000 UTC m=+1.848657155" lastFinishedPulling="2026-06-03 03:20:56.257245919 +0000 UTC m=+40.098827518" observedRunningTime="2026-06-03 03:20:59.029095514 +0000 UTC m=+42.870677134" watchObservedRunningTime="2026-06-03 03:20:59.029906083 +0000 UTC m=+42.871487702" Jun 03 03:21:06.026023 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:06.025987 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" event={"ID":"cad83c53-8505-48a1-b0d4-15c0d8fe567c","Type":"ContainerStarted","Data":"a72b4f2c82ab42eb522320e888ef62911c96897ba1d9fbe7a7ba18136db7bdc2"} Jun 03 03:21:06.026481 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:06.026374 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" Jun 03 03:21:06.027882 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:06.027844 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n6xjh" event={"ID":"ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27","Type":"ContainerStarted","Data":"40ebcba647b1dd7266949b71d0e22cf6f1559149caabc0f65a28f5fa33f9f781"} Jun 03 03:21:06.027994 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:06.027968 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" Jun 03 03:21:06.029203 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:06.029183 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c568bdbb6-x54f8" event={"ID":"124f9b5d-77a6-44fa-99b7-ce4eab67a00e","Type":"ContainerStarted","Data":"3db91277a47b18c3485ebb4a9cff0263088cd1e1cf913493bf3d33d3b3e4627c"} Jun 03 03:21:06.030456 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:06.030432 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" event={"ID":"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a","Type":"ContainerStarted","Data":"b6dcb25dd1b5e092f8277277ba21bd95de80c9cb333697a653032623c42304e6"} Jun 03 03:21:06.040702 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:06.040652 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" podStartSLOduration=2.518754034 podStartE2EDuration="12.040640915s" podCreationTimestamp="2026-06-03 03:20:54 +0000 UTC" firstStartedPulling="2026-06-03 03:20:56.234135793 +0000 UTC m=+40.075717401" lastFinishedPulling="2026-06-03 03:21:05.756022687 +0000 UTC m=+49.597604282" observedRunningTime="2026-06-03 03:21:06.039496652 +0000 UTC m=+49.881078268" watchObservedRunningTime="2026-06-03 03:21:06.040640915 +0000 UTC m=+49.882222532" Jun 03 03:21:06.052336 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:06.052288 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n6xjh" podStartSLOduration=33.242747827 podStartE2EDuration="41.052273513s" podCreationTimestamp="2026-06-03 03:20:25 +0000 UTC" firstStartedPulling="2026-06-03 03:20:57.981457985 +0000 UTC m=+41.823039586" lastFinishedPulling="2026-06-03 03:21:05.790983663 +0000 UTC m=+49.632565272" observedRunningTime="2026-06-03 03:21:06.051047164 +0000 UTC m=+49.892628782" watchObservedRunningTime="2026-06-03 03:21:06.052273513 +0000 UTC m=+49.893855130" Jun 03 03:21:06.063464 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:06.063417 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c568bdbb6-x54f8" podStartSLOduration=2.541265977 podStartE2EDuration="12.063404554s" podCreationTimestamp="2026-06-03 03:20:54 +0000 UTC" firstStartedPulling="2026-06-03 03:20:56.233886161 +0000 UTC m=+40.075467773" lastFinishedPulling="2026-06-03 03:21:05.756024541 +0000 UTC m=+49.597606350" observedRunningTime="2026-06-03 03:21:06.062997536 +0000 UTC m=+49.904579154" watchObservedRunningTime="2026-06-03 03:21:06.063404554 +0000 UTC m=+49.904986170" Jun 03 03:21:06.382226 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:06.382111 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-zw6wn\" (UID: \"46717f80-0839-4cb3-86d2-db4812b785a0\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" Jun 03 03:21:06.382226 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:06.382184 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:21:06.382434 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:06.382247 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert\") pod \"ingress-canary-2s2h7\" (UID: \"9338190d-d545-403e-888a-43929db2a9ec\") " pod="openshift-ingress-canary/ingress-canary-2s2h7" Jun 03 03:21:06.382434 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:06.382263 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 03:21:06.382434 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:06.382315 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 03:21:06.382434 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:06.382328 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert podName:46717f80-0839-4cb3-86d2-db4812b785a0 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:22.382312444 +0000 UTC m=+66.223894043 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-zw6wn" (UID: "46717f80-0839-4cb3-86d2-db4812b785a0") : secret "networking-console-plugin-cert" not found Jun 03 03:21:06.382434 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:06.382333 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75669d8948-dszd5: secret "image-registry-tls" not found Jun 03 03:21:06.382434 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:06.382355 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:21:06.382434 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:06.382401 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls podName:423d5b41-b980-48e8-865c-3dcb26d8b0af nodeName:}" failed. No retries permitted until 2026-06-03 03:21:22.3823849 +0000 UTC m=+66.223966509 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls") pod "image-registry-75669d8948-dszd5" (UID: "423d5b41-b980-48e8-865c-3dcb26d8b0af") : secret "image-registry-tls" not found Jun 03 03:21:06.382434 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:06.382418 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert podName:9338190d-d545-403e-888a-43929db2a9ec nodeName:}" failed. No retries permitted until 2026-06-03 03:21:22.382410706 +0000 UTC m=+66.223992301 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert") pod "ingress-canary-2s2h7" (UID: "9338190d-d545-403e-888a-43929db2a9ec") : secret "canary-serving-cert" not found Jun 03 03:21:06.482808 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:06.482758 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:21:06.482964 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:06.482862 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:21:06.482964 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:06.482929 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls podName:65e090c5-86cd-4b86-aca5-0d341af5171b nodeName:}" failed. No retries permitted until 2026-06-03 03:21:22.48291364 +0000 UTC m=+66.324495235 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls") pod "dns-default-hqjbr" (UID: "65e090c5-86cd-4b86-aca5-0d341af5171b") : secret "dns-default-metrics-tls" not found Jun 03 03:21:08.036631 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:08.036587 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" event={"ID":"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a","Type":"ContainerStarted","Data":"295136d6ffc0cb70455365345670a7262d18b289db1864928a6b99ea55ef327f"} Jun 03 03:21:08.036631 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:08.036637 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" event={"ID":"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a","Type":"ContainerStarted","Data":"4aa2a1cbd1084be2e500f6699eb056eac464c5d6a11365ebedd13592a1199d94"} Jun 03 03:21:08.053333 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:08.053279 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" podStartSLOduration=2.384365247 podStartE2EDuration="14.05326506s" podCreationTimestamp="2026-06-03 03:20:54 +0000 UTC" firstStartedPulling="2026-06-03 03:20:56.233714253 +0000 UTC m=+40.075295862" lastFinishedPulling="2026-06-03 03:21:07.902614081 +0000 UTC m=+51.744195675" observedRunningTime="2026-06-03 03:21:08.051616958 +0000 UTC m=+51.893198573" watchObservedRunningTime="2026-06-03 03:21:08.05326506 +0000 UTC m=+51.894846730" Jun 03 03:21:17.984101 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:17.984065 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn4q2" Jun 03 03:21:21.502832 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:21.502775 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs\") pod \"network-metrics-daemon-trw96\" (UID: \"0085db10-4407-48e2-b27f-2abf8391ee43\") " pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:21:21.505417 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:21.505395 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 03:21:21.513155 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:21.513132 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 03:21:21.513238 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:21.513203 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs podName:0085db10-4407-48e2-b27f-2abf8391ee43 nodeName:}" failed. No retries permitted until 2026-06-03 03:22:25.513187021 +0000 UTC m=+129.354768616 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs") pod "network-metrics-daemon-trw96" (UID: "0085db10-4407-48e2-b27f-2abf8391ee43") : secret "metrics-daemon-secret" not found Jun 03 03:21:21.603510 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:21.603468 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bx448\" (UniqueName: \"kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448\") pod \"network-check-target-vsqpb\" (UID: \"5316cd63-ebbf-456a-99d6-a20a009eeeac\") " pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:21:21.606083 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:21.606059 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 03:21:21.615956 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:21.615924 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 03:21:21.626357 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:21.626326 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx448\" (UniqueName: \"kubernetes.io/projected/5316cd63-ebbf-456a-99d6-a20a009eeeac-kube-api-access-bx448\") pod \"network-check-target-vsqpb\" (UID: \"5316cd63-ebbf-456a-99d6-a20a009eeeac\") " pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:21:21.800641 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:21.800614 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qcjrn\"" Jun 03 03:21:21.808452 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:21.808431 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:21:21.928913 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:21.928879 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vsqpb"] Jun 03 03:21:21.933033 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:21:21.932994 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5316cd63_ebbf_456a_99d6_a20a009eeeac.slice/crio-5038ba970a7a5bb202dc0dc52c90d9ea36607f988551bd4c7b7bc1056af7e6e9 WatchSource:0}: Error finding container 5038ba970a7a5bb202dc0dc52c90d9ea36607f988551bd4c7b7bc1056af7e6e9: Status 404 returned error can't find the container with id 5038ba970a7a5bb202dc0dc52c90d9ea36607f988551bd4c7b7bc1056af7e6e9 Jun 03 03:21:22.074522 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:22.074429 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vsqpb" event={"ID":"5316cd63-ebbf-456a-99d6-a20a009eeeac","Type":"ContainerStarted","Data":"5038ba970a7a5bb202dc0dc52c90d9ea36607f988551bd4c7b7bc1056af7e6e9"} Jun 03 03:21:22.410185 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:22.410104 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert\") pod \"ingress-canary-2s2h7\" (UID: \"9338190d-d545-403e-888a-43929db2a9ec\") " pod="openshift-ingress-canary/ingress-canary-2s2h7" Jun 03 03:21:22.410185 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:22.410168 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-zw6wn\" (UID: \"46717f80-0839-4cb3-86d2-db4812b785a0\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" Jun 03 03:21:22.410359 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:22.410224 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:21:22.410359 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:22.410263 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:21:22.410359 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:22.410333 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 03:21:22.410359 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:22.410341 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert podName:9338190d-d545-403e-888a-43929db2a9ec nodeName:}" failed. No retries permitted until 2026-06-03 03:21:54.410322789 +0000 UTC m=+98.251904385 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert") pod "ingress-canary-2s2h7" (UID: "9338190d-d545-403e-888a-43929db2a9ec") : secret "canary-serving-cert" not found Jun 03 03:21:22.410359 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:22.410348 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75669d8948-dszd5: secret "image-registry-tls" not found Jun 03 03:21:22.410359 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:22.410334 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 03:21:22.410539 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:22.410416 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert podName:46717f80-0839-4cb3-86d2-db4812b785a0 nodeName:}" failed. No retries permitted until 2026-06-03 03:21:54.410397843 +0000 UTC m=+98.251979440 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-zw6wn" (UID: "46717f80-0839-4cb3-86d2-db4812b785a0") : secret "networking-console-plugin-cert" not found Jun 03 03:21:22.410539 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:22.410433 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls podName:423d5b41-b980-48e8-865c-3dcb26d8b0af nodeName:}" failed. No retries permitted until 2026-06-03 03:21:54.410425623 +0000 UTC m=+98.252007217 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls") pod "image-registry-75669d8948-dszd5" (UID: "423d5b41-b980-48e8-865c-3dcb26d8b0af") : secret "image-registry-tls" not found Jun 03 03:21:22.511402 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:22.511358 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:21:22.511881 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:22.511537 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:21:22.511881 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:22.511628 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls podName:65e090c5-86cd-4b86-aca5-0d341af5171b nodeName:}" failed. No retries permitted until 2026-06-03 03:21:54.511612132 +0000 UTC m=+98.353193727 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls") pod "dns-default-hqjbr" (UID: "65e090c5-86cd-4b86-aca5-0d341af5171b") : secret "dns-default-metrics-tls" not found Jun 03 03:21:26.086802 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:26.086764 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vsqpb" event={"ID":"5316cd63-ebbf-456a-99d6-a20a009eeeac","Type":"ContainerStarted","Data":"f56bc1478ab22ba83d98c0f7b2639ae9a781e08716e8cfb63538055ee37a727e"} Jun 03 03:21:26.087203 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:26.086891 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:21:26.101833 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:26.101786 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vsqpb" podStartSLOduration=66.393048847 podStartE2EDuration="1m10.101771659s" podCreationTimestamp="2026-06-03 03:20:16 +0000 UTC" firstStartedPulling="2026-06-03 03:21:21.935051701 +0000 UTC m=+65.776633298" lastFinishedPulling="2026-06-03 03:21:25.643774514 +0000 UTC m=+69.485356110" observedRunningTime="2026-06-03 03:21:26.10058615 +0000 UTC m=+69.942167766" watchObservedRunningTime="2026-06-03 03:21:26.101771659 +0000 UTC m=+69.943353276" Jun 03 03:21:54.463766 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:54.463624 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-zw6wn\" (UID: \"46717f80-0839-4cb3-86d2-db4812b785a0\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" Jun 03 03:21:54.463766 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:54.463689 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:21:54.463766 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:54.463732 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert\") pod \"ingress-canary-2s2h7\" (UID: \"9338190d-d545-403e-888a-43929db2a9ec\") " pod="openshift-ingress-canary/ingress-canary-2s2h7" Jun 03 03:21:54.464299 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:54.463777 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 03:21:54.464299 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:54.463851 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert podName:46717f80-0839-4cb3-86d2-db4812b785a0 nodeName:}" failed. No retries permitted until 2026-06-03 03:22:58.463832748 +0000 UTC m=+162.305414347 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-zw6wn" (UID: "46717f80-0839-4cb3-86d2-db4812b785a0") : secret "networking-console-plugin-cert" not found Jun 03 03:21:54.464299 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:54.463861 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 03:21:54.464299 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:54.463864 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 03:21:54.464299 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:54.463883 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75669d8948-dszd5: secret "image-registry-tls" not found Jun 03 03:21:54.464299 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:54.463921 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert podName:9338190d-d545-403e-888a-43929db2a9ec nodeName:}" failed. No retries permitted until 2026-06-03 03:22:58.4639045 +0000 UTC m=+162.305486114 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert") pod "ingress-canary-2s2h7" (UID: "9338190d-d545-403e-888a-43929db2a9ec") : secret "canary-serving-cert" not found Jun 03 03:21:54.464299 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:54.463938 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls podName:423d5b41-b980-48e8-865c-3dcb26d8b0af nodeName:}" failed. No retries permitted until 2026-06-03 03:22:58.463928747 +0000 UTC m=+162.305510343 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls") pod "image-registry-75669d8948-dszd5" (UID: "423d5b41-b980-48e8-865c-3dcb26d8b0af") : secret "image-registry-tls" not found Jun 03 03:21:54.564404 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:54.564360 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:21:54.564607 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:54.564506 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 03:21:54.564607 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:21:54.564597 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls podName:65e090c5-86cd-4b86-aca5-0d341af5171b nodeName:}" failed. No retries permitted until 2026-06-03 03:22:58.56457873 +0000 UTC m=+162.406160329 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls") pod "dns-default-hqjbr" (UID: "65e090c5-86cd-4b86-aca5-0d341af5171b") : secret "dns-default-metrics-tls" not found Jun 03 03:21:57.092042 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:21:57.092010 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vsqpb" Jun 03 03:22:25.594768 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:25.594720 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs\") pod \"network-metrics-daemon-trw96\" (UID: \"0085db10-4407-48e2-b27f-2abf8391ee43\") " pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:22:25.595254 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:22:25.594872 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 03:22:25.595254 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:22:25.594952 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs podName:0085db10-4407-48e2-b27f-2abf8391ee43 nodeName:}" failed. No retries permitted until 2026-06-03 03:24:27.594933753 +0000 UTC m=+251.436515349 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs") pod "network-metrics-daemon-trw96" (UID: "0085db10-4407-48e2-b27f-2abf8391ee43") : secret "metrics-daemon-secret" not found Jun 03 03:22:44.584303 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:44.584272 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9cklm_70e80cc4-7c78-4606-a320-d3cc0ac6452a/dns-node-resolver/0.log" Jun 03 03:22:45.784138 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:45.784109 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rkbr5_4801abc1-ec7f-43ab-a2e1-2cbac19f58cb/node-ca/0.log" Jun 03 03:22:53.519915 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:22:53.519865 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" podUID="46717f80-0839-4cb3-86d2-db4812b785a0" Jun 03 03:22:53.538080 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:22:53.538045 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-75669d8948-dszd5" podUID="423d5b41-b980-48e8-865c-3dcb26d8b0af" Jun 03 03:22:53.552229 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:22:53.552200 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-2s2h7" podUID="9338190d-d545-403e-888a-43929db2a9ec" Jun 03 03:22:53.627453 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:22:53.627395 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hqjbr" podUID="65e090c5-86cd-4b86-aca5-0d341af5171b" Jun 03 03:22:54.292349 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:54.292321 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:22:54.292349 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:54.292347 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" Jun 03 03:22:54.292596 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:54.292464 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hqjbr" Jun 03 03:22:54.794092 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:22:54.794051 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-trw96" podUID="0085db10-4407-48e2-b27f-2abf8391ee43" Jun 03 03:22:58.546641 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:58.546589 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:22:58.547146 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:58.546672 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert\") pod \"ingress-canary-2s2h7\" (UID: \"9338190d-d545-403e-888a-43929db2a9ec\") " pod="openshift-ingress-canary/ingress-canary-2s2h7" Jun 03 03:22:58.547146 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:58.546739 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-zw6wn\" (UID: \"46717f80-0839-4cb3-86d2-db4812b785a0\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" Jun 03 03:22:58.549327 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:58.549294 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9338190d-d545-403e-888a-43929db2a9ec-cert\") pod \"ingress-canary-2s2h7\" (UID: \"9338190d-d545-403e-888a-43929db2a9ec\") " pod="openshift-ingress-canary/ingress-canary-2s2h7" Jun 03 03:22:58.549327 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:58.549316 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46717f80-0839-4cb3-86d2-db4812b785a0-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-zw6wn\" (UID: \"46717f80-0839-4cb3-86d2-db4812b785a0\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" Jun 03 03:22:58.549463 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:58.549316 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls\") pod \"image-registry-75669d8948-dszd5\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:22:58.647458 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:58.647416 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:22:58.649814 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:58.649786 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e090c5-86cd-4b86-aca5-0d341af5171b-metrics-tls\") pod \"dns-default-hqjbr\" (UID: \"65e090c5-86cd-4b86-aca5-0d341af5171b\") " pod="openshift-dns/dns-default-hqjbr" Jun 03 03:22:58.795819 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:58.795785 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wrcsp\"" Jun 03 03:22:58.795982 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:58.795828 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kzhg4\"" Jun 03 03:22:58.795982 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:58.795848 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-96wwc\"" Jun 03 03:22:58.803565 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:58.803483 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:22:58.803565 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:58.803507 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" Jun 03 03:22:58.803565 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:58.803535 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hqjbr" Jun 03 03:22:58.946078 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:58.946043 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hqjbr"] Jun 03 03:22:58.947858 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:22:58.947819 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e090c5_86cd_4b86_aca5_0d341af5171b.slice/crio-a1464f10909eea8e2d1f0a89c766d33a44a484d348a20f17be74a9bf2f4e1ac5 WatchSource:0}: Error finding container a1464f10909eea8e2d1f0a89c766d33a44a484d348a20f17be74a9bf2f4e1ac5: Status 404 returned error can't find the container with id a1464f10909eea8e2d1f0a89c766d33a44a484d348a20f17be74a9bf2f4e1ac5 Jun 03 03:22:59.171061 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:59.170981 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn"] Jun 03 03:22:59.173859 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:59.173828 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75669d8948-dszd5"] Jun 03 03:22:59.174738 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:22:59.174706 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46717f80_0839_4cb3_86d2_db4812b785a0.slice/crio-6fa7304c8aab270657f6ad2a526701d35b2c1f3e1225da2e5bbc6e4dbaaf39a3 WatchSource:0}: Error finding container 6fa7304c8aab270657f6ad2a526701d35b2c1f3e1225da2e5bbc6e4dbaaf39a3: Status 404 returned error can't find the container with id 6fa7304c8aab270657f6ad2a526701d35b2c1f3e1225da2e5bbc6e4dbaaf39a3 Jun 03 03:22:59.177242 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:22:59.177220 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423d5b41_b980_48e8_865c_3dcb26d8b0af.slice/crio-41e10c7f954e2f436bb89d8f4a94fc7b2391430902039eacab77ef5164dd8433 WatchSource:0}: Error finding container 41e10c7f954e2f436bb89d8f4a94fc7b2391430902039eacab77ef5164dd8433: Status 404 returned error can't find the container with id 41e10c7f954e2f436bb89d8f4a94fc7b2391430902039eacab77ef5164dd8433 Jun 03 03:22:59.304881 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:59.304845 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" event={"ID":"46717f80-0839-4cb3-86d2-db4812b785a0","Type":"ContainerStarted","Data":"6fa7304c8aab270657f6ad2a526701d35b2c1f3e1225da2e5bbc6e4dbaaf39a3"} Jun 03 03:22:59.305790 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:59.305760 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hqjbr" event={"ID":"65e090c5-86cd-4b86-aca5-0d341af5171b","Type":"ContainerStarted","Data":"a1464f10909eea8e2d1f0a89c766d33a44a484d348a20f17be74a9bf2f4e1ac5"} Jun 03 03:22:59.306910 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:59.306876 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75669d8948-dszd5" event={"ID":"423d5b41-b980-48e8-865c-3dcb26d8b0af","Type":"ContainerStarted","Data":"aa2c5afd3f8ec2a94faba3da66f97e71bfe4e21f3375767c5b627256be4f6f6e"} Jun 03 03:22:59.306996 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:59.306916 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75669d8948-dszd5" event={"ID":"423d5b41-b980-48e8-865c-3dcb26d8b0af","Type":"ContainerStarted","Data":"41e10c7f954e2f436bb89d8f4a94fc7b2391430902039eacab77ef5164dd8433"} Jun 03 03:22:59.307043 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:59.307025 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:22:59.323711 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:22:59.323661 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75669d8948-dszd5" podStartSLOduration=162.323646352 podStartE2EDuration="2m42.323646352s" podCreationTimestamp="2026-06-03 03:20:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:22:59.322798057 +0000 UTC m=+163.164379687" watchObservedRunningTime="2026-06-03 03:22:59.323646352 +0000 UTC m=+163.165227968" Jun 03 03:23:01.314253 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:01.314207 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" event={"ID":"46717f80-0839-4cb3-86d2-db4812b785a0","Type":"ContainerStarted","Data":"d5119ded946b0889707bdbe3f587b78aad633a053852410935dcc7842686da85"} Jun 03 03:23:01.315974 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:01.315948 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hqjbr" event={"ID":"65e090c5-86cd-4b86-aca5-0d341af5171b","Type":"ContainerStarted","Data":"1be277f1a9075783ae2d54150d973b383d7bf89dc67bfb218cde74e9a95f6a63"} Jun 03 03:23:01.316067 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:01.315978 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hqjbr" event={"ID":"65e090c5-86cd-4b86-aca5-0d341af5171b","Type":"ContainerStarted","Data":"c35b8d342ece8b74fbdfa89fb97d0c872ddf6c3d6f80a8742d92082efba2fee5"} Jun 03 03:23:01.316126 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:01.316086 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hqjbr" Jun 03 03:23:01.329780 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:01.329725 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-zw6wn" podStartSLOduration=151.245281402 podStartE2EDuration="2m32.32971149s" podCreationTimestamp="2026-06-03 03:20:29 +0000 UTC" firstStartedPulling="2026-06-03 03:22:59.176616211 +0000 UTC m=+163.018197806" lastFinishedPulling="2026-06-03 03:23:00.261046288 +0000 UTC m=+164.102627894" observedRunningTime="2026-06-03 03:23:01.328619811 +0000 UTC m=+165.170201430" watchObservedRunningTime="2026-06-03 03:23:01.32971149 +0000 UTC m=+165.171293103" Jun 03 03:23:01.343380 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:01.343327 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-hqjbr" podStartSLOduration=129.614995841 podStartE2EDuration="2m11.343314357s" podCreationTimestamp="2026-06-03 03:20:50 +0000 UTC" firstStartedPulling="2026-06-03 03:22:58.9496467 +0000 UTC m=+162.791228295" lastFinishedPulling="2026-06-03 03:23:00.677965216 +0000 UTC m=+164.519546811" observedRunningTime="2026-06-03 03:23:01.342345195 +0000 UTC m=+165.183926811" watchObservedRunningTime="2026-06-03 03:23:01.343314357 +0000 UTC m=+165.184895974" Jun 03 03:23:06.027068 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:06.027019 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" podUID="cad83c53-8505-48a1-b0d4-15c0d8fe567c" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.12:8000/readyz\": dial tcp 10.132.0.12:8000: connect: connection refused" Jun 03 03:23:06.331904 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:06.331871 2575 generic.go:358] "Generic (PLEG): container finished" podID="124f9b5d-77a6-44fa-99b7-ce4eab67a00e" containerID="3db91277a47b18c3485ebb4a9cff0263088cd1e1cf913493bf3d33d3b3e4627c" exitCode=255 Jun 03 03:23:06.332067 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:06.331945 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c568bdbb6-x54f8" event={"ID":"124f9b5d-77a6-44fa-99b7-ce4eab67a00e","Type":"ContainerDied","Data":"3db91277a47b18c3485ebb4a9cff0263088cd1e1cf913493bf3d33d3b3e4627c"} Jun 03 03:23:06.332307 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:06.332291 2575 scope.go:117] "RemoveContainer" containerID="3db91277a47b18c3485ebb4a9cff0263088cd1e1cf913493bf3d33d3b3e4627c" Jun 03 03:23:06.333183 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:06.333156 2575 generic.go:358] "Generic (PLEG): container finished" podID="cad83c53-8505-48a1-b0d4-15c0d8fe567c" containerID="a72b4f2c82ab42eb522320e888ef62911c96897ba1d9fbe7a7ba18136db7bdc2" exitCode=1 Jun 03 03:23:06.333254 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:06.333199 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" event={"ID":"cad83c53-8505-48a1-b0d4-15c0d8fe567c","Type":"ContainerDied","Data":"a72b4f2c82ab42eb522320e888ef62911c96897ba1d9fbe7a7ba18136db7bdc2"} Jun 03 03:23:06.333466 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:06.333453 2575 scope.go:117] "RemoveContainer" containerID="a72b4f2c82ab42eb522320e888ef62911c96897ba1d9fbe7a7ba18136db7bdc2" Jun 03 03:23:07.094092 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.094054 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7k6jr"] Jun 03 03:23:07.097242 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.097219 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:07.104209 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.104178 2575 status_manager.go:895] "Failed to get status for pod" podUID="bdcaeb80-8c1b-47d5-8f13-8576cfb48167" pod="openshift-insights/insights-runtime-extractor-7k6jr" err="pods \"insights-runtime-extractor-7k6jr\" is forbidden: User \"system:node:ip-10-0-130-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-130-55.ec2.internal' and this object" Jun 03 03:23:07.104508 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:23:07.104477 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-130-55.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-130-55.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" Jun 03 03:23:07.104629 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:23:07.104476 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-mwlqd\" is forbidden: User \"system:node:ip-10-0-130-55.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-130-55.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mwlqd\"" type="*v1.Secret" Jun 03 03:23:07.104629 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:23:07.104476 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-130-55.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-130-55.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" Jun 03 03:23:07.104629 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:23:07.104478 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-55.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-130-55.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 03 03:23:07.105083 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.105067 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 03:23:07.115647 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.115616 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7k6jr"] Jun 03 03:23:07.221164 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.221131 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7k6jr\" (UID: \"bdcaeb80-8c1b-47d5-8f13-8576cfb48167\") " pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:07.221164 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.221169 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-crio-socket\") pod \"insights-runtime-extractor-7k6jr\" (UID: \"bdcaeb80-8c1b-47d5-8f13-8576cfb48167\") " pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:07.221380 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.221207 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7k6jr\" (UID: \"bdcaeb80-8c1b-47d5-8f13-8576cfb48167\") " pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:07.221380 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.221281 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-data-volume\") pod \"insights-runtime-extractor-7k6jr\" (UID: \"bdcaeb80-8c1b-47d5-8f13-8576cfb48167\") " pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:07.221380 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.221334 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxfpk\" (UniqueName: \"kubernetes.io/projected/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-kube-api-access-nxfpk\") pod \"insights-runtime-extractor-7k6jr\" (UID: \"bdcaeb80-8c1b-47d5-8f13-8576cfb48167\") " pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:07.321909 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.321874 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nxfpk\" (UniqueName: \"kubernetes.io/projected/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-kube-api-access-nxfpk\") pod \"insights-runtime-extractor-7k6jr\" (UID: \"bdcaeb80-8c1b-47d5-8f13-8576cfb48167\") " pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:07.322064 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.321942 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7k6jr\" (UID: \"bdcaeb80-8c1b-47d5-8f13-8576cfb48167\") " pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:07.322064 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.321969 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-crio-socket\") pod \"insights-runtime-extractor-7k6jr\" (UID: \"bdcaeb80-8c1b-47d5-8f13-8576cfb48167\") " pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:07.322064 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.322013 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7k6jr\" (UID: \"bdcaeb80-8c1b-47d5-8f13-8576cfb48167\") " pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:07.322176 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.322063 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-data-volume\") pod \"insights-runtime-extractor-7k6jr\" (UID: \"bdcaeb80-8c1b-47d5-8f13-8576cfb48167\") " pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:07.322176 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.322080 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-crio-socket\") pod \"insights-runtime-extractor-7k6jr\" (UID: \"bdcaeb80-8c1b-47d5-8f13-8576cfb48167\") " pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:07.322395 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.322379 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-data-volume\") pod \"insights-runtime-extractor-7k6jr\" (UID: \"bdcaeb80-8c1b-47d5-8f13-8576cfb48167\") " pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:07.337354 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.337317 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" event={"ID":"cad83c53-8505-48a1-b0d4-15c0d8fe567c","Type":"ContainerStarted","Data":"993e4b7fe0bf4fc164d00b15f0e42591ba4cf5409f3dfc616b4980ceb5037e2c"} Jun 03 03:23:07.337659 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.337633 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" Jun 03 03:23:07.338275 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.338254 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7656595bf8-vlvk2" Jun 03 03:23:07.339061 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.339041 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c568bdbb6-x54f8" event={"ID":"124f9b5d-77a6-44fa-99b7-ce4eab67a00e","Type":"ContainerStarted","Data":"2ba304339bc2f5b47f6914c1a0d40ef1eb419028afa029a5d9c99650a9295e75"} Jun 03 03:23:07.778696 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.778638 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2s2h7" Jun 03 03:23:07.781187 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.781170 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7jxzs\"" Jun 03 03:23:07.789848 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.789826 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2s2h7" Jun 03 03:23:07.911978 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.911946 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2s2h7"] Jun 03 03:23:07.914900 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:23:07.914861 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9338190d_d545_403e_888a_43929db2a9ec.slice/crio-1df039946f20d2a6faebe3094528fe7f02e631041893fdd4382b87f705af53ea WatchSource:0}: Error finding container 1df039946f20d2a6faebe3094528fe7f02e631041893fdd4382b87f705af53ea: Status 404 returned error can't find the container with id 1df039946f20d2a6faebe3094528fe7f02e631041893fdd4382b87f705af53ea Jun 03 03:23:07.991364 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.991334 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 03:23:07.994679 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:07.994656 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7k6jr\" (UID: \"bdcaeb80-8c1b-47d5-8f13-8576cfb48167\") " pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:08.323086 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:23:08.323049 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: failed to sync configmap cache: timed out waiting for the condition Jun 03 03:23:08.323524 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:23:08.323173 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-kube-rbac-proxy-cm podName:bdcaeb80-8c1b-47d5-8f13-8576cfb48167 nodeName:}" failed. No retries permitted until 2026-06-03 03:23:08.823148965 +0000 UTC m=+172.664730576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7k6jr" (UID: "bdcaeb80-8c1b-47d5-8f13-8576cfb48167") : failed to sync configmap cache: timed out waiting for the condition Jun 03 03:23:08.328038 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:23:08.328009 2575 projected.go:289] Couldn't get configMap openshift-insights/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jun 03 03:23:08.328171 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:23:08.328048 2575 projected.go:194] Error preparing data for projected volume kube-api-access-nxfpk for pod openshift-insights/insights-runtime-extractor-7k6jr: failed to sync configmap cache: timed out waiting for the condition Jun 03 03:23:08.328171 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:23:08.328107 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-kube-api-access-nxfpk podName:bdcaeb80-8c1b-47d5-8f13-8576cfb48167 nodeName:}" failed. No retries permitted until 2026-06-03 03:23:08.828091694 +0000 UTC m=+172.669673304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nxfpk" (UniqueName: "kubernetes.io/projected/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-kube-api-access-nxfpk") pod "insights-runtime-extractor-7k6jr" (UID: "bdcaeb80-8c1b-47d5-8f13-8576cfb48167") : failed to sync configmap cache: timed out waiting for the condition Jun 03 03:23:08.343060 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:08.343018 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2s2h7" event={"ID":"9338190d-d545-403e-888a-43929db2a9ec","Type":"ContainerStarted","Data":"1df039946f20d2a6faebe3094528fe7f02e631041893fdd4382b87f705af53ea"} Jun 03 03:23:08.356338 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:08.356305 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 03:23:08.552683 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:08.552646 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mwlqd\"" Jun 03 03:23:08.571481 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:08.571450 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 03:23:08.833570 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:08.833520 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nxfpk\" (UniqueName: \"kubernetes.io/projected/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-kube-api-access-nxfpk\") pod \"insights-runtime-extractor-7k6jr\" (UID: \"bdcaeb80-8c1b-47d5-8f13-8576cfb48167\") " pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:08.833772 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:08.833612 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7k6jr\" (UID: \"bdcaeb80-8c1b-47d5-8f13-8576cfb48167\") " pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:08.834165 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:08.834142 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7k6jr\" (UID: \"bdcaeb80-8c1b-47d5-8f13-8576cfb48167\") " pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:08.836329 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:08.836304 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxfpk\" (UniqueName: \"kubernetes.io/projected/bdcaeb80-8c1b-47d5-8f13-8576cfb48167-kube-api-access-nxfpk\") pod \"insights-runtime-extractor-7k6jr\" (UID: \"bdcaeb80-8c1b-47d5-8f13-8576cfb48167\") " pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:08.907234 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:08.907198 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7k6jr" Jun 03 03:23:09.506039 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:09.506004 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7k6jr"] Jun 03 03:23:09.509132 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:23:09.509096 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdcaeb80_8c1b_47d5_8f13_8576cfb48167.slice/crio-6ee268fb34069df205771572c23f63ec41751803820fed7abdfdd1e24c41bb16 WatchSource:0}: Error finding container 6ee268fb34069df205771572c23f63ec41751803820fed7abdfdd1e24c41bb16: Status 404 returned error can't find the container with id 6ee268fb34069df205771572c23f63ec41751803820fed7abdfdd1e24c41bb16 Jun 03 03:23:09.777913 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:09.777879 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:23:10.350109 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:10.350072 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7k6jr" event={"ID":"bdcaeb80-8c1b-47d5-8f13-8576cfb48167","Type":"ContainerStarted","Data":"c279ab98c093edc8e903807f70403b471bda60d81259ee50cfa07ae374b57ae7"} Jun 03 03:23:10.350109 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:10.350113 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7k6jr" event={"ID":"bdcaeb80-8c1b-47d5-8f13-8576cfb48167","Type":"ContainerStarted","Data":"46c9e8e654b9f5e8ff2b1e3a3ffebaf26a3631d083ea1cc7fa392f74ec461ca0"} Jun 03 03:23:10.350321 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:10.350124 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7k6jr" event={"ID":"bdcaeb80-8c1b-47d5-8f13-8576cfb48167","Type":"ContainerStarted","Data":"6ee268fb34069df205771572c23f63ec41751803820fed7abdfdd1e24c41bb16"} Jun 03 03:23:10.351284 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:10.351257 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2s2h7" event={"ID":"9338190d-d545-403e-888a-43929db2a9ec","Type":"ContainerStarted","Data":"0b85cf646c0f7c2080362dd79fde26d3722e3dd2033933c85526a6363d8f95b6"} Jun 03 03:23:10.365039 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:10.364983 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2s2h7" podStartSLOduration=138.847448527 podStartE2EDuration="2m20.364964391s" podCreationTimestamp="2026-06-03 03:20:50 +0000 UTC" firstStartedPulling="2026-06-03 03:23:07.916733323 +0000 UTC m=+171.758314918" lastFinishedPulling="2026-06-03 03:23:09.434249169 +0000 UTC m=+173.275830782" observedRunningTime="2026-06-03 03:23:10.364673883 +0000 UTC m=+174.206255525" watchObservedRunningTime="2026-06-03 03:23:10.364964391 +0000 UTC m=+174.206546021" Jun 03 03:23:11.321860 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:11.321824 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hqjbr" Jun 03 03:23:12.358888 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:12.358854 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7k6jr" event={"ID":"bdcaeb80-8c1b-47d5-8f13-8576cfb48167","Type":"ContainerStarted","Data":"8897f38f755c52195b22443415a5b16f4a158ab9cc6a1b472c22c55cf647a17f"} Jun 03 03:23:12.376100 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:12.376042 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7k6jr" podStartSLOduration=3.401747202 podStartE2EDuration="5.376026316s" podCreationTimestamp="2026-06-03 03:23:07 +0000 UTC" firstStartedPulling="2026-06-03 03:23:09.57478945 +0000 UTC m=+173.416371044" lastFinishedPulling="2026-06-03 03:23:11.549068563 +0000 UTC m=+175.390650158" observedRunningTime="2026-06-03 03:23:12.374312552 +0000 UTC m=+176.215894168" watchObservedRunningTime="2026-06-03 03:23:12.376026316 +0000 UTC m=+176.217607932" Jun 03 03:23:17.723014 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.722973 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kqrlb"] Jun 03 03:23:17.726282 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.726257 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.728838 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.728810 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 03:23:17.728959 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.728881 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q9xxj\"" Jun 03 03:23:17.728959 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.728934 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 03:23:17.729406 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.729384 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 03:23:17.729495 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.729406 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 03:23:17.729721 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.729700 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 03:23:17.729798 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.729742 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 03:23:17.806243 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.806204 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.806243 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.806247 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.806470 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.806301 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svj96\" (UniqueName: \"kubernetes.io/projected/24d6a683-3ced-42d6-9168-87f4dcf360ad-kube-api-access-svj96\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.806470 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.806391 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/24d6a683-3ced-42d6-9168-87f4dcf360ad-root\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.806470 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.806412 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d6a683-3ced-42d6-9168-87f4dcf360ad-sys\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.806470 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.806427 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-tls\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.806622 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.806482 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24d6a683-3ced-42d6-9168-87f4dcf360ad-metrics-client-ca\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.806622 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.806523 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-wtmp\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.806622 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.806586 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-textfile\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.906920 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.906874 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-wtmp\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.907121 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.906953 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-textfile\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.907121 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.906989 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.907121 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.907020 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.907121 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.907055 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-svj96\" (UniqueName: \"kubernetes.io/projected/24d6a683-3ced-42d6-9168-87f4dcf360ad-kube-api-access-svj96\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.907121 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.907065 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-wtmp\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.907121 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.907090 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/24d6a683-3ced-42d6-9168-87f4dcf360ad-root\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.907418 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.907140 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/24d6a683-3ced-42d6-9168-87f4dcf360ad-root\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.907418 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.907143 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d6a683-3ced-42d6-9168-87f4dcf360ad-sys\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.907418 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.907170 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-tls\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.907418 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.907198 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24d6a683-3ced-42d6-9168-87f4dcf360ad-metrics-client-ca\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.907418 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.907212 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d6a683-3ced-42d6-9168-87f4dcf360ad-sys\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.907418 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.907408 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-textfile\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.907699 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:23:17.907453 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 03:23:17.907699 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:23:17.907515 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-tls podName:24d6a683-3ced-42d6-9168-87f4dcf360ad nodeName:}" failed. No retries permitted until 2026-06-03 03:23:18.407496475 +0000 UTC m=+182.249078091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-tls") pod "node-exporter-kqrlb" (UID: "24d6a683-3ced-42d6-9168-87f4dcf360ad") : secret "node-exporter-tls" not found Jun 03 03:23:17.907773 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.907730 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.907773 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.907763 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24d6a683-3ced-42d6-9168-87f4dcf360ad-metrics-client-ca\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.909627 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.909607 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:17.919262 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:17.919231 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svj96\" (UniqueName: \"kubernetes.io/projected/24d6a683-3ced-42d6-9168-87f4dcf360ad-kube-api-access-svj96\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:18.412469 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:18.412426 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-tls\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:18.414803 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:18.414773 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/24d6a683-3ced-42d6-9168-87f4dcf360ad-node-exporter-tls\") pod \"node-exporter-kqrlb\" (UID: \"24d6a683-3ced-42d6-9168-87f4dcf360ad\") " pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:18.635685 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:18.635638 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kqrlb" Jun 03 03:23:18.643588 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:23:18.643538 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24d6a683_3ced_42d6_9168_87f4dcf360ad.slice/crio-ede7a275dc7644cb5312ea048d7d43fe2fdd078ebea2562f9eaa4af3174ed28d WatchSource:0}: Error finding container ede7a275dc7644cb5312ea048d7d43fe2fdd078ebea2562f9eaa4af3174ed28d: Status 404 returned error can't find the container with id ede7a275dc7644cb5312ea048d7d43fe2fdd078ebea2562f9eaa4af3174ed28d Jun 03 03:23:18.808114 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:18.808067 2575 patch_prober.go:28] interesting pod/image-registry-75669d8948-dszd5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 03:23:18.808581 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:18.808128 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-75669d8948-dszd5" podUID="423d5b41-b980-48e8-865c-3dcb26d8b0af" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 03:23:19.377302 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:19.377260 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kqrlb" event={"ID":"24d6a683-3ced-42d6-9168-87f4dcf360ad","Type":"ContainerStarted","Data":"ede7a275dc7644cb5312ea048d7d43fe2fdd078ebea2562f9eaa4af3174ed28d"} Jun 03 03:23:20.314275 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:20.314246 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:23:20.381426 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:20.381390 2575 generic.go:358] "Generic (PLEG): container finished" podID="24d6a683-3ced-42d6-9168-87f4dcf360ad" containerID="2982bef58a78da4ed1d829fed50ba7a8b9408279630a4c8757b73698f83036c8" exitCode=0 Jun 03 03:23:20.381626 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:20.381466 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kqrlb" event={"ID":"24d6a683-3ced-42d6-9168-87f4dcf360ad","Type":"ContainerDied","Data":"2982bef58a78da4ed1d829fed50ba7a8b9408279630a4c8757b73698f83036c8"} Jun 03 03:23:21.386322 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:21.386286 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kqrlb" event={"ID":"24d6a683-3ced-42d6-9168-87f4dcf360ad","Type":"ContainerStarted","Data":"de6bded8387db349f64700a262f0ca4bbd32f5c2a580c2507d50077f99054da3"} Jun 03 03:23:21.386322 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:21.386321 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kqrlb" event={"ID":"24d6a683-3ced-42d6-9168-87f4dcf360ad","Type":"ContainerStarted","Data":"803c08076099670c0f4c106ceb4729c5f9565b41dfbc817ba11c664eca7a50f9"} Jun 03 03:23:21.403898 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:21.403850 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kqrlb" podStartSLOduration=3.543947884 podStartE2EDuration="4.403833448s" podCreationTimestamp="2026-06-03 03:23:17 +0000 UTC" firstStartedPulling="2026-06-03 03:23:18.64540395 +0000 UTC m=+182.486985545" lastFinishedPulling="2026-06-03 03:23:19.505289514 +0000 UTC m=+183.346871109" observedRunningTime="2026-06-03 03:23:21.403311296 +0000 UTC m=+185.244892914" watchObservedRunningTime="2026-06-03 03:23:21.403833448 +0000 UTC m=+185.245415067" Jun 03 03:23:28.860364 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:28.860323 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75669d8948-dszd5"] Jun 03 03:23:53.880183 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:53.880149 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2s2h7_9338190d-d545-403e-888a-43929db2a9ec/serve-healthcheck-canary/0.log" Jun 03 03:23:53.880703 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:53.880404 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-75669d8948-dszd5" podUID="423d5b41-b980-48e8-865c-3dcb26d8b0af" containerName="registry" containerID="cri-o://aa2c5afd3f8ec2a94faba3da66f97e71bfe4e21f3375767c5b627256be4f6f6e" gracePeriod=30 Jun 03 03:23:54.149421 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.149394 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:23:54.194444 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.194412 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls\") pod \"423d5b41-b980-48e8-865c-3dcb26d8b0af\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " Jun 03 03:23:54.194663 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.194455 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gb9z\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-kube-api-access-4gb9z\") pod \"423d5b41-b980-48e8-865c-3dcb26d8b0af\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " Jun 03 03:23:54.194663 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.194503 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-bound-sa-token\") pod \"423d5b41-b980-48e8-865c-3dcb26d8b0af\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " Jun 03 03:23:54.194663 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.194535 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/423d5b41-b980-48e8-865c-3dcb26d8b0af-image-registry-private-configuration\") pod \"423d5b41-b980-48e8-865c-3dcb26d8b0af\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " Jun 03 03:23:54.194663 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.194582 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-certificates\") pod \"423d5b41-b980-48e8-865c-3dcb26d8b0af\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " Jun 03 03:23:54.194663 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.194643 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/423d5b41-b980-48e8-865c-3dcb26d8b0af-trusted-ca\") pod \"423d5b41-b980-48e8-865c-3dcb26d8b0af\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " Jun 03 03:23:54.194913 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.194667 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/423d5b41-b980-48e8-865c-3dcb26d8b0af-installation-pull-secrets\") pod \"423d5b41-b980-48e8-865c-3dcb26d8b0af\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " Jun 03 03:23:54.194913 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.194711 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/423d5b41-b980-48e8-865c-3dcb26d8b0af-ca-trust-extracted\") pod \"423d5b41-b980-48e8-865c-3dcb26d8b0af\" (UID: \"423d5b41-b980-48e8-865c-3dcb26d8b0af\") " Jun 03 03:23:54.195527 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.195100 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "423d5b41-b980-48e8-865c-3dcb26d8b0af" (UID: "423d5b41-b980-48e8-865c-3dcb26d8b0af"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:23:54.195707 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.195661 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/423d5b41-b980-48e8-865c-3dcb26d8b0af-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "423d5b41-b980-48e8-865c-3dcb26d8b0af" (UID: "423d5b41-b980-48e8-865c-3dcb26d8b0af"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 03:23:54.197230 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.197184 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "423d5b41-b980-48e8-865c-3dcb26d8b0af" (UID: "423d5b41-b980-48e8-865c-3dcb26d8b0af"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:23:54.197328 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.197281 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-kube-api-access-4gb9z" (OuterVolumeSpecName: "kube-api-access-4gb9z") pod "423d5b41-b980-48e8-865c-3dcb26d8b0af" (UID: "423d5b41-b980-48e8-865c-3dcb26d8b0af"). InnerVolumeSpecName "kube-api-access-4gb9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:23:54.197328 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.197293 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/423d5b41-b980-48e8-865c-3dcb26d8b0af-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "423d5b41-b980-48e8-865c-3dcb26d8b0af" (UID: "423d5b41-b980-48e8-865c-3dcb26d8b0af"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:23:54.197450 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.197428 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "423d5b41-b980-48e8-865c-3dcb26d8b0af" (UID: "423d5b41-b980-48e8-865c-3dcb26d8b0af"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:23:54.197488 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.197451 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/423d5b41-b980-48e8-865c-3dcb26d8b0af-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "423d5b41-b980-48e8-865c-3dcb26d8b0af" (UID: "423d5b41-b980-48e8-865c-3dcb26d8b0af"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 03:23:54.203796 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.203775 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/423d5b41-b980-48e8-865c-3dcb26d8b0af-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "423d5b41-b980-48e8-865c-3dcb26d8b0af" (UID: "423d5b41-b980-48e8-865c-3dcb26d8b0af"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:23:54.295978 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.295944 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-bound-sa-token\") on node \"ip-10-0-130-55.ec2.internal\" DevicePath \"\"" Jun 03 03:23:54.295978 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.295974 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/423d5b41-b980-48e8-865c-3dcb26d8b0af-image-registry-private-configuration\") on node \"ip-10-0-130-55.ec2.internal\" DevicePath \"\"" Jun 03 03:23:54.295978 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.295984 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-certificates\") on node \"ip-10-0-130-55.ec2.internal\" DevicePath \"\"" Jun 03 03:23:54.296214 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.295995 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/423d5b41-b980-48e8-865c-3dcb26d8b0af-trusted-ca\") on node \"ip-10-0-130-55.ec2.internal\" DevicePath \"\"" Jun 03 03:23:54.296214 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.296004 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/423d5b41-b980-48e8-865c-3dcb26d8b0af-installation-pull-secrets\") on node \"ip-10-0-130-55.ec2.internal\" DevicePath \"\"" Jun 03 03:23:54.296214 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.296012 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/423d5b41-b980-48e8-865c-3dcb26d8b0af-ca-trust-extracted\") on node \"ip-10-0-130-55.ec2.internal\" DevicePath \"\"" Jun 03 03:23:54.296214 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.296021 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-registry-tls\") on node \"ip-10-0-130-55.ec2.internal\" DevicePath \"\"" Jun 03 03:23:54.296214 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.296030 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gb9z\" (UniqueName: \"kubernetes.io/projected/423d5b41-b980-48e8-865c-3dcb26d8b0af-kube-api-access-4gb9z\") on node \"ip-10-0-130-55.ec2.internal\" DevicePath \"\"" Jun 03 03:23:54.469726 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.469634 2575 generic.go:358] "Generic (PLEG): container finished" podID="423d5b41-b980-48e8-865c-3dcb26d8b0af" containerID="aa2c5afd3f8ec2a94faba3da66f97e71bfe4e21f3375767c5b627256be4f6f6e" exitCode=0 Jun 03 03:23:54.469726 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.469701 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75669d8948-dszd5" Jun 03 03:23:54.469924 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.469721 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75669d8948-dszd5" event={"ID":"423d5b41-b980-48e8-865c-3dcb26d8b0af","Type":"ContainerDied","Data":"aa2c5afd3f8ec2a94faba3da66f97e71bfe4e21f3375767c5b627256be4f6f6e"} Jun 03 03:23:54.469924 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.469762 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75669d8948-dszd5" event={"ID":"423d5b41-b980-48e8-865c-3dcb26d8b0af","Type":"ContainerDied","Data":"41e10c7f954e2f436bb89d8f4a94fc7b2391430902039eacab77ef5164dd8433"} Jun 03 03:23:54.469924 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.469777 2575 scope.go:117] "RemoveContainer" containerID="aa2c5afd3f8ec2a94faba3da66f97e71bfe4e21f3375767c5b627256be4f6f6e" Jun 03 03:23:54.478261 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.478242 2575 scope.go:117] "RemoveContainer" containerID="aa2c5afd3f8ec2a94faba3da66f97e71bfe4e21f3375767c5b627256be4f6f6e" Jun 03 03:23:54.478591 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:23:54.478537 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa2c5afd3f8ec2a94faba3da66f97e71bfe4e21f3375767c5b627256be4f6f6e\": container with ID starting with aa2c5afd3f8ec2a94faba3da66f97e71bfe4e21f3375767c5b627256be4f6f6e not found: ID does not exist" containerID="aa2c5afd3f8ec2a94faba3da66f97e71bfe4e21f3375767c5b627256be4f6f6e" Jun 03 03:23:54.478663 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.478603 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa2c5afd3f8ec2a94faba3da66f97e71bfe4e21f3375767c5b627256be4f6f6e"} err="failed to get container status \"aa2c5afd3f8ec2a94faba3da66f97e71bfe4e21f3375767c5b627256be4f6f6e\": rpc error: code = NotFound desc = could not find container \"aa2c5afd3f8ec2a94faba3da66f97e71bfe4e21f3375767c5b627256be4f6f6e\": container with ID starting with aa2c5afd3f8ec2a94faba3da66f97e71bfe4e21f3375767c5b627256be4f6f6e not found: ID does not exist" Jun 03 03:23:54.489565 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.489504 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75669d8948-dszd5"] Jun 03 03:23:54.494436 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.494412 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75669d8948-dszd5"] Jun 03 03:23:54.782154 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:54.782123 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="423d5b41-b980-48e8-865c-3dcb26d8b0af" path="/var/lib/kubelet/pods/423d5b41-b980-48e8-865c-3dcb26d8b0af/volumes" Jun 03 03:23:55.208649 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:23:55.208541 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" podUID="8efd4f8b-9e8b-4688-8480-3f4f9c9c291a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 03:24:05.208990 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:24:05.208934 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" podUID="8efd4f8b-9e8b-4688-8480-3f4f9c9c291a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 03:24:15.207607 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:24:15.207541 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" podUID="8efd4f8b-9e8b-4688-8480-3f4f9c9c291a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 03:24:15.208058 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:24:15.207646 2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" Jun 03 03:24:15.208145 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:24:15.208127 2575 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"295136d6ffc0cb70455365345670a7262d18b289db1864928a6b99ea55ef327f"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 03 03:24:15.208190 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:24:15.208167 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" podUID="8efd4f8b-9e8b-4688-8480-3f4f9c9c291a" containerName="service-proxy" containerID="cri-o://295136d6ffc0cb70455365345670a7262d18b289db1864928a6b99ea55ef327f" gracePeriod=30 Jun 03 03:24:15.527966 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:24:15.527930 2575 generic.go:358] "Generic (PLEG): container finished" podID="8efd4f8b-9e8b-4688-8480-3f4f9c9c291a" containerID="295136d6ffc0cb70455365345670a7262d18b289db1864928a6b99ea55ef327f" exitCode=2 Jun 03 03:24:15.528113 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:24:15.527991 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" event={"ID":"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a","Type":"ContainerDied","Data":"295136d6ffc0cb70455365345670a7262d18b289db1864928a6b99ea55ef327f"} Jun 03 03:24:15.528113 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:24:15.528030 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7ff64b9564-v22jb" event={"ID":"8efd4f8b-9e8b-4688-8480-3f4f9c9c291a","Type":"ContainerStarted","Data":"f4ad004f8ba009fccf047fbd8e14d69c5bd438a9ebf702bcb89d89748a8d3937"} Jun 03 03:24:27.656906 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:24:27.656860 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs\") pod \"network-metrics-daemon-trw96\" (UID: \"0085db10-4407-48e2-b27f-2abf8391ee43\") " pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:24:27.659385 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:24:27.659363 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0085db10-4407-48e2-b27f-2abf8391ee43-metrics-certs\") pod \"network-metrics-daemon-trw96\" (UID: \"0085db10-4407-48e2-b27f-2abf8391ee43\") " pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:24:27.781388 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:24:27.781359 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bwf2t\"" Jun 03 03:24:27.790089 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:24:27.790061 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trw96" Jun 03 03:24:27.914933 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:24:27.914858 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-trw96"] Jun 03 03:24:27.918298 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:24:27.918269 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0085db10_4407_48e2_b27f_2abf8391ee43.slice/crio-666b8397d3fb0de5467afd5cb05b3cc8ddda7c8dff1a3e8f327431eb78d675c9 WatchSource:0}: Error finding container 666b8397d3fb0de5467afd5cb05b3cc8ddda7c8dff1a3e8f327431eb78d675c9: Status 404 returned error can't find the container with id 666b8397d3fb0de5467afd5cb05b3cc8ddda7c8dff1a3e8f327431eb78d675c9 Jun 03 03:24:28.560909 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:24:28.560871 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-trw96" event={"ID":"0085db10-4407-48e2-b27f-2abf8391ee43","Type":"ContainerStarted","Data":"666b8397d3fb0de5467afd5cb05b3cc8ddda7c8dff1a3e8f327431eb78d675c9"} Jun 03 03:24:29.565317 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:24:29.565272 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-trw96" event={"ID":"0085db10-4407-48e2-b27f-2abf8391ee43","Type":"ContainerStarted","Data":"e538d02963c999664e2c805b8319a89a7c4c437d4b54f8481fa412c98cebe78f"} Jun 03 03:24:29.565317 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:24:29.565311 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-trw96" event={"ID":"0085db10-4407-48e2-b27f-2abf8391ee43","Type":"ContainerStarted","Data":"bdef60afab216a3ef89adb24fefb268595f6232be23a81c6207001c89131d77c"} Jun 03 03:24:29.580883 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:24:29.580829 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-trw96" podStartSLOduration=251.344119449 podStartE2EDuration="4m12.580815583s" podCreationTimestamp="2026-06-03 03:20:17 +0000 UTC" firstStartedPulling="2026-06-03 03:24:27.920146005 +0000 UTC m=+251.761727599" lastFinishedPulling="2026-06-03 03:24:29.156842138 +0000 UTC m=+252.998423733" observedRunningTime="2026-06-03 03:24:29.579762253 +0000 UTC m=+253.421343871" watchObservedRunningTime="2026-06-03 03:24:29.580815583 +0000 UTC m=+253.422397200" Jun 03 03:25:16.683977 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:25:16.683948 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:25:16.684457 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:25:16.684044 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:25:16.689000 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:25:16.688980 2575 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 03:27:21.185068 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.185035 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-z6x8f"] Jun 03 03:27:21.185528 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.185306 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="423d5b41-b980-48e8-865c-3dcb26d8b0af" containerName="registry" Jun 03 03:27:21.185528 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.185319 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="423d5b41-b980-48e8-865c-3dcb26d8b0af" containerName="registry" Jun 03 03:27:21.185528 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.185389 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="423d5b41-b980-48e8-865c-3dcb26d8b0af" containerName="registry" Jun 03 03:27:21.188148 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.188126 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z6x8f" Jun 03 03:27:21.190367 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.190343 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 03:27:21.190482 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.190431 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 03:27:21.191129 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.191112 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gv428\"" Jun 03 03:27:21.195150 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.194941 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-z6x8f"] Jun 03 03:27:21.253419 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.253384 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk6sl\" (UniqueName: \"kubernetes.io/projected/9f9c4e15-c8e3-4651-907f-182633560542-kube-api-access-vk6sl\") pod \"openshift-lws-operator-bfc7f696d-z6x8f\" (UID: \"9f9c4e15-c8e3-4651-907f-182633560542\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z6x8f" Jun 03 03:27:21.253641 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.253436 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f9c4e15-c8e3-4651-907f-182633560542-tmp\") pod \"openshift-lws-operator-bfc7f696d-z6x8f\" (UID: \"9f9c4e15-c8e3-4651-907f-182633560542\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z6x8f" Jun 03 03:27:21.354736 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.354698 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vk6sl\" (UniqueName: \"kubernetes.io/projected/9f9c4e15-c8e3-4651-907f-182633560542-kube-api-access-vk6sl\") pod \"openshift-lws-operator-bfc7f696d-z6x8f\" (UID: \"9f9c4e15-c8e3-4651-907f-182633560542\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z6x8f" Jun 03 03:27:21.354880 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.354750 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f9c4e15-c8e3-4651-907f-182633560542-tmp\") pod \"openshift-lws-operator-bfc7f696d-z6x8f\" (UID: \"9f9c4e15-c8e3-4651-907f-182633560542\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z6x8f" Jun 03 03:27:21.355093 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.355077 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f9c4e15-c8e3-4651-907f-182633560542-tmp\") pod \"openshift-lws-operator-bfc7f696d-z6x8f\" (UID: \"9f9c4e15-c8e3-4651-907f-182633560542\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z6x8f" Jun 03 03:27:21.366355 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.366318 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk6sl\" (UniqueName: \"kubernetes.io/projected/9f9c4e15-c8e3-4651-907f-182633560542-kube-api-access-vk6sl\") pod \"openshift-lws-operator-bfc7f696d-z6x8f\" (UID: \"9f9c4e15-c8e3-4651-907f-182633560542\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z6x8f" Jun 03 03:27:21.497619 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.497500 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z6x8f" Jun 03 03:27:21.622170 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.622134 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-z6x8f"] Jun 03 03:27:21.626078 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:27:21.626050 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f9c4e15_c8e3_4651_907f_182633560542.slice/crio-657189af0f23f9d24c5086abbc2d3fac33518360e20212d99ff22ab1d3239a77 WatchSource:0}: Error finding container 657189af0f23f9d24c5086abbc2d3fac33518360e20212d99ff22ab1d3239a77: Status 404 returned error can't find the container with id 657189af0f23f9d24c5086abbc2d3fac33518360e20212d99ff22ab1d3239a77 Jun 03 03:27:21.627410 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:21.627393 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 03:27:22.000171 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:22.000133 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z6x8f" event={"ID":"9f9c4e15-c8e3-4651-907f-182633560542","Type":"ContainerStarted","Data":"657189af0f23f9d24c5086abbc2d3fac33518360e20212d99ff22ab1d3239a77"} Jun 03 03:27:25.009158 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:25.009110 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z6x8f" event={"ID":"9f9c4e15-c8e3-4651-907f-182633560542","Type":"ContainerStarted","Data":"06a326078cb60647c564d9be626be9dfdbadb1417444c54af7fd4d946c347ab3"} Jun 03 03:27:25.026497 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:25.026434 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z6x8f" podStartSLOduration=1.402883323 podStartE2EDuration="4.026414322s" podCreationTimestamp="2026-06-03 03:27:21 +0000 UTC" firstStartedPulling="2026-06-03 03:27:21.627514986 +0000 UTC m=+425.469096594" lastFinishedPulling="2026-06-03 03:27:24.251045997 +0000 UTC m=+428.092627593" observedRunningTime="2026-06-03 03:27:25.025445208 +0000 UTC m=+428.867026824" watchObservedRunningTime="2026-06-03 03:27:25.026414322 +0000 UTC m=+428.867995939" Jun 03 03:27:44.433866 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.433778 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd"] Jun 03 03:27:44.436980 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.436961 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:44.439256 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.439211 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 03:27:44.439402 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.439273 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nqt2b\"" Jun 03 03:27:44.439402 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.439286 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 03:27:44.439402 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.439381 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 03:27:44.440159 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.440143 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 03:27:44.449088 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.449066 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd"] Jun 03 03:27:44.526931 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.526890 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/deeb95c6-2bad-48a9-bea1-669c0b515934-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f864588-g98jd\" (UID: \"deeb95c6-2bad-48a9-bea1-669c0b515934\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:44.526931 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.526930 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/deeb95c6-2bad-48a9-bea1-669c0b515934-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f864588-g98jd\" (UID: \"deeb95c6-2bad-48a9-bea1-669c0b515934\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:44.527163 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.526956 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/deeb95c6-2bad-48a9-bea1-669c0b515934-manifests\") pod \"opendatahub-operator-controller-manager-68f864588-g98jd\" (UID: \"deeb95c6-2bad-48a9-bea1-669c0b515934\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:44.527163 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.527073 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/deeb95c6-2bad-48a9-bea1-669c0b515934-tmp\") pod \"opendatahub-operator-controller-manager-68f864588-g98jd\" (UID: \"deeb95c6-2bad-48a9-bea1-669c0b515934\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:44.527163 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.527125 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dtlh\" (UniqueName: \"kubernetes.io/projected/deeb95c6-2bad-48a9-bea1-669c0b515934-kube-api-access-2dtlh\") pod \"opendatahub-operator-controller-manager-68f864588-g98jd\" (UID: \"deeb95c6-2bad-48a9-bea1-669c0b515934\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:44.628000 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.627958 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2dtlh\" (UniqueName: \"kubernetes.io/projected/deeb95c6-2bad-48a9-bea1-669c0b515934-kube-api-access-2dtlh\") pod \"opendatahub-operator-controller-manager-68f864588-g98jd\" (UID: \"deeb95c6-2bad-48a9-bea1-669c0b515934\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:44.628198 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.628016 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/deeb95c6-2bad-48a9-bea1-669c0b515934-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f864588-g98jd\" (UID: \"deeb95c6-2bad-48a9-bea1-669c0b515934\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:44.628198 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.628047 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/deeb95c6-2bad-48a9-bea1-669c0b515934-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f864588-g98jd\" (UID: \"deeb95c6-2bad-48a9-bea1-669c0b515934\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:44.628198 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.628077 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/deeb95c6-2bad-48a9-bea1-669c0b515934-manifests\") pod \"opendatahub-operator-controller-manager-68f864588-g98jd\" (UID: \"deeb95c6-2bad-48a9-bea1-669c0b515934\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:44.628198 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.628121 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/deeb95c6-2bad-48a9-bea1-669c0b515934-tmp\") pod \"opendatahub-operator-controller-manager-68f864588-g98jd\" (UID: \"deeb95c6-2bad-48a9-bea1-669c0b515934\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:44.628500 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.628474 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/deeb95c6-2bad-48a9-bea1-669c0b515934-manifests\") pod \"opendatahub-operator-controller-manager-68f864588-g98jd\" (UID: \"deeb95c6-2bad-48a9-bea1-669c0b515934\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:44.630706 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.630676 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/deeb95c6-2bad-48a9-bea1-669c0b515934-tmp\") pod \"opendatahub-operator-controller-manager-68f864588-g98jd\" (UID: \"deeb95c6-2bad-48a9-bea1-669c0b515934\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:44.630820 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.630753 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/deeb95c6-2bad-48a9-bea1-669c0b515934-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f864588-g98jd\" (UID: \"deeb95c6-2bad-48a9-bea1-669c0b515934\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:44.630875 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.630813 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/deeb95c6-2bad-48a9-bea1-669c0b515934-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f864588-g98jd\" (UID: \"deeb95c6-2bad-48a9-bea1-669c0b515934\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:44.636032 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.636000 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dtlh\" (UniqueName: \"kubernetes.io/projected/deeb95c6-2bad-48a9-bea1-669c0b515934-kube-api-access-2dtlh\") pod \"opendatahub-operator-controller-manager-68f864588-g98jd\" (UID: \"deeb95c6-2bad-48a9-bea1-669c0b515934\") " pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:44.747623 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.747493 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:44.884764 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:44.884730 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd"] Jun 03 03:27:44.888732 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:27:44.888700 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeeb95c6_2bad_48a9_bea1_669c0b515934.slice/crio-18b5705e94a79801117903d1a30c27ff45771265d99060317f3dd607a712bba1 WatchSource:0}: Error finding container 18b5705e94a79801117903d1a30c27ff45771265d99060317f3dd607a712bba1: Status 404 returned error can't find the container with id 18b5705e94a79801117903d1a30c27ff45771265d99060317f3dd607a712bba1 Jun 03 03:27:45.058975 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:45.058940 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" event={"ID":"deeb95c6-2bad-48a9-bea1-669c0b515934","Type":"ContainerStarted","Data":"18b5705e94a79801117903d1a30c27ff45771265d99060317f3dd607a712bba1"} Jun 03 03:27:48.068160 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:48.068120 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" event={"ID":"deeb95c6-2bad-48a9-bea1-669c0b515934","Type":"ContainerStarted","Data":"4edb5984cefcb5b1bbc5fbb5513acdf50aa244bbe7fb1ae86568326a50852514"} Jun 03 03:27:49.072057 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:49.072021 2575 generic.go:358] "Generic (PLEG): container finished" podID="deeb95c6-2bad-48a9-bea1-669c0b515934" containerID="4edb5984cefcb5b1bbc5fbb5513acdf50aa244bbe7fb1ae86568326a50852514" exitCode=0 Jun 03 03:27:49.072431 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:49.072066 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" event={"ID":"deeb95c6-2bad-48a9-bea1-669c0b515934","Type":"ContainerDied","Data":"4edb5984cefcb5b1bbc5fbb5513acdf50aa244bbe7fb1ae86568326a50852514"} Jun 03 03:27:50.076434 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:50.076393 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" event={"ID":"deeb95c6-2bad-48a9-bea1-669c0b515934","Type":"ContainerStarted","Data":"1d4613723393c5b52a69dbabe754eb2b026ddcfd4863b53252795ce4466eb6cc"} Jun 03 03:27:50.076907 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:50.076547 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:27:50.095070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:27:50.095016 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" podStartSLOduration=1.592007495 podStartE2EDuration="6.09500127s" podCreationTimestamp="2026-06-03 03:27:44 +0000 UTC" firstStartedPulling="2026-06-03 03:27:44.89037112 +0000 UTC m=+448.731952729" lastFinishedPulling="2026-06-03 03:27:49.393364906 +0000 UTC m=+453.234946504" observedRunningTime="2026-06-03 03:27:50.093683128 +0000 UTC m=+453.935264757" watchObservedRunningTime="2026-06-03 03:27:50.09500127 +0000 UTC m=+453.936582886" Jun 03 03:28:01.081366 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:01.081331 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68f864588-g98jd" Jun 03 03:28:03.975543 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:03.975503 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-9gg8h"] Jun 03 03:28:03.983869 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:03.983836 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-9gg8h" Jun 03 03:28:03.986692 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:03.986660 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-q7vkx\"" Jun 03 03:28:03.986842 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:03.986670 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 03 03:28:03.987484 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:03.987463 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-9gg8h"] Jun 03 03:28:04.076157 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:04.076123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e767d090-f951-4962-b654-88f34200fe01-cert\") pod \"odh-model-controller-76588b95-9gg8h\" (UID: \"e767d090-f951-4962-b654-88f34200fe01\") " pod="opendatahub/odh-model-controller-76588b95-9gg8h" Jun 03 03:28:04.076334 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:04.076247 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzsp4\" (UniqueName: \"kubernetes.io/projected/e767d090-f951-4962-b654-88f34200fe01-kube-api-access-fzsp4\") pod \"odh-model-controller-76588b95-9gg8h\" (UID: \"e767d090-f951-4962-b654-88f34200fe01\") " pod="opendatahub/odh-model-controller-76588b95-9gg8h" Jun 03 03:28:04.176873 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:04.176834 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzsp4\" (UniqueName: \"kubernetes.io/projected/e767d090-f951-4962-b654-88f34200fe01-kube-api-access-fzsp4\") pod \"odh-model-controller-76588b95-9gg8h\" (UID: \"e767d090-f951-4962-b654-88f34200fe01\") " pod="opendatahub/odh-model-controller-76588b95-9gg8h" Jun 03 03:28:04.176873 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:04.176876 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e767d090-f951-4962-b654-88f34200fe01-cert\") pod \"odh-model-controller-76588b95-9gg8h\" (UID: \"e767d090-f951-4962-b654-88f34200fe01\") " pod="opendatahub/odh-model-controller-76588b95-9gg8h" Jun 03 03:28:04.177092 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:28:04.176974 2575 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 03 03:28:04.177145 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:28:04.177109 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e767d090-f951-4962-b654-88f34200fe01-cert podName:e767d090-f951-4962-b654-88f34200fe01 nodeName:}" failed. No retries permitted until 2026-06-03 03:28:04.677020632 +0000 UTC m=+468.518602227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e767d090-f951-4962-b654-88f34200fe01-cert") pod "odh-model-controller-76588b95-9gg8h" (UID: "e767d090-f951-4962-b654-88f34200fe01") : secret "odh-model-controller-webhook-cert" not found Jun 03 03:28:04.185686 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:04.185653 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzsp4\" (UniqueName: \"kubernetes.io/projected/e767d090-f951-4962-b654-88f34200fe01-kube-api-access-fzsp4\") pod \"odh-model-controller-76588b95-9gg8h\" (UID: \"e767d090-f951-4962-b654-88f34200fe01\") " pod="opendatahub/odh-model-controller-76588b95-9gg8h" Jun 03 03:28:04.681034 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:04.680985 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e767d090-f951-4962-b654-88f34200fe01-cert\") pod \"odh-model-controller-76588b95-9gg8h\" (UID: \"e767d090-f951-4962-b654-88f34200fe01\") " pod="opendatahub/odh-model-controller-76588b95-9gg8h" Jun 03 03:28:04.683721 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:04.683694 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e767d090-f951-4962-b654-88f34200fe01-cert\") pod \"odh-model-controller-76588b95-9gg8h\" (UID: \"e767d090-f951-4962-b654-88f34200fe01\") " pod="opendatahub/odh-model-controller-76588b95-9gg8h" Jun 03 03:28:04.875137 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:04.875102 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-2qqgr"] Jun 03 03:28:04.878218 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:04.878195 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-2qqgr" Jun 03 03:28:04.880381 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:04.880359 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 03 03:28:04.885503 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:04.885481 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-2qqgr"] Jun 03 03:28:04.895602 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:04.895574 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-9gg8h" Jun 03 03:28:04.983007 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:04.982890 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc6d49b-5baf-4ced-b964-578f1be0fc8a-tls-certs\") pod \"model-serving-api-6577596cd5-2qqgr\" (UID: \"bfc6d49b-5baf-4ced-b964-578f1be0fc8a\") " pod="opendatahub/model-serving-api-6577596cd5-2qqgr" Jun 03 03:28:04.983007 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:04.982926 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjplp\" (UniqueName: \"kubernetes.io/projected/bfc6d49b-5baf-4ced-b964-578f1be0fc8a-kube-api-access-rjplp\") pod \"model-serving-api-6577596cd5-2qqgr\" (UID: \"bfc6d49b-5baf-4ced-b964-578f1be0fc8a\") " pod="opendatahub/model-serving-api-6577596cd5-2qqgr" Jun 03 03:28:05.031430 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:05.031387 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-9gg8h"] Jun 03 03:28:05.034985 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:28:05.034955 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode767d090_f951_4962_b654_88f34200fe01.slice/crio-6e68a8f63eb43e7703191019d8d256cfe74e531ba8cd7580e13306713d2f025b WatchSource:0}: Error finding container 6e68a8f63eb43e7703191019d8d256cfe74e531ba8cd7580e13306713d2f025b: Status 404 returned error can't find the container with id 6e68a8f63eb43e7703191019d8d256cfe74e531ba8cd7580e13306713d2f025b Jun 03 03:28:05.084029 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:05.083985 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc6d49b-5baf-4ced-b964-578f1be0fc8a-tls-certs\") pod \"model-serving-api-6577596cd5-2qqgr\" (UID: \"bfc6d49b-5baf-4ced-b964-578f1be0fc8a\") " pod="opendatahub/model-serving-api-6577596cd5-2qqgr" Jun 03 03:28:05.084029 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:05.084026 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rjplp\" (UniqueName: \"kubernetes.io/projected/bfc6d49b-5baf-4ced-b964-578f1be0fc8a-kube-api-access-rjplp\") pod \"model-serving-api-6577596cd5-2qqgr\" (UID: \"bfc6d49b-5baf-4ced-b964-578f1be0fc8a\") " pod="opendatahub/model-serving-api-6577596cd5-2qqgr" Jun 03 03:28:05.086621 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:05.086595 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc6d49b-5baf-4ced-b964-578f1be0fc8a-tls-certs\") pod \"model-serving-api-6577596cd5-2qqgr\" (UID: \"bfc6d49b-5baf-4ced-b964-578f1be0fc8a\") " pod="opendatahub/model-serving-api-6577596cd5-2qqgr" Jun 03 03:28:05.092109 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:05.092076 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjplp\" (UniqueName: \"kubernetes.io/projected/bfc6d49b-5baf-4ced-b964-578f1be0fc8a-kube-api-access-rjplp\") pod \"model-serving-api-6577596cd5-2qqgr\" (UID: \"bfc6d49b-5baf-4ced-b964-578f1be0fc8a\") " pod="opendatahub/model-serving-api-6577596cd5-2qqgr" Jun 03 03:28:05.117801 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:05.117752 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-9gg8h" event={"ID":"e767d090-f951-4962-b654-88f34200fe01","Type":"ContainerStarted","Data":"6e68a8f63eb43e7703191019d8d256cfe74e531ba8cd7580e13306713d2f025b"} Jun 03 03:28:05.189436 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:05.189396 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-2qqgr" Jun 03 03:28:05.320880 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:05.320838 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-2qqgr"] Jun 03 03:28:05.324089 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:28:05.324053 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfc6d49b_5baf_4ced_b964_578f1be0fc8a.slice/crio-c1ffd2860019b309de1f690797a394db9b5fe4d396082a364cd51e2cd5930c24 WatchSource:0}: Error finding container c1ffd2860019b309de1f690797a394db9b5fe4d396082a364cd51e2cd5930c24: Status 404 returned error can't find the container with id c1ffd2860019b309de1f690797a394db9b5fe4d396082a364cd51e2cd5930c24 Jun 03 03:28:06.123113 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:06.123069 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-2qqgr" event={"ID":"bfc6d49b-5baf-4ced-b964-578f1be0fc8a","Type":"ContainerStarted","Data":"c1ffd2860019b309de1f690797a394db9b5fe4d396082a364cd51e2cd5930c24"} Jun 03 03:28:06.814207 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:06.812964 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6969fb6c4b-96g8q"] Jun 03 03:28:06.820222 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:06.819691 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-96g8q" Jun 03 03:28:06.821625 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:06.821598 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 03:28:06.822057 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:06.822036 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 03:28:06.822233 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:06.822217 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 03:28:06.822963 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:06.822397 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-52qj6\"" Jun 03 03:28:06.822963 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:06.822596 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 03:28:06.825276 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:06.825257 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6969fb6c4b-96g8q"] Jun 03 03:28:06.899650 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:06.899486 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68kdz\" (UniqueName: \"kubernetes.io/projected/a952be14-696c-4531-ba3c-9cd1975889d3-kube-api-access-68kdz\") pod \"kube-auth-proxy-6969fb6c4b-96g8q\" (UID: \"a952be14-696c-4531-ba3c-9cd1975889d3\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-96g8q" Jun 03 03:28:06.899650 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:06.899601 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a952be14-696c-4531-ba3c-9cd1975889d3-tls-certs\") pod \"kube-auth-proxy-6969fb6c4b-96g8q\" (UID: \"a952be14-696c-4531-ba3c-9cd1975889d3\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-96g8q" Jun 03 03:28:06.899912 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:06.899668 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a952be14-696c-4531-ba3c-9cd1975889d3-tmp\") pod \"kube-auth-proxy-6969fb6c4b-96g8q\" (UID: \"a952be14-696c-4531-ba3c-9cd1975889d3\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-96g8q" Jun 03 03:28:07.000945 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:07.000902 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-68kdz\" (UniqueName: \"kubernetes.io/projected/a952be14-696c-4531-ba3c-9cd1975889d3-kube-api-access-68kdz\") pod \"kube-auth-proxy-6969fb6c4b-96g8q\" (UID: \"a952be14-696c-4531-ba3c-9cd1975889d3\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-96g8q" Jun 03 03:28:07.001131 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:07.000997 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a952be14-696c-4531-ba3c-9cd1975889d3-tls-certs\") pod \"kube-auth-proxy-6969fb6c4b-96g8q\" (UID: \"a952be14-696c-4531-ba3c-9cd1975889d3\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-96g8q" Jun 03 03:28:07.001131 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:07.001027 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a952be14-696c-4531-ba3c-9cd1975889d3-tmp\") pod \"kube-auth-proxy-6969fb6c4b-96g8q\" (UID: \"a952be14-696c-4531-ba3c-9cd1975889d3\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-96g8q" Jun 03 03:28:07.004206 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:07.004162 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a952be14-696c-4531-ba3c-9cd1975889d3-tmp\") pod \"kube-auth-proxy-6969fb6c4b-96g8q\" (UID: \"a952be14-696c-4531-ba3c-9cd1975889d3\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-96g8q" Jun 03 03:28:07.004358 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:07.004284 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a952be14-696c-4531-ba3c-9cd1975889d3-tls-certs\") pod \"kube-auth-proxy-6969fb6c4b-96g8q\" (UID: \"a952be14-696c-4531-ba3c-9cd1975889d3\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-96g8q" Jun 03 03:28:07.009164 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:07.009111 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68kdz\" (UniqueName: \"kubernetes.io/projected/a952be14-696c-4531-ba3c-9cd1975889d3-kube-api-access-68kdz\") pod \"kube-auth-proxy-6969fb6c4b-96g8q\" (UID: \"a952be14-696c-4531-ba3c-9cd1975889d3\") " pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-96g8q" Jun 03 03:28:07.136403 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:07.136318 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-96g8q" Jun 03 03:28:09.281315 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:09.281277 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6969fb6c4b-96g8q"] Jun 03 03:28:09.284598 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:28:09.284538 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda952be14_696c_4531_ba3c_9cd1975889d3.slice/crio-e0ec86dd7b0818ee6fef046fa0f1a221b836bcc687daefc1a5589d1d5590c284 WatchSource:0}: Error finding container e0ec86dd7b0818ee6fef046fa0f1a221b836bcc687daefc1a5589d1d5590c284: Status 404 returned error can't find the container with id e0ec86dd7b0818ee6fef046fa0f1a221b836bcc687daefc1a5589d1d5590c284 Jun 03 03:28:10.140001 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:10.139949 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-9gg8h" event={"ID":"e767d090-f951-4962-b654-88f34200fe01","Type":"ContainerStarted","Data":"98c116d874a365b806275d7c8fdd805e577a74dd4f17fc2e1203afdc44b4779f"} Jun 03 03:28:10.140209 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:10.140079 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-9gg8h" Jun 03 03:28:10.141451 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:10.141424 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-2qqgr" event={"ID":"bfc6d49b-5baf-4ced-b964-578f1be0fc8a","Type":"ContainerStarted","Data":"68ce810120ac7e69beef777a1259da17661ab2ef89fed6ff3815fe84c5ba4346"} Jun 03 03:28:10.141612 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:10.141596 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-2qqgr" Jun 03 03:28:10.142960 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:10.142925 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-96g8q" event={"ID":"a952be14-696c-4531-ba3c-9cd1975889d3","Type":"ContainerStarted","Data":"e0ec86dd7b0818ee6fef046fa0f1a221b836bcc687daefc1a5589d1d5590c284"} Jun 03 03:28:10.159846 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:10.159768 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-9gg8h" podStartSLOduration=3.056558099 podStartE2EDuration="7.159749509s" podCreationTimestamp="2026-06-03 03:28:03 +0000 UTC" firstStartedPulling="2026-06-03 03:28:05.036352072 +0000 UTC m=+468.877933667" lastFinishedPulling="2026-06-03 03:28:09.139543482 +0000 UTC m=+472.981125077" observedRunningTime="2026-06-03 03:28:10.158414535 +0000 UTC m=+473.999996153" watchObservedRunningTime="2026-06-03 03:28:10.159749509 +0000 UTC m=+474.001331128" Jun 03 03:28:10.173655 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:10.173599 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-2qqgr" podStartSLOduration=2.364445586 podStartE2EDuration="6.173582299s" podCreationTimestamp="2026-06-03 03:28:04 +0000 UTC" firstStartedPulling="2026-06-03 03:28:05.325959939 +0000 UTC m=+469.167541550" lastFinishedPulling="2026-06-03 03:28:09.135096662 +0000 UTC m=+472.976678263" observedRunningTime="2026-06-03 03:28:10.171902878 +0000 UTC m=+474.013484519" watchObservedRunningTime="2026-06-03 03:28:10.173582299 +0000 UTC m=+474.015163916" Jun 03 03:28:12.150733 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:12.150693 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-96g8q" event={"ID":"a952be14-696c-4531-ba3c-9cd1975889d3","Type":"ContainerStarted","Data":"0d82fd45e8ccb25d3a1521cd7d1f9c168e896815c16f5ef94c1f7990200ccadc"} Jun 03 03:28:12.166573 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:12.166487 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6969fb6c4b-96g8q" podStartSLOduration=4.182282665 podStartE2EDuration="6.166470725s" podCreationTimestamp="2026-06-03 03:28:06 +0000 UTC" firstStartedPulling="2026-06-03 03:28:09.286684838 +0000 UTC m=+473.128266433" lastFinishedPulling="2026-06-03 03:28:11.27087288 +0000 UTC m=+475.112454493" observedRunningTime="2026-06-03 03:28:12.165998334 +0000 UTC m=+476.007579951" watchObservedRunningTime="2026-06-03 03:28:12.166470725 +0000 UTC m=+476.008052358" Jun 03 03:28:14.561707 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.561665 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-8q7zf"] Jun 03 03:28:14.565082 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.565058 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8q7zf" Jun 03 03:28:14.567504 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.567477 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 03 03:28:14.567662 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.567620 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vx4rb\"" Jun 03 03:28:14.575506 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.575483 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-8q7zf"] Jun 03 03:28:14.578625 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.578603 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-s8825"] Jun 03 03:28:14.581636 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.581618 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-s8825" Jun 03 03:28:14.583830 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.583810 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 03 03:28:14.583915 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.583878 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-56kzh\"" Jun 03 03:28:14.593755 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.593730 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-s8825"] Jun 03 03:28:14.662322 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.662286 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae402e12-82a7-442e-9d82-c04d5f81dfed-cert\") pod \"kserve-controller-manager-7c99ffcdcd-8q7zf\" (UID: \"ae402e12-82a7-442e-9d82-c04d5f81dfed\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8q7zf" Jun 03 03:28:14.662522 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.662335 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj8ss\" (UniqueName: \"kubernetes.io/projected/ae402e12-82a7-442e-9d82-c04d5f81dfed-kube-api-access-mj8ss\") pod \"kserve-controller-manager-7c99ffcdcd-8q7zf\" (UID: \"ae402e12-82a7-442e-9d82-c04d5f81dfed\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8q7zf" Jun 03 03:28:14.662522 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.662389 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wschh\" (UniqueName: \"kubernetes.io/projected/76a486e8-1110-4190-9b29-5b3a282a091c-kube-api-access-wschh\") pod \"llmisvc-controller-manager-c6b9847d7-s8825\" (UID: \"76a486e8-1110-4190-9b29-5b3a282a091c\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-s8825" Jun 03 03:28:14.662522 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.662449 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76a486e8-1110-4190-9b29-5b3a282a091c-cert\") pod \"llmisvc-controller-manager-c6b9847d7-s8825\" (UID: \"76a486e8-1110-4190-9b29-5b3a282a091c\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-s8825" Jun 03 03:28:14.763581 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.763512 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76a486e8-1110-4190-9b29-5b3a282a091c-cert\") pod \"llmisvc-controller-manager-c6b9847d7-s8825\" (UID: \"76a486e8-1110-4190-9b29-5b3a282a091c\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-s8825" Jun 03 03:28:14.763730 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.763599 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae402e12-82a7-442e-9d82-c04d5f81dfed-cert\") pod \"kserve-controller-manager-7c99ffcdcd-8q7zf\" (UID: \"ae402e12-82a7-442e-9d82-c04d5f81dfed\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8q7zf" Jun 03 03:28:14.763730 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.763623 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mj8ss\" (UniqueName: \"kubernetes.io/projected/ae402e12-82a7-442e-9d82-c04d5f81dfed-kube-api-access-mj8ss\") pod \"kserve-controller-manager-7c99ffcdcd-8q7zf\" (UID: \"ae402e12-82a7-442e-9d82-c04d5f81dfed\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8q7zf" Jun 03 03:28:14.763730 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.763641 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wschh\" (UniqueName: \"kubernetes.io/projected/76a486e8-1110-4190-9b29-5b3a282a091c-kube-api-access-wschh\") pod \"llmisvc-controller-manager-c6b9847d7-s8825\" (UID: \"76a486e8-1110-4190-9b29-5b3a282a091c\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-s8825" Jun 03 03:28:14.763730 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:28:14.763702 2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 03 03:28:14.763877 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:28:14.763791 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae402e12-82a7-442e-9d82-c04d5f81dfed-cert podName:ae402e12-82a7-442e-9d82-c04d5f81dfed nodeName:}" failed. No retries permitted until 2026-06-03 03:28:15.26377051 +0000 UTC m=+479.105352106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ae402e12-82a7-442e-9d82-c04d5f81dfed-cert") pod "kserve-controller-manager-7c99ffcdcd-8q7zf" (UID: "ae402e12-82a7-442e-9d82-c04d5f81dfed") : secret "kserve-webhook-server-cert" not found Jun 03 03:28:14.766181 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.766161 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76a486e8-1110-4190-9b29-5b3a282a091c-cert\") pod \"llmisvc-controller-manager-c6b9847d7-s8825\" (UID: \"76a486e8-1110-4190-9b29-5b3a282a091c\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-s8825" Jun 03 03:28:14.782851 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.782824 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wschh\" (UniqueName: \"kubernetes.io/projected/76a486e8-1110-4190-9b29-5b3a282a091c-kube-api-access-wschh\") pod \"llmisvc-controller-manager-c6b9847d7-s8825\" (UID: \"76a486e8-1110-4190-9b29-5b3a282a091c\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-s8825" Jun 03 03:28:14.783524 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.783504 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj8ss\" (UniqueName: \"kubernetes.io/projected/ae402e12-82a7-442e-9d82-c04d5f81dfed-kube-api-access-mj8ss\") pod \"kserve-controller-manager-7c99ffcdcd-8q7zf\" (UID: \"ae402e12-82a7-442e-9d82-c04d5f81dfed\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8q7zf" Jun 03 03:28:14.891775 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:14.891678 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-s8825" Jun 03 03:28:15.020312 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:15.020280 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-s8825"] Jun 03 03:28:15.022794 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:28:15.022752 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod76a486e8_1110_4190_9b29_5b3a282a091c.slice/crio-f6e0fc5456bd14ed13510d9e61fd409354edd26e08ddb9f26b72e1eae4f46222 WatchSource:0}: Error finding container f6e0fc5456bd14ed13510d9e61fd409354edd26e08ddb9f26b72e1eae4f46222: Status 404 returned error can't find the container with id f6e0fc5456bd14ed13510d9e61fd409354edd26e08ddb9f26b72e1eae4f46222 Jun 03 03:28:15.163447 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:15.163367 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-s8825" event={"ID":"76a486e8-1110-4190-9b29-5b3a282a091c","Type":"ContainerStarted","Data":"f6e0fc5456bd14ed13510d9e61fd409354edd26e08ddb9f26b72e1eae4f46222"} Jun 03 03:28:15.268154 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:15.268114 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae402e12-82a7-442e-9d82-c04d5f81dfed-cert\") pod \"kserve-controller-manager-7c99ffcdcd-8q7zf\" (UID: \"ae402e12-82a7-442e-9d82-c04d5f81dfed\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8q7zf" Jun 03 03:28:15.270648 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:15.270624 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae402e12-82a7-442e-9d82-c04d5f81dfed-cert\") pod \"kserve-controller-manager-7c99ffcdcd-8q7zf\" (UID: \"ae402e12-82a7-442e-9d82-c04d5f81dfed\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8q7zf" Jun 03 03:28:15.476245 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:15.476155 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8q7zf" Jun 03 03:28:15.629214 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:15.629177 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-8q7zf"] Jun 03 03:28:15.659600 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:28:15.659541 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae402e12_82a7_442e_9d82_c04d5f81dfed.slice/crio-99e984a8f535888e6daf6146d2db9c45155243c04c156045fd3b8171dd98818b WatchSource:0}: Error finding container 99e984a8f535888e6daf6146d2db9c45155243c04c156045fd3b8171dd98818b: Status 404 returned error can't find the container with id 99e984a8f535888e6daf6146d2db9c45155243c04c156045fd3b8171dd98818b Jun 03 03:28:16.168132 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:16.168093 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8q7zf" event={"ID":"ae402e12-82a7-442e-9d82-c04d5f81dfed","Type":"ContainerStarted","Data":"99e984a8f535888e6daf6146d2db9c45155243c04c156045fd3b8171dd98818b"} Jun 03 03:28:20.182983 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:20.182943 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-s8825" event={"ID":"76a486e8-1110-4190-9b29-5b3a282a091c","Type":"ContainerStarted","Data":"54cabd12aa733c0680d3b53960f47837cb1c17ffae5379987c69f463d96d95fe"} Jun 03 03:28:20.183464 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:20.183056 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-s8825" Jun 03 03:28:20.184341 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:20.184315 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8q7zf" event={"ID":"ae402e12-82a7-442e-9d82-c04d5f81dfed","Type":"ContainerStarted","Data":"7a53c0e1462b7b4ca8dd448da10971c23cb93064854529cd84ae3c7190f09128"} Jun 03 03:28:20.184462 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:20.184430 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8q7zf" Jun 03 03:28:20.199337 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:20.199247 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-s8825" podStartSLOduration=2.078139859 podStartE2EDuration="6.199228075s" podCreationTimestamp="2026-06-03 03:28:14 +0000 UTC" firstStartedPulling="2026-06-03 03:28:15.024099772 +0000 UTC m=+478.865681366" lastFinishedPulling="2026-06-03 03:28:19.145187987 +0000 UTC m=+482.986769582" observedRunningTime="2026-06-03 03:28:20.197657285 +0000 UTC m=+484.039238915" watchObservedRunningTime="2026-06-03 03:28:20.199228075 +0000 UTC m=+484.040809693" Jun 03 03:28:20.213384 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:20.213316 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8q7zf" podStartSLOduration=2.733701908 podStartE2EDuration="6.21329781s" podCreationTimestamp="2026-06-03 03:28:14 +0000 UTC" firstStartedPulling="2026-06-03 03:28:15.660885101 +0000 UTC m=+479.502466700" lastFinishedPulling="2026-06-03 03:28:19.140480997 +0000 UTC m=+482.982062602" observedRunningTime="2026-06-03 03:28:20.211212195 +0000 UTC m=+484.052793826" watchObservedRunningTime="2026-06-03 03:28:20.21329781 +0000 UTC m=+484.054879426" Jun 03 03:28:21.149284 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:21.149247 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-9gg8h" Jun 03 03:28:21.151424 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:21.151401 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-2qqgr" Jun 03 03:28:25.170262 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:25.170225 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-z6q98"] Jun 03 03:28:25.175311 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:25.175289 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-z6q98" Jun 03 03:28:25.177741 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:25.177715 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 03 03:28:25.177882 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:25.177715 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-jpdxr\"" Jun 03 03:28:25.177882 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:25.177807 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 03 03:28:25.184022 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:25.183995 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-z6q98"] Jun 03 03:28:25.353468 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:25.353426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfxpc\" (UniqueName: \"kubernetes.io/projected/d1311a5a-fd7a-43e2-b48f-53b8a145f58b-kube-api-access-qfxpc\") pod \"servicemesh-operator3-55f49c5f94-z6q98\" (UID: \"d1311a5a-fd7a-43e2-b48f-53b8a145f58b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-z6q98" Jun 03 03:28:25.353695 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:25.353507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/d1311a5a-fd7a-43e2-b48f-53b8a145f58b-operator-config\") pod \"servicemesh-operator3-55f49c5f94-z6q98\" (UID: \"d1311a5a-fd7a-43e2-b48f-53b8a145f58b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-z6q98" Jun 03 03:28:25.454699 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:25.454604 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfxpc\" (UniqueName: \"kubernetes.io/projected/d1311a5a-fd7a-43e2-b48f-53b8a145f58b-kube-api-access-qfxpc\") pod \"servicemesh-operator3-55f49c5f94-z6q98\" (UID: \"d1311a5a-fd7a-43e2-b48f-53b8a145f58b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-z6q98" Jun 03 03:28:25.454699 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:25.454673 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/d1311a5a-fd7a-43e2-b48f-53b8a145f58b-operator-config\") pod \"servicemesh-operator3-55f49c5f94-z6q98\" (UID: \"d1311a5a-fd7a-43e2-b48f-53b8a145f58b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-z6q98" Jun 03 03:28:25.457270 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:25.457240 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/d1311a5a-fd7a-43e2-b48f-53b8a145f58b-operator-config\") pod \"servicemesh-operator3-55f49c5f94-z6q98\" (UID: \"d1311a5a-fd7a-43e2-b48f-53b8a145f58b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-z6q98" Jun 03 03:28:25.464423 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:25.464400 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfxpc\" (UniqueName: \"kubernetes.io/projected/d1311a5a-fd7a-43e2-b48f-53b8a145f58b-kube-api-access-qfxpc\") pod \"servicemesh-operator3-55f49c5f94-z6q98\" (UID: \"d1311a5a-fd7a-43e2-b48f-53b8a145f58b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-z6q98" Jun 03 03:28:25.485494 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:25.485459 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-z6q98" Jun 03 03:28:25.618686 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:25.618648 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-z6q98"] Jun 03 03:28:25.621752 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:28:25.621721 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1311a5a_fd7a_43e2_b48f_53b8a145f58b.slice/crio-f633522e45d3ff4418718d87ad30363e6ea09cfea871c9dec110e051921031f9 WatchSource:0}: Error finding container f633522e45d3ff4418718d87ad30363e6ea09cfea871c9dec110e051921031f9: Status 404 returned error can't find the container with id f633522e45d3ff4418718d87ad30363e6ea09cfea871c9dec110e051921031f9 Jun 03 03:28:26.208541 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:26.208497 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-z6q98" event={"ID":"d1311a5a-fd7a-43e2-b48f-53b8a145f58b","Type":"ContainerStarted","Data":"f633522e45d3ff4418718d87ad30363e6ea09cfea871c9dec110e051921031f9"} Jun 03 03:28:29.220536 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:29.220496 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-z6q98" event={"ID":"d1311a5a-fd7a-43e2-b48f-53b8a145f58b","Type":"ContainerStarted","Data":"9ce94f1e92be3f636a36d9143fb1e9d9d2d527b23b1522da3a7c9831b5e1cd94"} Jun 03 03:28:29.220960 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:29.220544 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-z6q98" Jun 03 03:28:29.240829 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:29.240775 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-z6q98" podStartSLOduration=1.572081632 podStartE2EDuration="4.240759502s" podCreationTimestamp="2026-06-03 03:28:25 +0000 UTC" firstStartedPulling="2026-06-03 03:28:25.624224342 +0000 UTC m=+489.465805937" lastFinishedPulling="2026-06-03 03:28:28.29290221 +0000 UTC m=+492.134483807" observedRunningTime="2026-06-03 03:28:29.239721745 +0000 UTC m=+493.081303364" watchObservedRunningTime="2026-06-03 03:28:29.240759502 +0000 UTC m=+493.082341119" Jun 03 03:28:36.985402 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:36.985363 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd"] Jun 03 03:28:36.988599 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:36.988582 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:36.990869 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:36.990843 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 03 03:28:36.991006 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:36.990935 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 03 03:28:36.991006 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:36.990938 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cs8d2\"" Jun 03 03:28:36.991251 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:36.991229 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 03 03:28:36.991300 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:36.991262 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 03:28:36.998657 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:36.998636 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd"] Jun 03 03:28:37.044655 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.044613 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-local-certs\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.044655 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.044654 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-istio-token\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.044851 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.044674 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.044851 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.044697 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.044851 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.044757 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.044851 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.044801 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-cacerts\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.044997 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.044852 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6mqm\" (UniqueName: \"kubernetes.io/projected/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-kube-api-access-b6mqm\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.120197 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.120162 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5cbbc674f4-4846f"] Jun 03 03:28:37.123279 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.123255 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5cbbc674f4-4846f" Jun 03 03:28:37.125654 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.125629 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 03:28:37.125799 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.125676 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-858tf\"" Jun 03 03:28:37.130809 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.130784 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5cbbc674f4-4846f"] Jun 03 03:28:37.145167 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.145132 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6mqm\" (UniqueName: \"kubernetes.io/projected/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-kube-api-access-b6mqm\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.145316 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.145179 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cac6fb51-ec5b-4a0d-9d67-58526fc6c1ed-redirect-config\") pod \"dashboard-redirect-5cbbc674f4-4846f\" (UID: \"cac6fb51-ec5b-4a0d-9d67-58526fc6c1ed\") " pod="opendatahub/dashboard-redirect-5cbbc674f4-4846f" Jun 03 03:28:37.145316 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.145299 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-local-certs\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.145392 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.145323 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mmmz\" (UniqueName: \"kubernetes.io/projected/cac6fb51-ec5b-4a0d-9d67-58526fc6c1ed-kube-api-access-5mmmz\") pod \"dashboard-redirect-5cbbc674f4-4846f\" (UID: \"cac6fb51-ec5b-4a0d-9d67-58526fc6c1ed\") " pod="opendatahub/dashboard-redirect-5cbbc674f4-4846f" Jun 03 03:28:37.145392 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.145357 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-istio-token\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.145966 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.145821 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.146063 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.146010 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.146063 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.146046 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.146169 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.146135 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-cacerts\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.146495 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.146460 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.151425 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.151398 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-cacerts\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.153399 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.153374 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-local-certs\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.154643 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.154615 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6mqm\" (UniqueName: \"kubernetes.io/projected/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-kube-api-access-b6mqm\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.156092 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.156070 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.157475 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.157402 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.162188 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.162132 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f-istio-token\") pod \"istiod-openshift-gateway-798958bb55-5djxd\" (UID: \"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.246707 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.246609 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cac6fb51-ec5b-4a0d-9d67-58526fc6c1ed-redirect-config\") pod \"dashboard-redirect-5cbbc674f4-4846f\" (UID: \"cac6fb51-ec5b-4a0d-9d67-58526fc6c1ed\") " pod="opendatahub/dashboard-redirect-5cbbc674f4-4846f" Jun 03 03:28:37.246707 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.246668 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5mmmz\" (UniqueName: \"kubernetes.io/projected/cac6fb51-ec5b-4a0d-9d67-58526fc6c1ed-kube-api-access-5mmmz\") pod \"dashboard-redirect-5cbbc674f4-4846f\" (UID: \"cac6fb51-ec5b-4a0d-9d67-58526fc6c1ed\") " pod="opendatahub/dashboard-redirect-5cbbc674f4-4846f" Jun 03 03:28:37.247616 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.247584 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cac6fb51-ec5b-4a0d-9d67-58526fc6c1ed-redirect-config\") pod \"dashboard-redirect-5cbbc674f4-4846f\" (UID: \"cac6fb51-ec5b-4a0d-9d67-58526fc6c1ed\") " pod="opendatahub/dashboard-redirect-5cbbc674f4-4846f" Jun 03 03:28:37.254054 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.254024 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mmmz\" (UniqueName: \"kubernetes.io/projected/cac6fb51-ec5b-4a0d-9d67-58526fc6c1ed-kube-api-access-5mmmz\") pod \"dashboard-redirect-5cbbc674f4-4846f\" (UID: \"cac6fb51-ec5b-4a0d-9d67-58526fc6c1ed\") " pod="opendatahub/dashboard-redirect-5cbbc674f4-4846f" Jun 03 03:28:37.299321 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.299279 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:37.435335 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.434941 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5cbbc674f4-4846f" Jun 03 03:28:37.436973 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.436937 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd"] Jun 03 03:28:37.441644 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:28:37.441617 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f4b89bd_3065_4d07_8ee4_9e6b7a0f164f.slice/crio-7102143f2a109ec199638ad9ae083445210bc1f34fe43a1daf64d7a930bc82b6 WatchSource:0}: Error finding container 7102143f2a109ec199638ad9ae083445210bc1f34fe43a1daf64d7a930bc82b6: Status 404 returned error can't find the container with id 7102143f2a109ec199638ad9ae083445210bc1f34fe43a1daf64d7a930bc82b6 Jun 03 03:28:37.571462 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:37.571423 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5cbbc674f4-4846f"] Jun 03 03:28:37.574312 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:28:37.574281 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac6fb51_ec5b_4a0d_9d67_58526fc6c1ed.slice/crio-3cf832bb80fe6807c78f0d369f7ce5746513f76be835003e29417a5f45ec041e WatchSource:0}: Error finding container 3cf832bb80fe6807c78f0d369f7ce5746513f76be835003e29417a5f45ec041e: Status 404 returned error can't find the container with id 3cf832bb80fe6807c78f0d369f7ce5746513f76be835003e29417a5f45ec041e Jun 03 03:28:38.252228 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:38.252184 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" event={"ID":"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f","Type":"ContainerStarted","Data":"7102143f2a109ec199638ad9ae083445210bc1f34fe43a1daf64d7a930bc82b6"} Jun 03 03:28:38.253288 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:38.253265 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5cbbc674f4-4846f" event={"ID":"cac6fb51-ec5b-4a0d-9d67-58526fc6c1ed","Type":"ContainerStarted","Data":"3cf832bb80fe6807c78f0d369f7ce5746513f76be835003e29417a5f45ec041e"} Jun 03 03:28:40.226962 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:40.226926 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-z6q98" Jun 03 03:28:40.523212 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:40.523178 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 03:28:40.523290 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:40.523246 2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 03:28:41.265478 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:41.265438 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" event={"ID":"8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f","Type":"ContainerStarted","Data":"b5e7b3e5db92b16929b296c991178648650df98e73ea8b19848f668a9e63dfea"} Jun 03 03:28:41.266023 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:41.266000 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:41.267866 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:41.267840 2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-5djxd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 03 03:28:41.268000 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:41.267898 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" podUID="8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 03:28:41.304828 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:41.304749 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" podStartSLOduration=2.225342624 podStartE2EDuration="5.304729704s" podCreationTimestamp="2026-06-03 03:28:36 +0000 UTC" firstStartedPulling="2026-06-03 03:28:37.443575673 +0000 UTC m=+501.285157268" lastFinishedPulling="2026-06-03 03:28:40.522962753 +0000 UTC m=+504.364544348" observedRunningTime="2026-06-03 03:28:41.303454456 +0000 UTC m=+505.145036109" watchObservedRunningTime="2026-06-03 03:28:41.304729704 +0000 UTC m=+505.146311322" Jun 03 03:28:42.270062 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:42.270034 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-5djxd" Jun 03 03:28:49.294822 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:49.294775 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5cbbc674f4-4846f" event={"ID":"cac6fb51-ec5b-4a0d-9d67-58526fc6c1ed","Type":"ContainerStarted","Data":"6cbb5c09c4e5f55ac25e405e9d38566b7a36f5473c0e0119b4fc5bf638982815"} Jun 03 03:28:49.309404 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:49.309343 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5cbbc674f4-4846f" podStartSLOduration=1.233087704 podStartE2EDuration="12.309328377s" podCreationTimestamp="2026-06-03 03:28:37 +0000 UTC" firstStartedPulling="2026-06-03 03:28:37.575609223 +0000 UTC m=+501.417190821" lastFinishedPulling="2026-06-03 03:28:48.651849886 +0000 UTC m=+512.493431494" observedRunningTime="2026-06-03 03:28:49.307248788 +0000 UTC m=+513.148830405" watchObservedRunningTime="2026-06-03 03:28:49.309328377 +0000 UTC m=+513.150909995" Jun 03 03:28:51.189533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:51.189501 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-s8825" Jun 03 03:28:51.192703 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:28:51.192683 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-8q7zf" Jun 03 03:29:44.534168 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:44.534126 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg"] Jun 03 03:29:44.537601 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:44.537574 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" Jun 03 03:29:44.540014 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:44.539987 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 03:29:44.540137 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:44.540053 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-75hbz\"" Jun 03 03:29:44.540197 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:44.540177 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 03:29:44.550352 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:44.550326 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg"] Jun 03 03:29:44.590822 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:44.590785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4ck2\" (UniqueName: \"kubernetes.io/projected/51287e1c-6402-46a4-aaf9-951758b24f93-kube-api-access-l4ck2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7k7zg\" (UID: \"51287e1c-6402-46a4-aaf9-951758b24f93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" Jun 03 03:29:44.590822 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:44.590839 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51287e1c-6402-46a4-aaf9-951758b24f93-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7k7zg\" (UID: \"51287e1c-6402-46a4-aaf9-951758b24f93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" Jun 03 03:29:44.691824 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:44.691781 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4ck2\" (UniqueName: \"kubernetes.io/projected/51287e1c-6402-46a4-aaf9-951758b24f93-kube-api-access-l4ck2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7k7zg\" (UID: \"51287e1c-6402-46a4-aaf9-951758b24f93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" Jun 03 03:29:44.692041 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:44.691837 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51287e1c-6402-46a4-aaf9-951758b24f93-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7k7zg\" (UID: \"51287e1c-6402-46a4-aaf9-951758b24f93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" Jun 03 03:29:44.692181 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:44.692162 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51287e1c-6402-46a4-aaf9-951758b24f93-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7k7zg\" (UID: \"51287e1c-6402-46a4-aaf9-951758b24f93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" Jun 03 03:29:44.700335 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:44.700312 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4ck2\" (UniqueName: \"kubernetes.io/projected/51287e1c-6402-46a4-aaf9-951758b24f93-kube-api-access-l4ck2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7k7zg\" (UID: \"51287e1c-6402-46a4-aaf9-951758b24f93\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" Jun 03 03:29:44.848185 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:44.848080 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" Jun 03 03:29:45.012718 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:45.012687 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg"] Jun 03 03:29:45.017109 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:29:45.017073 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51287e1c_6402_46a4_aaf9_951758b24f93.slice/crio-4b7a57d04734d680b98e606fe59b03feffd2d57896407457bdc82dc4dcb7e930 WatchSource:0}: Error finding container 4b7a57d04734d680b98e606fe59b03feffd2d57896407457bdc82dc4dcb7e930: Status 404 returned error can't find the container with id 4b7a57d04734d680b98e606fe59b03feffd2d57896407457bdc82dc4dcb7e930 Jun 03 03:29:45.470833 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:45.470801 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" event={"ID":"51287e1c-6402-46a4-aaf9-951758b24f93","Type":"ContainerStarted","Data":"4b7a57d04734d680b98e606fe59b03feffd2d57896407457bdc82dc4dcb7e930"} Jun 03 03:29:51.491593 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:51.491543 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" event={"ID":"51287e1c-6402-46a4-aaf9-951758b24f93","Type":"ContainerStarted","Data":"a359a4d63161cc7b8c864498d727100ed9e0e013501cc6ac4c0c6f2b0a01c452"} Jun 03 03:29:51.492000 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:51.491769 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" Jun 03 03:29:51.511244 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:29:51.511182 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" podStartSLOduration=1.680210794 podStartE2EDuration="7.511168121s" podCreationTimestamp="2026-06-03 03:29:44 +0000 UTC" firstStartedPulling="2026-06-03 03:29:45.01992266 +0000 UTC m=+568.861504255" lastFinishedPulling="2026-06-03 03:29:50.850879988 +0000 UTC m=+574.692461582" observedRunningTime="2026-06-03 03:29:51.510072624 +0000 UTC m=+575.351654241" watchObservedRunningTime="2026-06-03 03:29:51.511168121 +0000 UTC m=+575.352749738" Jun 03 03:30:02.497092 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:02.497057 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" Jun 03 03:30:04.114759 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.114716 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg"] Jun 03 03:30:04.115186 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.114965 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" podUID="51287e1c-6402-46a4-aaf9-951758b24f93" containerName="manager" containerID="cri-o://a359a4d63161cc7b8c864498d727100ed9e0e013501cc6ac4c0c6f2b0a01c452" gracePeriod=2 Jun 03 03:30:04.120255 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.120225 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg"] Jun 03 03:30:04.137326 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.137299 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk"] Jun 03 03:30:04.137625 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.137612 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51287e1c-6402-46a4-aaf9-951758b24f93" containerName="manager" Jun 03 03:30:04.137676 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.137627 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="51287e1c-6402-46a4-aaf9-951758b24f93" containerName="manager" Jun 03 03:30:04.137710 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.137689 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="51287e1c-6402-46a4-aaf9-951758b24f93" containerName="manager" Jun 03 03:30:04.140577 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.140526 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" Jun 03 03:30:04.157167 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.157134 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk"] Jun 03 03:30:04.177797 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.177757 2575 status_manager.go:895] "Failed to get status for pod" podUID="51287e1c-6402-46a4-aaf9-951758b24f93" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7k7zg\" is forbidden: User \"system:node:ip-10-0-130-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-55.ec2.internal' and this object" Jun 03 03:30:04.252046 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.252009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c24af705-ba38-4082-984a-89bafb8b8a2d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jz5sk\" (UID: \"c24af705-ba38-4082-984a-89bafb8b8a2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" Jun 03 03:30:04.252205 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.252057 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vmvx\" (UniqueName: \"kubernetes.io/projected/c24af705-ba38-4082-984a-89bafb8b8a2d-kube-api-access-4vmvx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jz5sk\" (UID: \"c24af705-ba38-4082-984a-89bafb8b8a2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" Jun 03 03:30:04.347058 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.347032 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" Jun 03 03:30:04.352864 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.352833 2575 status_manager.go:895] "Failed to get status for pod" podUID="51287e1c-6402-46a4-aaf9-951758b24f93" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7k7zg\" is forbidden: User \"system:node:ip-10-0-130-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-55.ec2.internal' and this object" Jun 03 03:30:04.353114 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.353094 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4vmvx\" (UniqueName: \"kubernetes.io/projected/c24af705-ba38-4082-984a-89bafb8b8a2d-kube-api-access-4vmvx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jz5sk\" (UID: \"c24af705-ba38-4082-984a-89bafb8b8a2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" Jun 03 03:30:04.353180 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.353167 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c24af705-ba38-4082-984a-89bafb8b8a2d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jz5sk\" (UID: \"c24af705-ba38-4082-984a-89bafb8b8a2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" Jun 03 03:30:04.353486 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.353468 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c24af705-ba38-4082-984a-89bafb8b8a2d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jz5sk\" (UID: \"c24af705-ba38-4082-984a-89bafb8b8a2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" Jun 03 03:30:04.365607 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.365513 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vmvx\" (UniqueName: \"kubernetes.io/projected/c24af705-ba38-4082-984a-89bafb8b8a2d-kube-api-access-4vmvx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-jz5sk\" (UID: \"c24af705-ba38-4082-984a-89bafb8b8a2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" Jun 03 03:30:04.454270 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.454227 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51287e1c-6402-46a4-aaf9-951758b24f93-extensions-socket-volume\") pod \"51287e1c-6402-46a4-aaf9-951758b24f93\" (UID: \"51287e1c-6402-46a4-aaf9-951758b24f93\") " Jun 03 03:30:04.454270 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.454268 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4ck2\" (UniqueName: \"kubernetes.io/projected/51287e1c-6402-46a4-aaf9-951758b24f93-kube-api-access-l4ck2\") pod \"51287e1c-6402-46a4-aaf9-951758b24f93\" (UID: \"51287e1c-6402-46a4-aaf9-951758b24f93\") " Jun 03 03:30:04.454773 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.454740 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51287e1c-6402-46a4-aaf9-951758b24f93-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "51287e1c-6402-46a4-aaf9-951758b24f93" (UID: "51287e1c-6402-46a4-aaf9-951758b24f93"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:30:04.456698 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.456671 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51287e1c-6402-46a4-aaf9-951758b24f93-kube-api-access-l4ck2" (OuterVolumeSpecName: "kube-api-access-l4ck2") pod "51287e1c-6402-46a4-aaf9-951758b24f93" (UID: "51287e1c-6402-46a4-aaf9-951758b24f93"). InnerVolumeSpecName "kube-api-access-l4ck2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:30:04.515533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.515487 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" Jun 03 03:30:04.541833 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.541800 2575 generic.go:358] "Generic (PLEG): container finished" podID="51287e1c-6402-46a4-aaf9-951758b24f93" containerID="a359a4d63161cc7b8c864498d727100ed9e0e013501cc6ac4c0c6f2b0a01c452" exitCode=0 Jun 03 03:30:04.542016 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.541862 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" Jun 03 03:30:04.542016 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.541903 2575 scope.go:117] "RemoveContainer" containerID="a359a4d63161cc7b8c864498d727100ed9e0e013501cc6ac4c0c6f2b0a01c452" Jun 03 03:30:04.543960 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.543930 2575 status_manager.go:895] "Failed to get status for pod" podUID="51287e1c-6402-46a4-aaf9-951758b24f93" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7k7zg\" is forbidden: User \"system:node:ip-10-0-130-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-55.ec2.internal' and this object" Jun 03 03:30:04.552670 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.552634 2575 status_manager.go:895] "Failed to get status for pod" podUID="51287e1c-6402-46a4-aaf9-951758b24f93" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7k7zg" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7k7zg\" is forbidden: User \"system:node:ip-10-0-130-55.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-55.ec2.internal' and this object" Jun 03 03:30:04.553839 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.553813 2575 scope.go:117] "RemoveContainer" containerID="a359a4d63161cc7b8c864498d727100ed9e0e013501cc6ac4c0c6f2b0a01c452" Jun 03 03:30:04.554275 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:30:04.554204 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a359a4d63161cc7b8c864498d727100ed9e0e013501cc6ac4c0c6f2b0a01c452\": container with ID starting with a359a4d63161cc7b8c864498d727100ed9e0e013501cc6ac4c0c6f2b0a01c452 not found: ID does not exist" containerID="a359a4d63161cc7b8c864498d727100ed9e0e013501cc6ac4c0c6f2b0a01c452" Jun 03 03:30:04.554275 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.554244 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a359a4d63161cc7b8c864498d727100ed9e0e013501cc6ac4c0c6f2b0a01c452"} err="failed to get container status \"a359a4d63161cc7b8c864498d727100ed9e0e013501cc6ac4c0c6f2b0a01c452\": rpc error: code = NotFound desc = could not find container \"a359a4d63161cc7b8c864498d727100ed9e0e013501cc6ac4c0c6f2b0a01c452\": container with ID starting with a359a4d63161cc7b8c864498d727100ed9e0e013501cc6ac4c0c6f2b0a01c452 not found: ID does not exist" Jun 03 03:30:04.555725 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.555680 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51287e1c-6402-46a4-aaf9-951758b24f93-extensions-socket-volume\") on node \"ip-10-0-130-55.ec2.internal\" DevicePath \"\"" Jun 03 03:30:04.555725 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.555702 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4ck2\" (UniqueName: \"kubernetes.io/projected/51287e1c-6402-46a4-aaf9-951758b24f93-kube-api-access-l4ck2\") on node \"ip-10-0-130-55.ec2.internal\" DevicePath \"\"" Jun 03 03:30:04.664898 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.664785 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk"] Jun 03 03:30:04.667760 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:30:04.667731 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc24af705_ba38_4082_984a_89bafb8b8a2d.slice/crio-6a542ed3aba8913205ada8fd63dd0506d4b2eb3729f5beeaf8d35bfbad216de1 WatchSource:0}: Error finding container 6a542ed3aba8913205ada8fd63dd0506d4b2eb3729f5beeaf8d35bfbad216de1: Status 404 returned error can't find the container with id 6a542ed3aba8913205ada8fd63dd0506d4b2eb3729f5beeaf8d35bfbad216de1 Jun 03 03:30:04.782328 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:04.782296 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51287e1c-6402-46a4-aaf9-951758b24f93" path="/var/lib/kubelet/pods/51287e1c-6402-46a4-aaf9-951758b24f93/volumes" Jun 03 03:30:05.547137 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:05.547098 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" event={"ID":"c24af705-ba38-4082-984a-89bafb8b8a2d","Type":"ContainerStarted","Data":"1b33c118acf79744d2b47d97874ab97b13f7d340d3ad1a6c3eb27a2f044d930f"} Jun 03 03:30:05.547137 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:05.547142 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" event={"ID":"c24af705-ba38-4082-984a-89bafb8b8a2d","Type":"ContainerStarted","Data":"6a542ed3aba8913205ada8fd63dd0506d4b2eb3729f5beeaf8d35bfbad216de1"} Jun 03 03:30:05.547673 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:05.547157 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" Jun 03 03:30:16.553921 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:16.553884 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" Jun 03 03:30:16.572957 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:16.572904 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" podStartSLOduration=12.572885095 podStartE2EDuration="12.572885095s" podCreationTimestamp="2026-06-03 03:30:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:30:05.572869245 +0000 UTC m=+589.414450862" watchObservedRunningTime="2026-06-03 03:30:16.572885095 +0000 UTC m=+600.414466764" Jun 03 03:30:16.709053 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:16.709019 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:30:16.709235 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:16.709172 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:30:20.278070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.278031 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk"] Jun 03 03:30:20.278469 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.278288 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" podUID="c24af705-ba38-4082-984a-89bafb8b8a2d" containerName="manager" containerID="cri-o://1b33c118acf79744d2b47d97874ab97b13f7d340d3ad1a6c3eb27a2f044d930f" gracePeriod=10 Jun 03 03:30:20.539054 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.538981 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" Jun 03 03:30:20.560539 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.560503 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk"] Jun 03 03:30:20.560817 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.560805 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c24af705-ba38-4082-984a-89bafb8b8a2d" containerName="manager" Jun 03 03:30:20.560853 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.560819 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c24af705-ba38-4082-984a-89bafb8b8a2d" containerName="manager" Jun 03 03:30:20.560903 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.560879 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c24af705-ba38-4082-984a-89bafb8b8a2d" containerName="manager" Jun 03 03:30:20.563819 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.563795 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" Jun 03 03:30:20.575883 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.575853 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk"] Jun 03 03:30:20.605732 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.605698 2575 generic.go:358] "Generic (PLEG): container finished" podID="c24af705-ba38-4082-984a-89bafb8b8a2d" containerID="1b33c118acf79744d2b47d97874ab97b13f7d340d3ad1a6c3eb27a2f044d930f" exitCode=0 Jun 03 03:30:20.605912 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.605763 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" Jun 03 03:30:20.605912 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.605772 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" event={"ID":"c24af705-ba38-4082-984a-89bafb8b8a2d","Type":"ContainerDied","Data":"1b33c118acf79744d2b47d97874ab97b13f7d340d3ad1a6c3eb27a2f044d930f"} Jun 03 03:30:20.605912 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.605799 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk" event={"ID":"c24af705-ba38-4082-984a-89bafb8b8a2d","Type":"ContainerDied","Data":"6a542ed3aba8913205ada8fd63dd0506d4b2eb3729f5beeaf8d35bfbad216de1"} Jun 03 03:30:20.605912 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.605815 2575 scope.go:117] "RemoveContainer" containerID="1b33c118acf79744d2b47d97874ab97b13f7d340d3ad1a6c3eb27a2f044d930f" Jun 03 03:30:20.613917 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.613897 2575 scope.go:117] "RemoveContainer" containerID="1b33c118acf79744d2b47d97874ab97b13f7d340d3ad1a6c3eb27a2f044d930f" Jun 03 03:30:20.614173 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:30:20.614155 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b33c118acf79744d2b47d97874ab97b13f7d340d3ad1a6c3eb27a2f044d930f\": container with ID starting with 1b33c118acf79744d2b47d97874ab97b13f7d340d3ad1a6c3eb27a2f044d930f not found: ID does not exist" containerID="1b33c118acf79744d2b47d97874ab97b13f7d340d3ad1a6c3eb27a2f044d930f" Jun 03 03:30:20.614219 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.614183 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b33c118acf79744d2b47d97874ab97b13f7d340d3ad1a6c3eb27a2f044d930f"} err="failed to get container status \"1b33c118acf79744d2b47d97874ab97b13f7d340d3ad1a6c3eb27a2f044d930f\": rpc error: code = NotFound desc = could not find container \"1b33c118acf79744d2b47d97874ab97b13f7d340d3ad1a6c3eb27a2f044d930f\": container with ID starting with 1b33c118acf79744d2b47d97874ab97b13f7d340d3ad1a6c3eb27a2f044d930f not found: ID does not exist" Jun 03 03:30:20.694762 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.694727 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vmvx\" (UniqueName: \"kubernetes.io/projected/c24af705-ba38-4082-984a-89bafb8b8a2d-kube-api-access-4vmvx\") pod \"c24af705-ba38-4082-984a-89bafb8b8a2d\" (UID: \"c24af705-ba38-4082-984a-89bafb8b8a2d\") " Jun 03 03:30:20.694938 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.694792 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c24af705-ba38-4082-984a-89bafb8b8a2d-extensions-socket-volume\") pod \"c24af705-ba38-4082-984a-89bafb8b8a2d\" (UID: \"c24af705-ba38-4082-984a-89bafb8b8a2d\") " Jun 03 03:30:20.694938 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.694931 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn7c9\" (UniqueName: \"kubernetes.io/projected/30b36208-c855-4952-bc49-d8ad3df69b71-kube-api-access-nn7c9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wbnlk\" (UID: \"30b36208-c855-4952-bc49-d8ad3df69b71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" Jun 03 03:30:20.695029 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.694981 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30b36208-c855-4952-bc49-d8ad3df69b71-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wbnlk\" (UID: \"30b36208-c855-4952-bc49-d8ad3df69b71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" Jun 03 03:30:20.695190 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.695164 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c24af705-ba38-4082-984a-89bafb8b8a2d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c24af705-ba38-4082-984a-89bafb8b8a2d" (UID: "c24af705-ba38-4082-984a-89bafb8b8a2d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:30:20.697033 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.696995 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c24af705-ba38-4082-984a-89bafb8b8a2d-kube-api-access-4vmvx" (OuterVolumeSpecName: "kube-api-access-4vmvx") pod "c24af705-ba38-4082-984a-89bafb8b8a2d" (UID: "c24af705-ba38-4082-984a-89bafb8b8a2d"). InnerVolumeSpecName "kube-api-access-4vmvx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:30:20.795971 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.795902 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nn7c9\" (UniqueName: \"kubernetes.io/projected/30b36208-c855-4952-bc49-d8ad3df69b71-kube-api-access-nn7c9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wbnlk\" (UID: \"30b36208-c855-4952-bc49-d8ad3df69b71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" Jun 03 03:30:20.796102 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.795983 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30b36208-c855-4952-bc49-d8ad3df69b71-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wbnlk\" (UID: \"30b36208-c855-4952-bc49-d8ad3df69b71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" Jun 03 03:30:20.796102 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.796028 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c24af705-ba38-4082-984a-89bafb8b8a2d-extensions-socket-volume\") on node \"ip-10-0-130-55.ec2.internal\" DevicePath \"\"" Jun 03 03:30:20.796102 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.796043 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vmvx\" (UniqueName: \"kubernetes.io/projected/c24af705-ba38-4082-984a-89bafb8b8a2d-kube-api-access-4vmvx\") on node \"ip-10-0-130-55.ec2.internal\" DevicePath \"\"" Jun 03 03:30:20.796329 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.796307 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30b36208-c855-4952-bc49-d8ad3df69b71-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wbnlk\" (UID: \"30b36208-c855-4952-bc49-d8ad3df69b71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" Jun 03 03:30:20.803763 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.803732 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn7c9\" (UniqueName: \"kubernetes.io/projected/30b36208-c855-4952-bc49-d8ad3df69b71-kube-api-access-nn7c9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wbnlk\" (UID: \"30b36208-c855-4952-bc49-d8ad3df69b71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" Jun 03 03:30:20.876347 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.876308 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" Jun 03 03:30:20.923436 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.923401 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk"] Jun 03 03:30:20.941599 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:20.935414 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-jz5sk"] Jun 03 03:30:21.030223 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:21.030187 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk"] Jun 03 03:30:21.033722 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:30:21.033689 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b36208_c855_4952_bc49_d8ad3df69b71.slice/crio-76301c162896c1fc9ad202d667662ea61e6aebb8e214a20f8b827c92b75e8ab9 WatchSource:0}: Error finding container 76301c162896c1fc9ad202d667662ea61e6aebb8e214a20f8b827c92b75e8ab9: Status 404 returned error can't find the container with id 76301c162896c1fc9ad202d667662ea61e6aebb8e214a20f8b827c92b75e8ab9 Jun 03 03:30:21.611532 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:21.611494 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" event={"ID":"30b36208-c855-4952-bc49-d8ad3df69b71","Type":"ContainerStarted","Data":"d6ce83cdd2441acb7ceda8fb9edafb1b512b40d6d39faec29bd8467509bb046a"} Jun 03 03:30:21.611532 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:21.611528 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" event={"ID":"30b36208-c855-4952-bc49-d8ad3df69b71","Type":"ContainerStarted","Data":"76301c162896c1fc9ad202d667662ea61e6aebb8e214a20f8b827c92b75e8ab9"} Jun 03 03:30:21.611952 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:21.611626 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" Jun 03 03:30:21.627695 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:21.627649 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" podStartSLOduration=1.627633707 podStartE2EDuration="1.627633707s" podCreationTimestamp="2026-06-03 03:30:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:30:21.626919523 +0000 UTC m=+605.468501151" watchObservedRunningTime="2026-06-03 03:30:21.627633707 +0000 UTC m=+605.469215323" Jun 03 03:30:22.782326 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:22.782292 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c24af705-ba38-4082-984a-89bafb8b8a2d" path="/var/lib/kubelet/pods/c24af705-ba38-4082-984a-89bafb8b8a2d/volumes" Jun 03 03:30:32.617909 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:32.617875 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" Jun 03 03:30:53.412617 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:53.412576 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:30:53.415805 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:53.415783 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-5s7n6" Jun 03 03:30:53.418006 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:53.417983 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kxdrd\"" Jun 03 03:30:53.418134 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:53.417982 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 03:30:53.425407 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:53.425378 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:30:53.446153 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:53.446116 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:30:53.457826 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:53.457793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8f89644a-6d48-42b8-b986-9ac2f2e78297-config-file\") pod \"limitador-limitador-78c99df468-5s7n6\" (UID: \"8f89644a-6d48-42b8-b986-9ac2f2e78297\") " pod="kuadrant-system/limitador-limitador-78c99df468-5s7n6" Jun 03 03:30:53.457974 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:53.457847 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzrkn\" (UniqueName: \"kubernetes.io/projected/8f89644a-6d48-42b8-b986-9ac2f2e78297-kube-api-access-pzrkn\") pod \"limitador-limitador-78c99df468-5s7n6\" (UID: \"8f89644a-6d48-42b8-b986-9ac2f2e78297\") " pod="kuadrant-system/limitador-limitador-78c99df468-5s7n6" Jun 03 03:30:53.558253 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:53.558216 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzrkn\" (UniqueName: \"kubernetes.io/projected/8f89644a-6d48-42b8-b986-9ac2f2e78297-kube-api-access-pzrkn\") pod \"limitador-limitador-78c99df468-5s7n6\" (UID: \"8f89644a-6d48-42b8-b986-9ac2f2e78297\") " pod="kuadrant-system/limitador-limitador-78c99df468-5s7n6" Jun 03 03:30:53.558451 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:53.558282 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8f89644a-6d48-42b8-b986-9ac2f2e78297-config-file\") pod \"limitador-limitador-78c99df468-5s7n6\" (UID: \"8f89644a-6d48-42b8-b986-9ac2f2e78297\") " pod="kuadrant-system/limitador-limitador-78c99df468-5s7n6" Jun 03 03:30:53.558898 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:53.558876 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8f89644a-6d48-42b8-b986-9ac2f2e78297-config-file\") pod \"limitador-limitador-78c99df468-5s7n6\" (UID: \"8f89644a-6d48-42b8-b986-9ac2f2e78297\") " pod="kuadrant-system/limitador-limitador-78c99df468-5s7n6" Jun 03 03:30:53.565985 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:53.565959 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzrkn\" (UniqueName: \"kubernetes.io/projected/8f89644a-6d48-42b8-b986-9ac2f2e78297-kube-api-access-pzrkn\") pod \"limitador-limitador-78c99df468-5s7n6\" (UID: \"8f89644a-6d48-42b8-b986-9ac2f2e78297\") " pod="kuadrant-system/limitador-limitador-78c99df468-5s7n6" Jun 03 03:30:53.726770 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:53.726689 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-5s7n6" Jun 03 03:30:53.859769 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:53.859741 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:30:53.862431 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:30:53.862405 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f89644a_6d48_42b8_b986_9ac2f2e78297.slice/crio-0c063f6fb54560e9f4b4f6bead6d66a20fd2d650ccfbc212744d611d952b79cc WatchSource:0}: Error finding container 0c063f6fb54560e9f4b4f6bead6d66a20fd2d650ccfbc212744d611d952b79cc: Status 404 returned error can't find the container with id 0c063f6fb54560e9f4b4f6bead6d66a20fd2d650ccfbc212744d611d952b79cc Jun 03 03:30:54.723094 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:54.723045 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-5s7n6" event={"ID":"8f89644a-6d48-42b8-b986-9ac2f2e78297","Type":"ContainerStarted","Data":"0c063f6fb54560e9f4b4f6bead6d66a20fd2d650ccfbc212744d611d952b79cc"} Jun 03 03:30:56.731135 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:56.731034 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-5s7n6" event={"ID":"8f89644a-6d48-42b8-b986-9ac2f2e78297","Type":"ContainerStarted","Data":"464ce54ad337e350fec5f0721bbda21e0461606b9c2482da3d06f47d14f92d22"} Jun 03 03:30:56.731135 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:56.731111 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-5s7n6" Jun 03 03:30:56.745912 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:30:56.745868 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-5s7n6" podStartSLOduration=1.203729682 podStartE2EDuration="3.745851878s" podCreationTimestamp="2026-06-03 03:30:53 +0000 UTC" firstStartedPulling="2026-06-03 03:30:53.864098243 +0000 UTC m=+637.705679839" lastFinishedPulling="2026-06-03 03:30:56.406220425 +0000 UTC m=+640.247802035" observedRunningTime="2026-06-03 03:30:56.744693426 +0000 UTC m=+640.586275042" watchObservedRunningTime="2026-06-03 03:30:56.745851878 +0000 UTC m=+640.587433494" Jun 03 03:31:07.736171 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:31:07.736139 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-5s7n6" Jun 03 03:32:23.374870 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:23.374828 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59b7454559-s8nxb"] Jun 03 03:32:23.378402 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:23.378378 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59b7454559-s8nxb" Jun 03 03:32:23.381537 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:23.381507 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 03:32:23.381537 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:23.381523 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tbl6d\"" Jun 03 03:32:23.388855 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:23.388829 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59b7454559-s8nxb"] Jun 03 03:32:23.460486 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:23.460442 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97zlw\" (UniqueName: \"kubernetes.io/projected/02e87ef1-0b04-4780-9719-077cd3c4922d-kube-api-access-97zlw\") pod \"maas-controller-59b7454559-s8nxb\" (UID: \"02e87ef1-0b04-4780-9719-077cd3c4922d\") " pod="opendatahub/maas-controller-59b7454559-s8nxb" Jun 03 03:32:23.561709 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:23.561672 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97zlw\" (UniqueName: \"kubernetes.io/projected/02e87ef1-0b04-4780-9719-077cd3c4922d-kube-api-access-97zlw\") pod \"maas-controller-59b7454559-s8nxb\" (UID: \"02e87ef1-0b04-4780-9719-077cd3c4922d\") " pod="opendatahub/maas-controller-59b7454559-s8nxb" Jun 03 03:32:23.569692 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:23.569657 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97zlw\" (UniqueName: \"kubernetes.io/projected/02e87ef1-0b04-4780-9719-077cd3c4922d-kube-api-access-97zlw\") pod \"maas-controller-59b7454559-s8nxb\" (UID: \"02e87ef1-0b04-4780-9719-077cd3c4922d\") " pod="opendatahub/maas-controller-59b7454559-s8nxb" Jun 03 03:32:23.689313 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:23.689212 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59b7454559-s8nxb" Jun 03 03:32:23.818802 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:23.818763 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59b7454559-s8nxb"] Jun 03 03:32:23.822743 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:32:23.822704 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e87ef1_0b04_4780_9719_077cd3c4922d.slice/crio-c7c05f8b10a593f5dd45aff630f725ca35bfe8d4f404ecda6565d52cf6e58dd3 WatchSource:0}: Error finding container c7c05f8b10a593f5dd45aff630f725ca35bfe8d4f404ecda6565d52cf6e58dd3: Status 404 returned error can't find the container with id c7c05f8b10a593f5dd45aff630f725ca35bfe8d4f404ecda6565d52cf6e58dd3 Jun 03 03:32:23.824347 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:23.824328 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 03:32:24.012110 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:24.012018 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59b7454559-s8nxb" event={"ID":"02e87ef1-0b04-4780-9719-077cd3c4922d","Type":"ContainerStarted","Data":"c7c05f8b10a593f5dd45aff630f725ca35bfe8d4f404ecda6565d52cf6e58dd3"} Jun 03 03:32:27.024683 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:27.024638 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59b7454559-s8nxb" event={"ID":"02e87ef1-0b04-4780-9719-077cd3c4922d","Type":"ContainerStarted","Data":"083b8f2c9db4b3e20e3d639e8dbe6014e63f98b4264125ad7bb7f2b6aaf19850"} Jun 03 03:32:27.025239 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:27.024756 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59b7454559-s8nxb" Jun 03 03:32:27.041046 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:27.040982 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-59b7454559-s8nxb" podStartSLOduration=1.616442164 podStartE2EDuration="4.040965677s" podCreationTimestamp="2026-06-03 03:32:23 +0000 UTC" firstStartedPulling="2026-06-03 03:32:23.82448961 +0000 UTC m=+727.666071205" lastFinishedPulling="2026-06-03 03:32:26.249013123 +0000 UTC m=+730.090594718" observedRunningTime="2026-06-03 03:32:27.039336198 +0000 UTC m=+730.880917816" watchObservedRunningTime="2026-06-03 03:32:27.040965677 +0000 UTC m=+730.882547346" Jun 03 03:32:37.763638 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:37.763602 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59b7454559-s8nxb"] Jun 03 03:32:37.764109 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:37.763824 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-59b7454559-s8nxb" podUID="02e87ef1-0b04-4780-9719-077cd3c4922d" containerName="manager" containerID="cri-o://083b8f2c9db4b3e20e3d639e8dbe6014e63f98b4264125ad7bb7f2b6aaf19850" gracePeriod=30 Jun 03 03:32:37.771070 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:37.771038 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59b7454559-s8nxb" Jun 03 03:32:38.006053 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:38.006028 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59b7454559-s8nxb" Jun 03 03:32:38.062700 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:38.062660 2575 generic.go:358] "Generic (PLEG): container finished" podID="02e87ef1-0b04-4780-9719-077cd3c4922d" containerID="083b8f2c9db4b3e20e3d639e8dbe6014e63f98b4264125ad7bb7f2b6aaf19850" exitCode=0 Jun 03 03:32:38.062902 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:38.062738 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59b7454559-s8nxb" Jun 03 03:32:38.062902 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:38.062754 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59b7454559-s8nxb" event={"ID":"02e87ef1-0b04-4780-9719-077cd3c4922d","Type":"ContainerDied","Data":"083b8f2c9db4b3e20e3d639e8dbe6014e63f98b4264125ad7bb7f2b6aaf19850"} Jun 03 03:32:38.062902 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:38.062803 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59b7454559-s8nxb" event={"ID":"02e87ef1-0b04-4780-9719-077cd3c4922d","Type":"ContainerDied","Data":"c7c05f8b10a593f5dd45aff630f725ca35bfe8d4f404ecda6565d52cf6e58dd3"} Jun 03 03:32:38.062902 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:38.062823 2575 scope.go:117] "RemoveContainer" containerID="083b8f2c9db4b3e20e3d639e8dbe6014e63f98b4264125ad7bb7f2b6aaf19850" Jun 03 03:32:38.070764 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:38.070746 2575 scope.go:117] "RemoveContainer" containerID="083b8f2c9db4b3e20e3d639e8dbe6014e63f98b4264125ad7bb7f2b6aaf19850" Jun 03 03:32:38.071026 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:32:38.071008 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"083b8f2c9db4b3e20e3d639e8dbe6014e63f98b4264125ad7bb7f2b6aaf19850\": container with ID starting with 083b8f2c9db4b3e20e3d639e8dbe6014e63f98b4264125ad7bb7f2b6aaf19850 not found: ID does not exist" containerID="083b8f2c9db4b3e20e3d639e8dbe6014e63f98b4264125ad7bb7f2b6aaf19850" Jun 03 03:32:38.071080 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:38.071039 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"083b8f2c9db4b3e20e3d639e8dbe6014e63f98b4264125ad7bb7f2b6aaf19850"} err="failed to get container status \"083b8f2c9db4b3e20e3d639e8dbe6014e63f98b4264125ad7bb7f2b6aaf19850\": rpc error: code = NotFound desc = could not find container \"083b8f2c9db4b3e20e3d639e8dbe6014e63f98b4264125ad7bb7f2b6aaf19850\": container with ID starting with 083b8f2c9db4b3e20e3d639e8dbe6014e63f98b4264125ad7bb7f2b6aaf19850 not found: ID does not exist" Jun 03 03:32:38.083396 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:38.083372 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97zlw\" (UniqueName: \"kubernetes.io/projected/02e87ef1-0b04-4780-9719-077cd3c4922d-kube-api-access-97zlw\") pod \"02e87ef1-0b04-4780-9719-077cd3c4922d\" (UID: \"02e87ef1-0b04-4780-9719-077cd3c4922d\") " Jun 03 03:32:38.085613 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:38.085590 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02e87ef1-0b04-4780-9719-077cd3c4922d-kube-api-access-97zlw" (OuterVolumeSpecName: "kube-api-access-97zlw") pod "02e87ef1-0b04-4780-9719-077cd3c4922d" (UID: "02e87ef1-0b04-4780-9719-077cd3c4922d"). InnerVolumeSpecName "kube-api-access-97zlw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:32:38.184741 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:38.184685 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97zlw\" (UniqueName: \"kubernetes.io/projected/02e87ef1-0b04-4780-9719-077cd3c4922d-kube-api-access-97zlw\") on node \"ip-10-0-130-55.ec2.internal\" DevicePath \"\"" Jun 03 03:32:38.387229 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:38.387197 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59b7454559-s8nxb"] Jun 03 03:32:38.392168 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:38.392141 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-59b7454559-s8nxb"] Jun 03 03:32:38.782480 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:38.782447 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02e87ef1-0b04-4780-9719-077cd3c4922d" path="/var/lib/kubelet/pods/02e87ef1-0b04-4780-9719-077cd3c4922d/volumes" Jun 03 03:32:57.405705 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.405668 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6b44f49ff-ffxwb"] Jun 03 03:32:57.406135 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.405977 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e87ef1-0b04-4780-9719-077cd3c4922d" containerName="manager" Jun 03 03:32:57.406135 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.405989 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e87ef1-0b04-4780-9719-077cd3c4922d" containerName="manager" Jun 03 03:32:57.406135 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.406043 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="02e87ef1-0b04-4780-9719-077cd3c4922d" containerName="manager" Jun 03 03:32:57.410282 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.410265 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6b44f49ff-ffxwb" Jun 03 03:32:57.413171 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.413145 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lfsk5\"" Jun 03 03:32:57.413300 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.413170 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 03 03:32:57.422479 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.422452 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6b44f49ff-ffxwb"] Jun 03 03:32:57.548689 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.548653 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9fc93c1-db0d-4f3d-a4c2-c4ffdf032167-maas-api-tls\") pod \"maas-api-6b44f49ff-ffxwb\" (UID: \"a9fc93c1-db0d-4f3d-a4c2-c4ffdf032167\") " pod="opendatahub/maas-api-6b44f49ff-ffxwb" Jun 03 03:32:57.548882 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.548711 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5brt\" (UniqueName: \"kubernetes.io/projected/a9fc93c1-db0d-4f3d-a4c2-c4ffdf032167-kube-api-access-g5brt\") pod \"maas-api-6b44f49ff-ffxwb\" (UID: \"a9fc93c1-db0d-4f3d-a4c2-c4ffdf032167\") " pod="opendatahub/maas-api-6b44f49ff-ffxwb" Jun 03 03:32:57.649294 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.649255 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9fc93c1-db0d-4f3d-a4c2-c4ffdf032167-maas-api-tls\") pod \"maas-api-6b44f49ff-ffxwb\" (UID: \"a9fc93c1-db0d-4f3d-a4c2-c4ffdf032167\") " pod="opendatahub/maas-api-6b44f49ff-ffxwb" Jun 03 03:32:57.649467 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.649314 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5brt\" (UniqueName: \"kubernetes.io/projected/a9fc93c1-db0d-4f3d-a4c2-c4ffdf032167-kube-api-access-g5brt\") pod \"maas-api-6b44f49ff-ffxwb\" (UID: \"a9fc93c1-db0d-4f3d-a4c2-c4ffdf032167\") " pod="opendatahub/maas-api-6b44f49ff-ffxwb" Jun 03 03:32:57.651846 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.651827 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9fc93c1-db0d-4f3d-a4c2-c4ffdf032167-maas-api-tls\") pod \"maas-api-6b44f49ff-ffxwb\" (UID: \"a9fc93c1-db0d-4f3d-a4c2-c4ffdf032167\") " pod="opendatahub/maas-api-6b44f49ff-ffxwb" Jun 03 03:32:57.657456 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.657389 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5brt\" (UniqueName: \"kubernetes.io/projected/a9fc93c1-db0d-4f3d-a4c2-c4ffdf032167-kube-api-access-g5brt\") pod \"maas-api-6b44f49ff-ffxwb\" (UID: \"a9fc93c1-db0d-4f3d-a4c2-c4ffdf032167\") " pod="opendatahub/maas-api-6b44f49ff-ffxwb" Jun 03 03:32:57.720483 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.720389 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6b44f49ff-ffxwb" Jun 03 03:32:57.860670 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.860636 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6b44f49ff-ffxwb"] Jun 03 03:32:57.864658 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:32:57.864617 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9fc93c1_db0d_4f3d_a4c2_c4ffdf032167.slice/crio-be3dd01befbc646918e75eb897abd0647d8ab313e0c1fbe77f76a8d91f241af3 WatchSource:0}: Error finding container be3dd01befbc646918e75eb897abd0647d8ab313e0c1fbe77f76a8d91f241af3: Status 404 returned error can't find the container with id be3dd01befbc646918e75eb897abd0647d8ab313e0c1fbe77f76a8d91f241af3 Jun 03 03:32:57.907736 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.907637 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-krxlx"] Jun 03 03:32:57.912221 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.912194 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-krxlx" Jun 03 03:32:57.914254 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.914227 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 03:32:57.914254 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.914246 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-s9cgv\"" Jun 03 03:32:57.917744 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:57.917718 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-krxlx"] Jun 03 03:32:58.052577 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:58.052512 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97x4h\" (UniqueName: \"kubernetes.io/projected/67c4a030-b833-45cb-9dc1-bce4a4471c15-kube-api-access-97x4h\") pod \"payload-processing-58b6c8fdc7-krxlx\" (UID: \"67c4a030-b833-45cb-9dc1-bce4a4471c15\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-krxlx" Jun 03 03:32:58.091251 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:58.091214 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:32:58.131433 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:58.131394 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6b44f49ff-ffxwb" event={"ID":"a9fc93c1-db0d-4f3d-a4c2-c4ffdf032167","Type":"ContainerStarted","Data":"be3dd01befbc646918e75eb897abd0647d8ab313e0c1fbe77f76a8d91f241af3"} Jun 03 03:32:58.152979 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:58.152946 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97x4h\" (UniqueName: \"kubernetes.io/projected/67c4a030-b833-45cb-9dc1-bce4a4471c15-kube-api-access-97x4h\") pod \"payload-processing-58b6c8fdc7-krxlx\" (UID: \"67c4a030-b833-45cb-9dc1-bce4a4471c15\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-krxlx" Jun 03 03:32:58.160168 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:58.160106 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97x4h\" (UniqueName: \"kubernetes.io/projected/67c4a030-b833-45cb-9dc1-bce4a4471c15-kube-api-access-97x4h\") pod \"payload-processing-58b6c8fdc7-krxlx\" (UID: \"67c4a030-b833-45cb-9dc1-bce4a4471c15\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-krxlx" Jun 03 03:32:58.225333 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:58.225295 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-krxlx" Jun 03 03:32:58.362473 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:58.362426 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-krxlx"] Jun 03 03:32:58.365408 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:32:58.365383 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67c4a030_b833_45cb_9dc1_bce4a4471c15.slice/crio-57e95a0479ea4525ea6d3a0be5448d6ed569da4198968a1bad300d89d5cc75a1 WatchSource:0}: Error finding container 57e95a0479ea4525ea6d3a0be5448d6ed569da4198968a1bad300d89d5cc75a1: Status 404 returned error can't find the container with id 57e95a0479ea4525ea6d3a0be5448d6ed569da4198968a1bad300d89d5cc75a1 Jun 03 03:32:59.140152 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:32:59.137727 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-krxlx" event={"ID":"67c4a030-b833-45cb-9dc1-bce4a4471c15","Type":"ContainerStarted","Data":"57e95a0479ea4525ea6d3a0be5448d6ed569da4198968a1bad300d89d5cc75a1"} Jun 03 03:33:00.142896 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:33:00.142853 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6b44f49ff-ffxwb" event={"ID":"a9fc93c1-db0d-4f3d-a4c2-c4ffdf032167","Type":"ContainerStarted","Data":"d132fd0c9f69f87bd11bdd16a393faf25bc463fb71fd5532b318995946a8fe91"} Jun 03 03:33:00.143382 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:33:00.142986 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6b44f49ff-ffxwb" Jun 03 03:33:00.158990 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:33:00.158925 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-6b44f49ff-ffxwb" podStartSLOduration=1.407564689 podStartE2EDuration="3.158907234s" podCreationTimestamp="2026-06-03 03:32:57 +0000 UTC" firstStartedPulling="2026-06-03 03:32:57.865884512 +0000 UTC m=+761.707466107" lastFinishedPulling="2026-06-03 03:32:59.617227054 +0000 UTC m=+763.458808652" observedRunningTime="2026-06-03 03:33:00.156895228 +0000 UTC m=+763.998476883" watchObservedRunningTime="2026-06-03 03:33:00.158907234 +0000 UTC m=+764.000488852" Jun 03 03:33:01.147323 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:33:01.147220 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-krxlx" event={"ID":"67c4a030-b833-45cb-9dc1-bce4a4471c15","Type":"ContainerStarted","Data":"f76e610064d019bd4be41e58a538cbf083a9b0f738a34c48b4730913d6a7acf8"} Jun 03 03:33:01.147797 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:33:01.147491 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-krxlx" Jun 03 03:33:01.161706 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:33:01.161657 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-krxlx" podStartSLOduration=1.645118638 podStartE2EDuration="4.161645981s" podCreationTimestamp="2026-06-03 03:32:57 +0000 UTC" firstStartedPulling="2026-06-03 03:32:58.369462586 +0000 UTC m=+762.211044181" lastFinishedPulling="2026-06-03 03:33:00.885989929 +0000 UTC m=+764.727571524" observedRunningTime="2026-06-03 03:33:01.16014949 +0000 UTC m=+765.001731107" watchObservedRunningTime="2026-06-03 03:33:01.161645981 +0000 UTC m=+765.003227643" Jun 03 03:33:06.153476 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:33:06.153441 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6b44f49ff-ffxwb" Jun 03 03:33:12.152627 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:33:12.152588 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-krxlx" Jun 03 03:33:52.251098 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:33:52.251002 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:33:58.443841 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:33:58.443795 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:34:01.551364 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.551325 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4"] Jun 03 03:34:01.560681 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.560631 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.562850 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.562821 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-26bdz\"" Jun 03 03:34:01.563168 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.563152 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 03:34:01.563685 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.563666 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 03:34:01.563805 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.563712 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 03:34:01.563872 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.563799 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4"] Jun 03 03:34:01.654522 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.654484 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/420662d3-d7bb-4121-94f3-ccff2ea6f18b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.654715 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.654540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/420662d3-d7bb-4121-94f3-ccff2ea6f18b-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.654715 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.654584 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/420662d3-d7bb-4121-94f3-ccff2ea6f18b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.654715 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.654629 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/420662d3-d7bb-4121-94f3-ccff2ea6f18b-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.654715 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.654655 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/420662d3-d7bb-4121-94f3-ccff2ea6f18b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.654715 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.654688 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnsk2\" (UniqueName: \"kubernetes.io/projected/420662d3-d7bb-4121-94f3-ccff2ea6f18b-kube-api-access-wnsk2\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.755297 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.755257 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/420662d3-d7bb-4121-94f3-ccff2ea6f18b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.755467 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.755314 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/420662d3-d7bb-4121-94f3-ccff2ea6f18b-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.755467 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.755340 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/420662d3-d7bb-4121-94f3-ccff2ea6f18b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.755467 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.755380 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnsk2\" (UniqueName: \"kubernetes.io/projected/420662d3-d7bb-4121-94f3-ccff2ea6f18b-kube-api-access-wnsk2\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.755467 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.755429 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/420662d3-d7bb-4121-94f3-ccff2ea6f18b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.755710 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.755485 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/420662d3-d7bb-4121-94f3-ccff2ea6f18b-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.755839 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.755814 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/420662d3-d7bb-4121-94f3-ccff2ea6f18b-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.755904 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.755868 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/420662d3-d7bb-4121-94f3-ccff2ea6f18b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.755952 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.755909 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/420662d3-d7bb-4121-94f3-ccff2ea6f18b-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.758013 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.757992 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/420662d3-d7bb-4121-94f3-ccff2ea6f18b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.758260 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.758245 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/420662d3-d7bb-4121-94f3-ccff2ea6f18b-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.762621 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.762599 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnsk2\" (UniqueName: \"kubernetes.io/projected/420662d3-d7bb-4121-94f3-ccff2ea6f18b-kube-api-access-wnsk2\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4\" (UID: \"420662d3-d7bb-4121-94f3-ccff2ea6f18b\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:01.873418 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:01.873323 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:02.009005 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:02.008979 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4"] Jun 03 03:34:02.010811 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:34:02.010763 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod420662d3_d7bb_4121_94f3_ccff2ea6f18b.slice/crio-30846d690447deba049624647c56335093a0237c0ead8f6b874be42991409d2f WatchSource:0}: Error finding container 30846d690447deba049624647c56335093a0237c0ead8f6b874be42991409d2f: Status 404 returned error can't find the container with id 30846d690447deba049624647c56335093a0237c0ead8f6b874be42991409d2f Jun 03 03:34:02.353450 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:02.353414 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" event={"ID":"420662d3-d7bb-4121-94f3-ccff2ea6f18b","Type":"ContainerStarted","Data":"30846d690447deba049624647c56335093a0237c0ead8f6b874be42991409d2f"} Jun 03 03:34:02.453059 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:02.453018 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:34:05.367064 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:05.367019 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" event={"ID":"420662d3-d7bb-4121-94f3-ccff2ea6f18b","Type":"ContainerStarted","Data":"6f66fd59b1c390ca7211be6031f8a3a9e02d05ea06b4e989798bf8c623f6e203"} Jun 03 03:34:07.376150 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:07.376115 2575 generic.go:358] "Generic (PLEG): container finished" podID="420662d3-d7bb-4121-94f3-ccff2ea6f18b" containerID="6f66fd59b1c390ca7211be6031f8a3a9e02d05ea06b4e989798bf8c623f6e203" exitCode=0 Jun 03 03:34:07.376532 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:07.376181 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" event={"ID":"420662d3-d7bb-4121-94f3-ccff2ea6f18b","Type":"ContainerDied","Data":"6f66fd59b1c390ca7211be6031f8a3a9e02d05ea06b4e989798bf8c623f6e203"} Jun 03 03:34:09.385335 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:09.385289 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" event={"ID":"420662d3-d7bb-4121-94f3-ccff2ea6f18b","Type":"ContainerStarted","Data":"be04502a2e4ea3d8d5a1edcc7f620487bb39947ed51606bfb62d84509ef88f6c"} Jun 03 03:34:09.402899 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:09.402826 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" podStartSLOduration=1.953480401 podStartE2EDuration="8.402811503s" podCreationTimestamp="2026-06-03 03:34:01 +0000 UTC" firstStartedPulling="2026-06-03 03:34:02.012610675 +0000 UTC m=+825.854192269" lastFinishedPulling="2026-06-03 03:34:08.461941774 +0000 UTC m=+832.303523371" observedRunningTime="2026-06-03 03:34:09.401428512 +0000 UTC m=+833.243010130" watchObservedRunningTime="2026-06-03 03:34:09.402811503 +0000 UTC m=+833.244393119" Jun 03 03:34:11.874238 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:11.874195 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:11.874674 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:11.874508 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:11.887116 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:11.887092 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:12.409197 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:12.409165 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4" Jun 03 03:34:26.570595 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.570122 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx"] Jun 03 03:34:26.591533 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.591504 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx"] Jun 03 03:34:26.591710 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.591650 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.593925 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.593900 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 03:34:26.777207 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.777163 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72b73e79-836b-4e03-ada1-5088e6fd6e61-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.777207 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.777209 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72b73e79-836b-4e03-ada1-5088e6fd6e61-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.777443 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.777240 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6z7d\" (UniqueName: \"kubernetes.io/projected/72b73e79-836b-4e03-ada1-5088e6fd6e61-kube-api-access-x6z7d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.777443 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.777296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72b73e79-836b-4e03-ada1-5088e6fd6e61-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.777443 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.777328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/72b73e79-836b-4e03-ada1-5088e6fd6e61-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.777443 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.777370 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72b73e79-836b-4e03-ada1-5088e6fd6e61-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.878862 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.878761 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72b73e79-836b-4e03-ada1-5088e6fd6e61-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.879023 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.878940 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72b73e79-836b-4e03-ada1-5088e6fd6e61-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.879023 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.878978 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72b73e79-836b-4e03-ada1-5088e6fd6e61-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.879023 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.879015 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x6z7d\" (UniqueName: \"kubernetes.io/projected/72b73e79-836b-4e03-ada1-5088e6fd6e61-kube-api-access-x6z7d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.879178 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.879066 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72b73e79-836b-4e03-ada1-5088e6fd6e61-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.879178 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.879136 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/72b73e79-836b-4e03-ada1-5088e6fd6e61-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.879282 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.879225 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72b73e79-836b-4e03-ada1-5088e6fd6e61-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.879392 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.879370 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72b73e79-836b-4e03-ada1-5088e6fd6e61-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.879526 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.879503 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/72b73e79-836b-4e03-ada1-5088e6fd6e61-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.881454 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.881432 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72b73e79-836b-4e03-ada1-5088e6fd6e61-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.881642 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.881626 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72b73e79-836b-4e03-ada1-5088e6fd6e61-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.886542 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.886520 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6z7d\" (UniqueName: \"kubernetes.io/projected/72b73e79-836b-4e03-ada1-5088e6fd6e61-kube-api-access-x6z7d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx\" (UID: \"72b73e79-836b-4e03-ada1-5088e6fd6e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:26.903055 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:26.903011 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:27.034596 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:27.034569 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx"] Jun 03 03:34:27.037198 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:34:27.037165 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72b73e79_836b_4e03_ada1_5088e6fd6e61.slice/crio-5bbaee479b838ffabd74c9c28a73d96866a88fdbc73a8f400f1b453fa287b976 WatchSource:0}: Error finding container 5bbaee479b838ffabd74c9c28a73d96866a88fdbc73a8f400f1b453fa287b976: Status 404 returned error can't find the container with id 5bbaee479b838ffabd74c9c28a73d96866a88fdbc73a8f400f1b453fa287b976 Jun 03 03:34:27.451251 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:27.451206 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" event={"ID":"72b73e79-836b-4e03-ada1-5088e6fd6e61","Type":"ContainerStarted","Data":"4fc71e64302d8c476de3558199d46b71a26eb3e9ef0940fbf74b985f5446a877"} Jun 03 03:34:27.451251 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:27.451254 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" event={"ID":"72b73e79-836b-4e03-ada1-5088e6fd6e61","Type":"ContainerStarted","Data":"5bbaee479b838ffabd74c9c28a73d96866a88fdbc73a8f400f1b453fa287b976"} Jun 03 03:34:28.051529 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:28.051486 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:34:28.459130 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:28.459099 2575 generic.go:358] "Generic (PLEG): container finished" podID="72b73e79-836b-4e03-ada1-5088e6fd6e61" containerID="4fc71e64302d8c476de3558199d46b71a26eb3e9ef0940fbf74b985f5446a877" exitCode=0 Jun 03 03:34:28.459335 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:28.459194 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" event={"ID":"72b73e79-836b-4e03-ada1-5088e6fd6e61","Type":"ContainerDied","Data":"4fc71e64302d8c476de3558199d46b71a26eb3e9ef0940fbf74b985f5446a877"} Jun 03 03:34:29.464782 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:29.464750 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" event={"ID":"72b73e79-836b-4e03-ada1-5088e6fd6e61","Type":"ContainerStarted","Data":"b22de6e73fb9caf4774199a2e8a5da6a30a0719a8a5e45dc1687aeec891a3f31"} Jun 03 03:34:29.483820 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:29.483770 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" podStartSLOduration=3.295307958 podStartE2EDuration="3.48375614s" podCreationTimestamp="2026-06-03 03:34:26 +0000 UTC" firstStartedPulling="2026-06-03 03:34:28.459757628 +0000 UTC m=+852.301339223" lastFinishedPulling="2026-06-03 03:34:28.648205805 +0000 UTC m=+852.489787405" observedRunningTime="2026-06-03 03:34:29.482778029 +0000 UTC m=+853.324359637" watchObservedRunningTime="2026-06-03 03:34:29.48375614 +0000 UTC m=+853.325337736" Jun 03 03:34:33.753581 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:33.751250 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:34:36.903241 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:36.903208 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:36.903241 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:36.903251 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:36.916955 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:36.916929 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:37.505331 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:37.505299 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx" Jun 03 03:34:52.256123 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.256079 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr"] Jun 03 03:34:52.259883 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.259860 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.262060 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.262038 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 03 03:34:52.270112 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.270087 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr"] Jun 03 03:34:52.295361 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.295332 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/231756cd-a9da-4855-9309-7e9a2b8aa4d0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.295361 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.295368 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/231756cd-a9da-4855-9309-7e9a2b8aa4d0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.295582 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.295395 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/231756cd-a9da-4855-9309-7e9a2b8aa4d0-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.295582 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.295446 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/231756cd-a9da-4855-9309-7e9a2b8aa4d0-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.295582 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.295471 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/231756cd-a9da-4855-9309-7e9a2b8aa4d0-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.295582 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.295509 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh8nq\" (UniqueName: \"kubernetes.io/projected/231756cd-a9da-4855-9309-7e9a2b8aa4d0-kube-api-access-hh8nq\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.396737 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.396682 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/231756cd-a9da-4855-9309-7e9a2b8aa4d0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.396737 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.396736 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/231756cd-a9da-4855-9309-7e9a2b8aa4d0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.396971 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.396768 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/231756cd-a9da-4855-9309-7e9a2b8aa4d0-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.396971 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.396806 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/231756cd-a9da-4855-9309-7e9a2b8aa4d0-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.396971 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.396840 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/231756cd-a9da-4855-9309-7e9a2b8aa4d0-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.396971 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.396902 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hh8nq\" (UniqueName: \"kubernetes.io/projected/231756cd-a9da-4855-9309-7e9a2b8aa4d0-kube-api-access-hh8nq\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.397179 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.397149 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/231756cd-a9da-4855-9309-7e9a2b8aa4d0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.397498 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.397474 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/231756cd-a9da-4855-9309-7e9a2b8aa4d0-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.397852 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.397830 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/231756cd-a9da-4855-9309-7e9a2b8aa4d0-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.400224 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.400200 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/231756cd-a9da-4855-9309-7e9a2b8aa4d0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.401818 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.401774 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/231756cd-a9da-4855-9309-7e9a2b8aa4d0-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.404988 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.404964 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh8nq\" (UniqueName: \"kubernetes.io/projected/231756cd-a9da-4855-9309-7e9a2b8aa4d0-kube-api-access-hh8nq\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr\" (UID: \"231756cd-a9da-4855-9309-7e9a2b8aa4d0\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.571904 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.571864 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:34:52.707136 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:52.707090 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr"] Jun 03 03:34:52.711132 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:34:52.711096 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231756cd_a9da_4855_9309_7e9a2b8aa4d0.slice/crio-e862ba9eda745ef61091e224b76cb7f6fb039ffdb8977335ea65ecc8944aa68e WatchSource:0}: Error finding container e862ba9eda745ef61091e224b76cb7f6fb039ffdb8977335ea65ecc8944aa68e: Status 404 returned error can't find the container with id e862ba9eda745ef61091e224b76cb7f6fb039ffdb8977335ea65ecc8944aa68e Jun 03 03:34:53.556839 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:53.556800 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" event={"ID":"231756cd-a9da-4855-9309-7e9a2b8aa4d0","Type":"ContainerStarted","Data":"710ceb43e3190fa031b0e580528742758931d15ae6a267e68e9f62622593e9c0"} Jun 03 03:34:53.556839 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:53.556844 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" event={"ID":"231756cd-a9da-4855-9309-7e9a2b8aa4d0","Type":"ContainerStarted","Data":"e862ba9eda745ef61091e224b76cb7f6fb039ffdb8977335ea65ecc8944aa68e"} Jun 03 03:34:54.252279 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:34:54.252241 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:35:01.587251 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:35:01.587214 2575 generic.go:358] "Generic (PLEG): container finished" podID="231756cd-a9da-4855-9309-7e9a2b8aa4d0" containerID="710ceb43e3190fa031b0e580528742758931d15ae6a267e68e9f62622593e9c0" exitCode=0 Jun 03 03:35:01.587708 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:35:01.587289 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" event={"ID":"231756cd-a9da-4855-9309-7e9a2b8aa4d0","Type":"ContainerDied","Data":"710ceb43e3190fa031b0e580528742758931d15ae6a267e68e9f62622593e9c0"} Jun 03 03:35:02.595098 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:35:02.593269 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" event={"ID":"231756cd-a9da-4855-9309-7e9a2b8aa4d0","Type":"ContainerStarted","Data":"8e3b44cd67c3187cf115d69ac2b6da933607215d31b7581bc61d62686fe76729"} Jun 03 03:35:02.611346 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:35:02.611290 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" podStartSLOduration=10.404119068 podStartE2EDuration="10.611275687s" podCreationTimestamp="2026-06-03 03:34:52 +0000 UTC" firstStartedPulling="2026-06-03 03:35:01.587954288 +0000 UTC m=+885.429535882" lastFinishedPulling="2026-06-03 03:35:01.795110903 +0000 UTC m=+885.636692501" observedRunningTime="2026-06-03 03:35:02.609702207 +0000 UTC m=+886.451283828" watchObservedRunningTime="2026-06-03 03:35:02.611275687 +0000 UTC m=+886.452857331" Jun 03 03:35:12.572753 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:35:12.572652 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:35:12.572753 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:35:12.572707 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:35:12.585444 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:35:12.585409 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:35:12.647801 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:35:12.647768 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr" Jun 03 03:35:16.735754 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:35:16.735719 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:35:16.737243 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:35:16.737219 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:36:33.349839 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:36:33.349796 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:36:43.753326 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:36:43.753237 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:36:52.152705 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:36:52.152667 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:37:01.446134 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:37:01.446093 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:37:10.248392 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:37:10.248349 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:37:21.046032 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:37:21.045987 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:38:33.158611 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:38:33.158571 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:38:49.352786 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:38:49.352741 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:39:26.549826 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:39:26.549783 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:39:43.553971 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:39:43.553887 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:39:58.245760 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:39:58.245721 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:40:13.851968 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:40:13.851927 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:40:16.761272 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:40:16.761236 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:40:16.762829 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:40:16.762792 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:40:42.250931 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:40:42.250889 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:40:49.048377 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:40:49.048339 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:41:14.850243 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:41:14.850151 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:41:24.246471 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:41:24.246428 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:41:40.642096 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:41:40.642050 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:41:49.547997 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:41:49.547957 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:42:05.756777 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:42:05.756737 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:42:12.847767 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:42:12.847730 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:42:46.944666 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:42:46.944628 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:42:54.841132 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:42:54.841071 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:43:03.347437 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:43:03.347405 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:43:11.548848 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:43:11.548805 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:43:19.542671 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:43:19.542633 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:43:37.552658 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:43:37.552611 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:43:50.849350 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:43:50.849309 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:44:37.845958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:44:37.845916 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:44:43.341979 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:44:43.341945 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:44:48.841674 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:44:48.841632 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:44:57.645325 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:44:57.645256 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:45:06.256012 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:45:06.255969 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:45:12.750891 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:45:12.750852 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:45:16.784342 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:45:16.784308 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:45:16.788304 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:45:16.788282 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:45:23.553431 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:45:23.553390 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:45:32.355086 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:45:32.355040 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:45:41.147752 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:45:41.147512 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:45:48.150265 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:45:48.150216 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:45:58.553567 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:45:58.553512 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:46:05.551917 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:46:05.551864 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:46:15.954458 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:46:15.954419 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:46:25.454304 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:46:25.454263 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:46:31.950201 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:46:31.950160 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:46:42.154703 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:46:42.154662 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:46:51.050751 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:46:51.050708 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:46:57.353539 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:46:57.353502 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:47:49.230871 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:49.230830 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk"] Jun 03 03:47:49.231497 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:49.231145 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" podUID="30b36208-c855-4952-bc49-d8ad3df69b71" containerName="manager" containerID="cri-o://d6ce83cdd2441acb7ceda8fb9edafb1b512b40d6d39faec29bd8467509bb046a" gracePeriod=10 Jun 03 03:47:49.585579 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:49.585522 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" Jun 03 03:47:49.691177 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:49.691121 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30b36208-c855-4952-bc49-d8ad3df69b71-extensions-socket-volume\") pod \"30b36208-c855-4952-bc49-d8ad3df69b71\" (UID: \"30b36208-c855-4952-bc49-d8ad3df69b71\") " Jun 03 03:47:49.691376 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:49.691215 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nn7c9\" (UniqueName: \"kubernetes.io/projected/30b36208-c855-4952-bc49-d8ad3df69b71-kube-api-access-nn7c9\") pod \"30b36208-c855-4952-bc49-d8ad3df69b71\" (UID: \"30b36208-c855-4952-bc49-d8ad3df69b71\") " Jun 03 03:47:49.691597 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:49.691547 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30b36208-c855-4952-bc49-d8ad3df69b71-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "30b36208-c855-4952-bc49-d8ad3df69b71" (UID: "30b36208-c855-4952-bc49-d8ad3df69b71"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 03:47:49.693466 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:49.693442 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30b36208-c855-4952-bc49-d8ad3df69b71-kube-api-access-nn7c9" (OuterVolumeSpecName: "kube-api-access-nn7c9") pod "30b36208-c855-4952-bc49-d8ad3df69b71" (UID: "30b36208-c855-4952-bc49-d8ad3df69b71"). InnerVolumeSpecName "kube-api-access-nn7c9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 03:47:49.792193 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:49.792153 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nn7c9\" (UniqueName: \"kubernetes.io/projected/30b36208-c855-4952-bc49-d8ad3df69b71-kube-api-access-nn7c9\") on node \"ip-10-0-130-55.ec2.internal\" DevicePath \"\"" Jun 03 03:47:49.792193 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:49.792185 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30b36208-c855-4952-bc49-d8ad3df69b71-extensions-socket-volume\") on node \"ip-10-0-130-55.ec2.internal\" DevicePath \"\"" Jun 03 03:47:50.288291 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:50.288254 2575 generic.go:358] "Generic (PLEG): container finished" podID="30b36208-c855-4952-bc49-d8ad3df69b71" containerID="d6ce83cdd2441acb7ceda8fb9edafb1b512b40d6d39faec29bd8467509bb046a" exitCode=0 Jun 03 03:47:50.288723 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:50.288316 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" Jun 03 03:47:50.288723 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:50.288343 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" event={"ID":"30b36208-c855-4952-bc49-d8ad3df69b71","Type":"ContainerDied","Data":"d6ce83cdd2441acb7ceda8fb9edafb1b512b40d6d39faec29bd8467509bb046a"} Jun 03 03:47:50.288723 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:50.288380 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk" event={"ID":"30b36208-c855-4952-bc49-d8ad3df69b71","Type":"ContainerDied","Data":"76301c162896c1fc9ad202d667662ea61e6aebb8e214a20f8b827c92b75e8ab9"} Jun 03 03:47:50.288723 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:50.288395 2575 scope.go:117] "RemoveContainer" containerID="d6ce83cdd2441acb7ceda8fb9edafb1b512b40d6d39faec29bd8467509bb046a" Jun 03 03:47:50.297732 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:50.297712 2575 scope.go:117] "RemoveContainer" containerID="d6ce83cdd2441acb7ceda8fb9edafb1b512b40d6d39faec29bd8467509bb046a" Jun 03 03:47:50.297997 ip-10-0-130-55 kubenswrapper[2575]: E0603 03:47:50.297975 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6ce83cdd2441acb7ceda8fb9edafb1b512b40d6d39faec29bd8467509bb046a\": container with ID starting with d6ce83cdd2441acb7ceda8fb9edafb1b512b40d6d39faec29bd8467509bb046a not found: ID does not exist" containerID="d6ce83cdd2441acb7ceda8fb9edafb1b512b40d6d39faec29bd8467509bb046a" Jun 03 03:47:50.298040 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:50.298006 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6ce83cdd2441acb7ceda8fb9edafb1b512b40d6d39faec29bd8467509bb046a"} err="failed to get container status \"d6ce83cdd2441acb7ceda8fb9edafb1b512b40d6d39faec29bd8467509bb046a\": rpc error: code = NotFound desc = could not find container \"d6ce83cdd2441acb7ceda8fb9edafb1b512b40d6d39faec29bd8467509bb046a\": container with ID starting with d6ce83cdd2441acb7ceda8fb9edafb1b512b40d6d39faec29bd8467509bb046a not found: ID does not exist" Jun 03 03:47:50.309709 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:50.309681 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk"] Jun 03 03:47:50.312697 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:50.312670 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wbnlk"] Jun 03 03:47:50.783106 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:47:50.783077 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30b36208-c855-4952-bc49-d8ad3df69b71" path="/var/lib/kubelet/pods/30b36208-c855-4952-bc49-d8ad3df69b71/volumes" Jun 03 03:49:13.993958 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:49:13.993917 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:49:20.588842 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:49:20.588803 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:49:46.488133 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:49:46.488093 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:49:52.295858 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:49:52.295818 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:50:02.197198 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:50:02.197155 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:50:12.792932 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:50:12.792893 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:50:16.808534 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:50:16.808502 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:50:16.814145 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:50:16.814124 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:50:21.596783 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:50:21.596747 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:50:32.393024 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:50:32.392985 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:50:41.586205 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:50:41.586163 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:50:50.585983 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:50:50.585947 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:51:00.491655 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:51:00.491615 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:51:10.392037 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:51:10.391994 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:51:19.185988 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:51:19.185938 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:51:26.593128 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:51:26.593085 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:51:52.590729 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:51:52.590647 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:52:35.791089 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:52:35.791037 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:52:45.686837 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:52:45.686794 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:52:55.892917 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:52:55.892879 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:53:02.692240 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:53:02.692197 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:53:10.996619 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:53:10.996496 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:53:24.288416 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:53:24.288376 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:53:34.096190 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:53:34.096149 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:53:41.986788 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:53:41.986745 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:53:52.193748 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:53:52.193704 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:54:01.631631 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:54:01.631595 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:54:09.688868 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:54:09.688824 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:54:21.985545 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:54:21.985501 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:54:39.288905 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:54:39.288816 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:54:47.993478 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:54:47.993443 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:54:56.694447 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:54:56.694402 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:55:03.589196 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:55:03.589158 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:55:16.831265 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:55:16.831225 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:55:16.841259 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:55:16.841234 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:55:22.093054 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:55:22.093012 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:55:29.187907 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:55:29.187865 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:55:39.992909 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:55:39.992872 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:55:46.288741 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:55:46.288701 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:55:56.198777 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:55:56.198732 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:56:03.488309 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:56:03.488259 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:56:13.588876 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:56:13.588791 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:56:26.496418 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:56:26.496379 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:56:35.190409 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:56:35.190366 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:56:48.287723 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:56:48.287677 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:56:57.992528 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:56:57.992484 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:57:06.288104 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:57:06.288059 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:57:16.693296 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:57:16.693252 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:57:25.085445 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:57:25.085402 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:57:41.893729 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:57:41.893637 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:57:50.984296 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:57:50.984256 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:58:00.091970 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:58:00.091931 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:58:06.791362 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:58:06.791324 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:58:32.884012 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:58:32.883974 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:58:44.692547 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:58:44.692497 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5s7n6"] Jun 03 03:59:14.868534 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:14.868455 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5cbbc674f4-4846f_cac6fb51-ec5b-4a0d-9d67-58526fc6c1ed/nginx/0.log" Jun 03 03:59:15.086765 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:15.086730 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-8q7zf_ae402e12-82a7-442e-9d82-c04d5f81dfed/manager/0.log" Jun 03 03:59:15.201171 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:15.201096 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-s8825_76a486e8-1110-4190-9b29-5b3a282a091c/manager/0.log" Jun 03 03:59:15.312559 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:15.312507 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6b44f49ff-ffxwb_a9fc93c1-db0d-4f3d-a4c2-c4ffdf032167/maas-api/0.log" Jun 03 03:59:15.635801 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:15.635769 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-2qqgr_bfc6d49b-5baf-4ced-b964-578f1be0fc8a/server/0.log" Jun 03 03:59:15.744880 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:15.744844 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-9gg8h_e767d090-f951-4962-b654-88f34200fe01/manager/0.log" Jun 03 03:59:15.973606 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:15.973502 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f864588-g98jd_deeb95c6-2bad-48a9-bea1-669c0b515934/copy-manifests/0.log" Jun 03 03:59:15.985607 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:15.985580 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f864588-g98jd_deeb95c6-2bad-48a9-bea1-669c0b515934/manager/0.log" Jun 03 03:59:18.080073 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:18.080045 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-5s7n6_8f89644a-6d48-42b8-b986-9ac2f2e78297/limitador/0.log" Jun 03 03:59:18.656684 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:18.656652 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-5djxd_8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f/discovery/0.log" Jun 03 03:59:18.866255 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:18.866229 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6969fb6c4b-96g8q_a952be14-696c-4531-ba3c-9cd1975889d3/kube-auth-proxy/0.log" Jun 03 03:59:19.097884 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:19.097853 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-krxlx_67c4a030-b833-45cb-9dc1-bce4a4471c15/payload-processing/0.log" Jun 03 03:59:19.778874 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:19.778839 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4_420662d3-d7bb-4121-94f3-ccff2ea6f18b/storage-initializer/0.log" Jun 03 03:59:19.785492 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:19.785471 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-nnxq4_420662d3-d7bb-4121-94f3-ccff2ea6f18b/main/0.log" Jun 03 03:59:19.891182 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:19.891145 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx_72b73e79-836b-4e03-ada1-5088e6fd6e61/storage-initializer/0.log" Jun 03 03:59:19.897531 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:19.897505 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97nrxx_72b73e79-836b-4e03-ada1-5088e6fd6e61/main/0.log" Jun 03 03:59:20.120712 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:20.120632 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr_231756cd-a9da-4855-9309-7e9a2b8aa4d0/storage-initializer/0.log" Jun 03 03:59:20.127356 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:20.127334 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-5z7qr_231756cd-a9da-4855-9309-7e9a2b8aa4d0/main/0.log" Jun 03 03:59:27.256009 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:27.255971 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n6xjh_ae02a8fa-2d15-40f8-8fad-88bcfc0ebb27/global-pull-secret-syncer/0.log" Jun 03 03:59:27.357371 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:27.357312 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ndjrl_dbb3a2ed-ce99-479a-979b-4968e52096ce/konnectivity-agent/0.log" Jun 03 03:59:27.399475 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:27.399446 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-55.ec2.internal_9e6a6970212cff9ea79f77794f10d402/haproxy/0.log" Jun 03 03:59:32.641027 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:32.640987 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-5s7n6_8f89644a-6d48-42b8-b986-9ac2f2e78297/limitador/0.log" Jun 03 03:59:34.610421 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:34.610388 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kqrlb_24d6a683-3ced-42d6-9168-87f4dcf360ad/node-exporter/0.log" Jun 03 03:59:34.630290 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:34.630263 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kqrlb_24d6a683-3ced-42d6-9168-87f4dcf360ad/kube-rbac-proxy/0.log" Jun 03 03:59:34.655475 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:34.655446 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kqrlb_24d6a683-3ced-42d6-9168-87f4dcf360ad/init-textfile/0.log" Jun 03 03:59:36.215235 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:36.215203 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-zw6wn_46717f80-0839-4cb3-86d2-db4812b785a0/networking-console-plugin/0.log" Jun 03 03:59:38.169084 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.169048 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb"] Jun 03 03:59:38.169475 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.169406 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b36208-c855-4952-bc49-d8ad3df69b71" containerName="manager" Jun 03 03:59:38.169475 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.169420 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b36208-c855-4952-bc49-d8ad3df69b71" containerName="manager" Jun 03 03:59:38.169579 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.169480 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="30b36208-c855-4952-bc49-d8ad3df69b71" containerName="manager" Jun 03 03:59:38.172367 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.172347 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.174366 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.174343 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hsqd8\"/\"kube-root-ca.crt\"" Jun 03 03:59:38.175068 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.175047 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hsqd8\"/\"openshift-service-ca.crt\"" Jun 03 03:59:38.175180 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.175099 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hsqd8\"/\"default-dockercfg-x9tf6\"" Jun 03 03:59:38.182260 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.182231 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb"] Jun 03 03:59:38.242705 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.242664 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acc882d8-05a0-4d2b-b426-27a3a3022ce2-sys\") pod \"perf-node-gather-daemonset-xzxkb\" (UID: \"acc882d8-05a0-4d2b-b426-27a3a3022ce2\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.242705 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.242703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gq2j\" (UniqueName: \"kubernetes.io/projected/acc882d8-05a0-4d2b-b426-27a3a3022ce2-kube-api-access-2gq2j\") pod \"perf-node-gather-daemonset-xzxkb\" (UID: \"acc882d8-05a0-4d2b-b426-27a3a3022ce2\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.242936 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.242729 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/acc882d8-05a0-4d2b-b426-27a3a3022ce2-lib-modules\") pod \"perf-node-gather-daemonset-xzxkb\" (UID: \"acc882d8-05a0-4d2b-b426-27a3a3022ce2\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.242936 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.242805 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/acc882d8-05a0-4d2b-b426-27a3a3022ce2-proc\") pod \"perf-node-gather-daemonset-xzxkb\" (UID: \"acc882d8-05a0-4d2b-b426-27a3a3022ce2\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.242936 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.242846 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/acc882d8-05a0-4d2b-b426-27a3a3022ce2-podres\") pod \"perf-node-gather-daemonset-xzxkb\" (UID: \"acc882d8-05a0-4d2b-b426-27a3a3022ce2\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.343710 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.343671 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/acc882d8-05a0-4d2b-b426-27a3a3022ce2-proc\") pod \"perf-node-gather-daemonset-xzxkb\" (UID: \"acc882d8-05a0-4d2b-b426-27a3a3022ce2\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.343710 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.343716 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/acc882d8-05a0-4d2b-b426-27a3a3022ce2-podres\") pod \"perf-node-gather-daemonset-xzxkb\" (UID: \"acc882d8-05a0-4d2b-b426-27a3a3022ce2\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.343946 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.343776 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acc882d8-05a0-4d2b-b426-27a3a3022ce2-sys\") pod \"perf-node-gather-daemonset-xzxkb\" (UID: \"acc882d8-05a0-4d2b-b426-27a3a3022ce2\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.343946 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.343795 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2gq2j\" (UniqueName: \"kubernetes.io/projected/acc882d8-05a0-4d2b-b426-27a3a3022ce2-kube-api-access-2gq2j\") pod \"perf-node-gather-daemonset-xzxkb\" (UID: \"acc882d8-05a0-4d2b-b426-27a3a3022ce2\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.343946 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.343816 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/acc882d8-05a0-4d2b-b426-27a3a3022ce2-proc\") pod \"perf-node-gather-daemonset-xzxkb\" (UID: \"acc882d8-05a0-4d2b-b426-27a3a3022ce2\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.343946 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.343821 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/acc882d8-05a0-4d2b-b426-27a3a3022ce2-lib-modules\") pod \"perf-node-gather-daemonset-xzxkb\" (UID: \"acc882d8-05a0-4d2b-b426-27a3a3022ce2\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.343946 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.343886 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acc882d8-05a0-4d2b-b426-27a3a3022ce2-sys\") pod \"perf-node-gather-daemonset-xzxkb\" (UID: \"acc882d8-05a0-4d2b-b426-27a3a3022ce2\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.343946 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.343928 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/acc882d8-05a0-4d2b-b426-27a3a3022ce2-lib-modules\") pod \"perf-node-gather-daemonset-xzxkb\" (UID: \"acc882d8-05a0-4d2b-b426-27a3a3022ce2\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.343946 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.343931 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/acc882d8-05a0-4d2b-b426-27a3a3022ce2-podres\") pod \"perf-node-gather-daemonset-xzxkb\" (UID: \"acc882d8-05a0-4d2b-b426-27a3a3022ce2\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.351306 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.351273 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gq2j\" (UniqueName: \"kubernetes.io/projected/acc882d8-05a0-4d2b-b426-27a3a3022ce2-kube-api-access-2gq2j\") pod \"perf-node-gather-daemonset-xzxkb\" (UID: \"acc882d8-05a0-4d2b-b426-27a3a3022ce2\") " pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.484205 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.484118 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.617027 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.616952 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb"] Jun 03 03:59:38.619931 ip-10-0-130-55 kubenswrapper[2575]: W0603 03:59:38.619896 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podacc882d8_05a0_4d2b_b426_27a3a3022ce2.slice/crio-14eb19f787620228c8774757b96d726a16d92a3954af90138bc815af921a5e6d WatchSource:0}: Error finding container 14eb19f787620228c8774757b96d726a16d92a3954af90138bc815af921a5e6d: Status 404 returned error can't find the container with id 14eb19f787620228c8774757b96d726a16d92a3954af90138bc815af921a5e6d Jun 03 03:59:38.621741 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.621721 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 03:59:38.727128 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.727088 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" event={"ID":"acc882d8-05a0-4d2b-b426-27a3a3022ce2","Type":"ContainerStarted","Data":"07c6521eeb0a67616a844a37ee3ac268d078ce6695ac2a55e010c81686bf05be"} Jun 03 03:59:38.727128 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.727132 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" event={"ID":"acc882d8-05a0-4d2b-b426-27a3a3022ce2","Type":"ContainerStarted","Data":"14eb19f787620228c8774757b96d726a16d92a3954af90138bc815af921a5e6d"} Jun 03 03:59:38.727385 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.727260 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:38.727790 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.727774 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hqjbr_65e090c5-86cd-4b86-aca5-0d341af5171b/dns/0.log" Jun 03 03:59:38.742959 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.742863 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" podStartSLOduration=0.742849097 podStartE2EDuration="742.849097ms" podCreationTimestamp="2026-06-03 03:59:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 03:59:38.740125632 +0000 UTC m=+2362.581707248" watchObservedRunningTime="2026-06-03 03:59:38.742849097 +0000 UTC m=+2362.584430714" Jun 03 03:59:38.748957 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.748933 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hqjbr_65e090c5-86cd-4b86-aca5-0d341af5171b/kube-rbac-proxy/0.log" Jun 03 03:59:38.855985 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:38.855962 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9cklm_70e80cc4-7c78-4606-a320-d3cc0ac6452a/dns-node-resolver/0.log" Jun 03 03:59:39.396666 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:39.396629 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rkbr5_4801abc1-ec7f-43ab-a2e1-2cbac19f58cb/node-ca/0.log" Jun 03 03:59:40.296521 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:40.296488 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-5djxd_8f4b89bd-3065-4d07-8ee4-9e6b7a0f164f/discovery/0.log" Jun 03 03:59:40.336823 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:40.336792 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6969fb6c4b-96g8q_a952be14-696c-4531-ba3c-9cd1975889d3/kube-auth-proxy/0.log" Jun 03 03:59:40.461184 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:40.461150 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-krxlx_67c4a030-b833-45cb-9dc1-bce4a4471c15/payload-processing/0.log" Jun 03 03:59:40.974786 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:40.974745 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2s2h7_9338190d-d545-403e-888a-43929db2a9ec/serve-healthcheck-canary/0.log" Jun 03 03:59:41.430603 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:41.430573 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7k6jr_bdcaeb80-8c1b-47d5-8f13-8576cfb48167/kube-rbac-proxy/0.log" Jun 03 03:59:41.448859 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:41.448836 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7k6jr_bdcaeb80-8c1b-47d5-8f13-8576cfb48167/exporter/0.log" Jun 03 03:59:41.467043 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:41.467015 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7k6jr_bdcaeb80-8c1b-47d5-8f13-8576cfb48167/extractor/0.log" Jun 03 03:59:43.493896 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:43.493864 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5cbbc674f4-4846f_cac6fb51-ec5b-4a0d-9d67-58526fc6c1ed/nginx/0.log" Jun 03 03:59:43.537267 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:43.537232 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-8q7zf_ae402e12-82a7-442e-9d82-c04d5f81dfed/manager/0.log" Jun 03 03:59:43.611897 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:43.611860 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-s8825_76a486e8-1110-4190-9b29-5b3a282a091c/manager/0.log" Jun 03 03:59:43.643585 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:43.643545 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6b44f49ff-ffxwb_a9fc93c1-db0d-4f3d-a4c2-c4ffdf032167/maas-api/0.log" Jun 03 03:59:43.755585 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:43.755482 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-2qqgr_bfc6d49b-5baf-4ced-b964-578f1be0fc8a/server/0.log" Jun 03 03:59:43.805024 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:43.804985 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-9gg8h_e767d090-f951-4962-b654-88f34200fe01/manager/0.log" Jun 03 03:59:43.949804 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:43.949765 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f864588-g98jd_deeb95c6-2bad-48a9-bea1-669c0b515934/manager/0.log" Jun 03 03:59:43.964414 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:43.964388 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f864588-g98jd_deeb95c6-2bad-48a9-bea1-669c0b515934/copy-manifests/0.log" Jun 03 03:59:44.741044 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:44.741016 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hsqd8/perf-node-gather-daemonset-xzxkb" Jun 03 03:59:45.340528 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:45.340492 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-z6x8f_9f9c4e15-c8e3-4651-907f-182633560542/openshift-lws-operator/0.log" Jun 03 03:59:51.500293 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:51.500257 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5fkcf_6bc4f112-f25e-439c-b288-0788f935ade9/kube-multus-additional-cni-plugins/0.log" Jun 03 03:59:51.519229 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:51.519202 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5fkcf_6bc4f112-f25e-439c-b288-0788f935ade9/egress-router-binary-copy/0.log" Jun 03 03:59:51.540127 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:51.540077 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5fkcf_6bc4f112-f25e-439c-b288-0788f935ade9/cni-plugins/0.log" Jun 03 03:59:51.558005 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:51.557971 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5fkcf_6bc4f112-f25e-439c-b288-0788f935ade9/bond-cni-plugin/0.log" Jun 03 03:59:51.577532 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:51.577500 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5fkcf_6bc4f112-f25e-439c-b288-0788f935ade9/routeoverride-cni/0.log" Jun 03 03:59:51.595628 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:51.595604 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5fkcf_6bc4f112-f25e-439c-b288-0788f935ade9/whereabouts-cni-bincopy/0.log" Jun 03 03:59:51.614266 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:51.614240 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5fkcf_6bc4f112-f25e-439c-b288-0788f935ade9/whereabouts-cni/0.log" Jun 03 03:59:51.789897 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:51.789871 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-p5fc9_90b86af7-646d-4288-9773-965f3ef2ac98/kube-multus/0.log" Jun 03 03:59:51.913545 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:51.913518 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-trw96_0085db10-4407-48e2-b27f-2abf8391ee43/network-metrics-daemon/0.log" Jun 03 03:59:51.931182 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:51.931156 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-trw96_0085db10-4407-48e2-b27f-2abf8391ee43/kube-rbac-proxy/0.log" Jun 03 03:59:53.004908 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:53.004872 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-controller/0.log" Jun 03 03:59:53.020405 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:53.020377 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/0.log" Jun 03 03:59:53.030414 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:53.030379 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovn-acl-logging/1.log" Jun 03 03:59:53.048285 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:53.048252 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/kube-rbac-proxy-node/0.log" Jun 03 03:59:53.066074 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:53.066042 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 03:59:53.080674 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:53.080646 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/northd/0.log" Jun 03 03:59:53.097760 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:53.097734 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/nbdb/0.log" Jun 03 03:59:53.115803 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:53.115777 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/sbdb/0.log" Jun 03 03:59:53.218132 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:53.218102 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn4q2_8aa8e984-793a-41cf-81a8-6b25a478ada3/ovnkube-controller/0.log" Jun 03 03:59:54.575580 ip-10-0-130-55 kubenswrapper[2575]: I0603 03:59:54.575520 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vsqpb_5316cd63-ebbf-456a-99d6-a20a009eeeac/network-check-target-container/0.log"