Jun 10 00:32:23.564829 ip-10-0-131-237 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 00:32:23.564844 ip-10-0-131-237 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 00:32:23.564852 ip-10-0-131-237 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 00:32:23.565071 ip-10-0-131-237 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 00:32:33.571672 ip-10-0-131-237 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 00:32:33.571688 ip-10-0-131-237 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6a0f0864d30b4f008e560af716f88d27 -- Jun 10 00:35:13.064544 ip-10-0-131-237 systemd[1]: Starting Kubernetes Kubelet... Jun 10 00:35:13.440380 ip-10-0-131-237 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 00:35:13.440380 ip-10-0-131-237 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 00:35:13.440380 ip-10-0-131-237 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 00:35:13.440380 ip-10-0-131-237 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 00:35:13.440380 ip-10-0-131-237 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 00:35:13.442911 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.442815 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 00:35:13.447046 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447030 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:13.447046 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447046 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447049 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447054 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447057 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447060 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447063 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447066 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447068 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447071 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447074 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447077 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447079 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447083 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447089 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447091 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447095 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447097 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447100 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447103 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447105 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:13.447114 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447108 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447111 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447114 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447117 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447119 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447122 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447125 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447128 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447132 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447135 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447137 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447140 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447142 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447145 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447147 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447150 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447152 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447155 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447158 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447160 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:13.447599 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447163 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447165 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447168 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447172 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447176 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447180 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447183 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447187 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447190 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447193 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447210 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447214 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447217 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447220 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447223 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447225 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447228 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447232 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:13.448087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447234 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447237 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447240 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447243 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447246 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447248 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447251 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447254 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447256 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447260 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447263 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447265 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447268 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447271 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447273 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447276 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447278 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447280 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447283 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447286 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:13.448546 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447288 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447291 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447294 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447297 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447299 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447302 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447305 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447308 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447311 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447314 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447316 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447320 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447322 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447324 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447327 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447330 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447332 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447335 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447338 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.447341 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:13.449034 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448114 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448121 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448124 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448127 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448129 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448133 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448137 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448142 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448145 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448148 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448150 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448153 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448156 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448159 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448161 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448164 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448167 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448170 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448172 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448176 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:13.449542 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448180 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448184 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448187 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448190 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448193 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448196 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448213 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448216 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448219 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448222 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448226 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448229 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448232 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448235 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448238 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448241 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448243 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448246 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448248 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448251 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:13.450044 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448254 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448257 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448259 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448262 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448265 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448268 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448271 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448274 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448276 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448279 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448281 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448284 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448287 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448289 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448292 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448294 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448297 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448300 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448302 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448305 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:13.450565 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448307 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448309 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448313 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448316 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448318 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448321 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448323 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448328 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448331 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448333 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448336 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448338 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448341 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448344 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448347 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448350 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448352 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448355 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448357 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448360 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:13.451066 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448362 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448365 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448367 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448370 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448372 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448375 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448377 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448379 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448382 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448386 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448389 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448392 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448394 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448397 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448400 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448403 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448406 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448408 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448411 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:13.451597 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448792 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448797 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448800 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448802 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448805 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448809 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448812 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448816 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448819 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448822 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448824 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448827 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448830 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448832 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448835 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448837 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448842 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448845 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448848 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:13.452067 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448851 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448854 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448857 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448859 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448862 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448864 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448867 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448870 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448872 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448875 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448878 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448880 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448886 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448888 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448891 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448893 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448899 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448902 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448904 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448907 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:13.452551 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448910 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448913 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448915 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448917 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448920 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448922 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448925 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448928 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448930 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448933 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448935 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448938 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448941 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448943 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448946 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448949 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448951 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448954 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448956 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448959 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:13.453087 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448961 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448964 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448967 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448970 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448974 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448976 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448979 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448982 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448985 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448989 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448991 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448994 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448996 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.448999 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449002 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449004 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449006 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449009 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449011 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449015 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:13.453611 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449018 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449021 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449024 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449027 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449030 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449033 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449036 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449038 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449041 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449044 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449046 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449049 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449051 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449054 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449056 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449060 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449063 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449066 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449069 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449071 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:13.454126 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449145 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449153 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449160 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449164 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449169 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449172 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449176 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449181 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449184 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449187 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449191 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449194 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449210 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449214 2577 flags.go:64] FLAG: --cgroup-root="" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449218 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449221 2577 flags.go:64] FLAG: --client-ca-file="" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449224 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449227 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449231 2577 flags.go:64] FLAG: --cluster-domain="" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449234 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449236 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449240 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449243 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449247 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 00:35:13.454644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449250 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449253 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449257 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449260 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449264 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449268 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449271 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449274 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449281 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449284 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449287 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449290 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449293 2577 flags.go:64] FLAG: --enable-server="true" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449296 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449300 2577 flags.go:64] FLAG: --event-burst="100" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449304 2577 flags.go:64] FLAG: --event-qps="50" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449307 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449310 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449313 2577 flags.go:64] FLAG: --eviction-hard="" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449316 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449319 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449322 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449325 2577 flags.go:64] FLAG: --eviction-soft="" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449328 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449331 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 00:35:13.455247 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449335 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449337 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449340 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449344 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449346 2577 flags.go:64] FLAG: --feature-gates="" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449350 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449353 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449356 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449360 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449364 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449367 2577 flags.go:64] FLAG: --help="false" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449371 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-131-237.ec2.internal" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449380 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449383 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449386 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449390 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449394 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449397 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449400 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449403 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449406 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449409 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449412 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449415 2577 flags.go:64] FLAG: --kube-reserved="" Jun 10 00:35:13.456036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449418 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449421 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449424 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449427 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449430 2577 flags.go:64] FLAG: --lock-file="" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449433 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449436 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449439 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449444 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449447 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449450 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449453 2577 flags.go:64] FLAG: --logging-format="text" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449456 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449459 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449462 2577 flags.go:64] FLAG: --manifest-url="" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449465 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449469 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449472 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449476 2577 flags.go:64] FLAG: --max-pods="110" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449481 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449484 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449487 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449490 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449494 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449497 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 00:35:13.457045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449500 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449508 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449510 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449514 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449517 2577 flags.go:64] FLAG: --pod-cidr="" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449520 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449525 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449528 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449531 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449534 2577 flags.go:64] FLAG: --port="10250" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449537 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449540 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03ad80709972642de" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449543 2577 flags.go:64] FLAG: --qos-reserved="" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449546 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449549 2577 flags.go:64] FLAG: --register-node="true" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449553 2577 flags.go:64] FLAG: --register-with-taints="" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449556 2577 flags.go:64] FLAG: --registry-burst="10" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449559 2577 flags.go:64] FLAG: --registry-qps="5" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449562 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449565 2577 flags.go:64] FLAG: --reserved-memory="" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449569 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449572 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449575 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449578 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449581 2577 flags.go:64] FLAG: --runonce="false" Jun 10 00:35:13.458067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449584 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449588 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449591 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449593 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449597 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449600 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449604 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449607 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449610 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449612 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449615 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449618 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449621 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449624 2577 flags.go:64] FLAG: --system-cgroups="" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449626 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449632 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449634 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449637 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449640 2577 flags.go:64] FLAG: --tls-min-version="" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449643 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449646 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449649 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449651 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449654 2577 flags.go:64] FLAG: --v="2" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449658 2577 flags.go:64] FLAG: --version="false" Jun 10 00:35:13.458811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449662 2577 flags.go:64] FLAG: --vmodule="" Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449666 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.449669 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449788 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449791 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449794 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449797 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449800 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449803 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449806 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449809 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449811 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449815 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449817 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449820 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449823 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449825 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449828 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449830 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449833 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:13.459567 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449836 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449839 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449841 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449844 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449846 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449849 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449851 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449854 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449856 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449859 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449862 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449864 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449866 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449869 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449871 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449874 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449877 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449879 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449883 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:13.460082 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449886 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449890 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449892 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449895 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449898 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449902 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449906 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449909 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449911 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449914 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449916 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449918 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449921 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449923 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449926 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449928 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449931 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449933 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449936 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449938 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:13.460588 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449941 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449943 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449946 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449948 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449951 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449953 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449956 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449958 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449961 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449963 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449966 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449968 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449971 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449974 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449977 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449979 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449982 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449984 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449987 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449990 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:13.461084 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449993 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449995 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.449997 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450000 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450002 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450005 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450007 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450010 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450012 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450016 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450019 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450022 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450025 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450028 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450030 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450033 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450035 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450038 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450040 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:13.461583 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450043 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:13.462049 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450045 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:13.462049 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450048 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:13.462049 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.450051 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:13.462049 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.450654 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 00:35:13.462049 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.459073 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 00:35:13.462049 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.459091 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 00:35:13.462049 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.459719 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 00:35:13.462049 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.459726 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 00:35:13.462049 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459801 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:13.462049 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459807 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:13.462049 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459810 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:13.462049 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459813 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:13.462049 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459816 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:13.462049 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459820 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:13.462049 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459823 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459826 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459829 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459833 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459835 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459838 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459841 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459844 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459847 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459851 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459854 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459857 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459859 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459864 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459868 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459871 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459874 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459877 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459880 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:13.462459 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459883 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459886 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459889 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459892 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459895 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459898 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459901 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459904 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459907 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459909 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459913 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459915 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459918 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459921 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459925 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459928 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459931 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459933 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459936 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459939 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:13.462934 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459941 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459945 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459948 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459950 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459953 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459955 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459958 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459961 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459963 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459966 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459969 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459972 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459975 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459977 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459980 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459982 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459986 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459989 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459991 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459994 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:13.463445 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459996 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.459999 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460001 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460004 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460007 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460009 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460012 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460015 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460017 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460020 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460022 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460025 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460029 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460032 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460036 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460039 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460042 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460045 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460048 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:13.463946 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460050 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:13.464487 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460053 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:13.464487 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460056 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:13.464487 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460058 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:13.464487 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460061 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:13.464487 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460064 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:13.464487 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460066 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:13.464487 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460069 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:13.464487 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460072 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:13.464487 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460076 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:13.464487 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460078 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:13.464487 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460081 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:13.464487 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460084 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:13.464487 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460087 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:13.464487 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460090 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:13.464487 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.460095 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460232 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460239 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460241 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460244 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460247 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460250 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460252 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460255 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460258 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460260 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460263 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460266 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460269 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460271 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460274 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460277 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460281 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460284 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 00:35:13.464870 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460288 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460291 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460295 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460298 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460300 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460303 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460306 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460310 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460313 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460316 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460318 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460321 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460324 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460326 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460329 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460332 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460334 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460337 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460339 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 00:35:13.465432 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460342 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460344 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460347 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460349 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460352 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460354 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460357 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460360 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460363 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460366 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460368 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460371 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460374 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460376 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460379 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460381 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460384 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460386 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460389 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460392 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 00:35:13.465984 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460395 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460397 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460400 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460402 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460405 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460407 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460410 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460412 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460415 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460418 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460420 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460423 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460425 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460428 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460430 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460433 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460436 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460438 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460441 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 00:35:13.466545 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460444 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460446 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460450 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460452 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460455 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460458 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460460 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460463 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460466 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460469 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460471 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460474 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460476 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460479 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460482 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460484 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460488 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460491 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460494 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460497 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 00:35:13.467331 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460499 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 00:35:13.468014 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460502 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 00:35:13.468014 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:13.460504 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 00:35:13.468014 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.460509 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 00:35:13.468014 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.460639 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 00:35:13.468014 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.463958 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 00:35:13.468014 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.465288 2577 server.go:1019] "Starting client certificate rotation" Jun 10 00:35:13.468014 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.465417 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 00:35:13.468014 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.465462 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 00:35:13.468543 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.468527 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 00:35:13.472787 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.472766 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 00:35:13.482709 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.482686 2577 log.go:25] "Validated CRI v1 runtime API" Jun 10 00:35:13.485285 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.485267 2577 log.go:25] "Validated CRI v1 image API" Jun 10 00:35:13.486157 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.486139 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 00:35:13.490259 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.490236 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c20ec797-5ed0-41c5-a78d-40eca9c5fbd4:/dev/nvme0n1p3 c8239627-7cc4-4e59-994f-3e6cf9a5a7cc:/dev/nvme0n1p4] Jun 10 00:35:13.490361 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.490256 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 00:35:13.495343 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.495194 2577 manager.go:216] Machine: {Timestamp:2026-06-10 00:35:13.494709756 +0000 UTC m=+0.318615605 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095491 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f02932b5820fcb2bcc4c661c6d167 SystemUUID:ec2f0293-2b58-20fc-b2bc-c4c661c6d167 BootID:6a0f0864-d30b-4f00-8e56-0af716f88d27 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3a:cf:4d:fa:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3a:cf:4d:fa:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:80:f9:85:99:8b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 00:35:13.495343 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.495328 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 00:35:13.495513 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.495492 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 00:35:13.499382 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.499356 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 00:35:13.499658 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.499414 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 00:35:13.499821 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.499665 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-237.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 00:35:13.500486 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.500476 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 00:35:13.500527 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.500489 2577 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 00:35:13.500527 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.500497 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 00:35:13.500527 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.500507 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 00:35:13.501297 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.501287 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 00:35:13.504096 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.504084 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 10 00:35:13.504246 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.504236 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 00:35:13.504284 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.504269 2577 kubelet.go:486] "Attempting to sync node with API server" Jun 10 00:35:13.504284 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.504279 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 00:35:13.504352 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.504296 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 00:35:13.504352 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.504310 2577 kubelet.go:398] "Adding apiserver pod source" Jun 10 00:35:13.504352 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.504323 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 00:35:13.504728 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.504717 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 00:35:13.504772 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.504736 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 00:35:13.507128 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.507107 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 00:35:13.508670 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.508656 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 00:35:13.508727 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.508687 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 00:35:13.509828 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.509815 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 00:35:13.509877 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.509832 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 00:35:13.509877 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.509838 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 00:35:13.509877 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.509845 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 00:35:13.509877 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.509853 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 00:35:13.509877 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.509859 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 00:35:13.509877 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.509868 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 00:35:13.509877 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.509874 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 00:35:13.509877 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.509881 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 00:35:13.510088 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.509887 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 00:35:13.510088 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.509895 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 00:35:13.510088 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.509901 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 00:35:13.511106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.511095 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 00:35:13.511106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.511105 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 00:35:13.514239 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.514225 2577 server.go:1268] "Started kubelet" Jun 10 00:35:13.514372 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.514321 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 00:35:13.514433 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.514375 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 00:35:13.514433 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.514424 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 00:35:13.514749 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.514726 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-237.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 00:35:13.514854 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.514752 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 00:35:13.514915 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.514855 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-237.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 00:35:13.515129 ip-10-0-131-237 systemd[1]: Started Kubernetes Kubelet. Jun 10 00:35:13.516740 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.516720 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 00:35:13.516856 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.516775 2577 server.go:310] "Adding debug handlers to kubelet server" Jun 10 00:35:13.519876 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.518937 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-237.ec2.internal.18b79118d69d2075 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-237.ec2.internal,UID:ip-10-0-131-237.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-237.ec2.internal,},FirstTimestamp:2026-06-10 00:35:13.514184821 +0000 UTC m=+0.338090719,LastTimestamp:2026-06-10 00:35:13.514184821 +0000 UTC m=+0.338090719,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-237.ec2.internal,}" Jun 10 00:35:13.521431 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.521411 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 00:35:13.521777 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.521765 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 00:35:13.521892 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.521868 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-237.ec2.internal\" not found" Jun 10 00:35:13.522031 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.522018 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 00:35:13.522319 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.522304 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 00:35:13.522789 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.522750 2577 factory.go:55] Registering systemd factory Jun 10 00:35:13.522789 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.522767 2577 factory.go:223] Registration of the systemd container factory successfully Jun 10 00:35:13.523241 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.522786 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 00:35:13.523299 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.523246 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 00:35:13.523299 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.523052 2577 factory.go:153] Registering CRI-O factory Jun 10 00:35:13.523364 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.523307 2577 factory.go:223] Registration of the crio container factory successfully Jun 10 00:35:13.523364 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.523352 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 00:35:13.523419 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.523371 2577 factory.go:103] Registering Raw factory Jun 10 00:35:13.523419 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.523382 2577 manager.go:1196] Started watching for new ooms in manager Jun 10 00:35:13.523934 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.523921 2577 manager.go:349] Starting recovery of all containers Jun 10 00:35:13.524347 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.524317 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-237.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 00:35:13.524452 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.524417 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 10 00:35:13.524452 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.524429 2577 reconciler.go:29] "Reconciler: start to sync state" Jun 10 00:35:13.524452 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.524411 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 00:35:13.535171 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.535150 2577 manager.go:354] Recovery completed Jun 10 00:35:13.539288 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.539274 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:13.541620 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.541603 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:13.541694 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.541637 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:13.541694 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.541650 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:13.542213 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.542178 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 00:35:13.542213 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.542213 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 00:35:13.542299 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.542190 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:13.542299 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.542233 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 10 00:35:13.542948 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.542933 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:13.542987 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.542959 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:13.542987 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.542972 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:13.543392 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.543380 2577 policy_none.go:49] "None policy: Start" Jun 10 00:35:13.543429 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.543398 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 00:35:13.543429 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.543409 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 00:35:13.544328 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.544317 2577 policy_none.go:47] "Start" Jun 10 00:35:13.544379 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.544328 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t7j42" Jun 10 00:35:13.552521 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.552441 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-237.ec2.internal.18b79118d83fc29a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-237.ec2.internal,UID:ip-10-0-131-237.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-237.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-237.ec2.internal,},FirstTimestamp:2026-06-10 00:35:13.541620378 +0000 UTC m=+0.365526226,LastTimestamp:2026-06-10 00:35:13.541620378 +0000 UTC m=+0.365526226,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-237.ec2.internal,}" Jun 10 00:35:13.555111 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.555051 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-237.ec2.internal.18b79118d8401ebb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-237.ec2.internal,UID:ip-10-0-131-237.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-237.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-237.ec2.internal,},FirstTimestamp:2026-06-10 00:35:13.541643963 +0000 UTC m=+0.365549812,LastTimestamp:2026-06-10 00:35:13.541643963 +0000 UTC m=+0.365549812,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-237.ec2.internal,}" Jun 10 00:35:13.555543 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.555526 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t7j42" Jun 10 00:35:13.582918 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.582884 2577 manager.go:337] "Starting Device Plugin manager" Jun 10 00:35:13.595875 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.582927 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 00:35:13.595875 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.582940 2577 server.go:87] "Starting device plugin registration server" Jun 10 00:35:13.595875 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.583240 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 00:35:13.595875 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.583255 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 00:35:13.595875 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.583318 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 00:35:13.595875 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.583402 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 00:35:13.595875 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.583411 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 00:35:13.595875 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.584114 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 00:35:13.595875 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.584164 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-237.ec2.internal\" not found" Jun 10 00:35:13.595875 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.591913 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 00:35:13.595875 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.593174 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 00:35:13.595875 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.593225 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 00:35:13.595875 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.593247 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 00:35:13.595875 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.593310 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 00:35:13.595875 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.595362 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:13.683720 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.683688 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:13.684756 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.684736 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:13.684871 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.684772 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:13.684871 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.684786 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:13.684871 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.684816 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-237.ec2.internal" Jun 10 00:35:13.693595 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.693536 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-237.ec2.internal"] Jun 10 00:35:13.693693 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.693608 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:13.694407 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.694393 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-237.ec2.internal" Jun 10 00:35:13.694454 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.694415 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-237.ec2.internal\": node \"ip-10-0-131-237.ec2.internal\" not found" Jun 10 00:35:13.694855 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.694841 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:13.694914 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.694868 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:13.694914 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.694877 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:13.695944 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.695933 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:13.696065 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.696051 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal" Jun 10 00:35:13.696122 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.696087 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:13.696687 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.696667 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:13.696783 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.696695 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:13.696783 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.696709 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:13.696783 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.696714 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:13.696783 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.696732 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:13.696783 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.696741 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:13.697741 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.697728 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-237.ec2.internal" Jun 10 00:35:13.697796 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.697762 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 00:35:13.698479 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.698460 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasSufficientMemory" Jun 10 00:35:13.698584 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.698489 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 00:35:13.698584 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.698501 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeHasSufficientPID" Jun 10 00:35:13.726617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.726585 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea5cb07e64b230b7e9101e78080a625c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal\" (UID: \"ea5cb07e64b230b7e9101e78080a625c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal" Jun 10 00:35:13.726725 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.726628 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a071ffa0cc2d42bd342637b19e0cdf8-config\") pod \"kube-apiserver-proxy-ip-10-0-131-237.ec2.internal\" (UID: \"7a071ffa0cc2d42bd342637b19e0cdf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-237.ec2.internal" Jun 10 00:35:13.726725 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.726653 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea5cb07e64b230b7e9101e78080a625c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal\" (UID: \"ea5cb07e64b230b7e9101e78080a625c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal" Jun 10 00:35:13.727862 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.727844 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-237.ec2.internal\" not found" Jun 10 00:35:13.730005 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.729989 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-237.ec2.internal\" not found" node="ip-10-0-131-237.ec2.internal" Jun 10 00:35:13.734566 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.734551 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-237.ec2.internal\" not found" node="ip-10-0-131-237.ec2.internal" Jun 10 00:35:13.827735 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.827695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea5cb07e64b230b7e9101e78080a625c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal\" (UID: \"ea5cb07e64b230b7e9101e78080a625c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal" Jun 10 00:35:13.827735 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.827739 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea5cb07e64b230b7e9101e78080a625c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal\" (UID: \"ea5cb07e64b230b7e9101e78080a625c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal" Jun 10 00:35:13.827947 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.827762 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a071ffa0cc2d42bd342637b19e0cdf8-config\") pod \"kube-apiserver-proxy-ip-10-0-131-237.ec2.internal\" (UID: \"7a071ffa0cc2d42bd342637b19e0cdf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-237.ec2.internal" Jun 10 00:35:13.827947 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.827794 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea5cb07e64b230b7e9101e78080a625c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal\" (UID: \"ea5cb07e64b230b7e9101e78080a625c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal" Jun 10 00:35:13.827947 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.827824 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a071ffa0cc2d42bd342637b19e0cdf8-config\") pod \"kube-apiserver-proxy-ip-10-0-131-237.ec2.internal\" (UID: \"7a071ffa0cc2d42bd342637b19e0cdf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-237.ec2.internal" Jun 10 00:35:13.827947 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:13.827849 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea5cb07e64b230b7e9101e78080a625c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal\" (UID: \"ea5cb07e64b230b7e9101e78080a625c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal" Jun 10 00:35:13.827947 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.827876 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-237.ec2.internal\" not found" Jun 10 00:35:13.928094 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:13.928062 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-237.ec2.internal\" not found" Jun 10 00:35:14.028892 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:14.028812 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-237.ec2.internal\" not found" Jun 10 00:35:14.033958 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.033939 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal" Jun 10 00:35:14.039590 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.039470 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-237.ec2.internal" Jun 10 00:35:14.129640 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:14.129599 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-237.ec2.internal\" not found" Jun 10 00:35:14.230013 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:14.229973 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-237.ec2.internal\" not found" Jun 10 00:35:14.330496 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:14.330385 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-237.ec2.internal\" not found" Jun 10 00:35:14.408292 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.408260 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:14.422620 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.422593 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal" Jun 10 00:35:14.436094 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.436069 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 00:35:14.438024 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.438001 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-237.ec2.internal" Jun 10 00:35:14.446839 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.446816 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 00:35:14.464993 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.464967 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 00:35:14.465129 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.465112 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 00:35:14.465173 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.465112 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 00:35:14.503218 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:14.503177 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5cb07e64b230b7e9101e78080a625c.slice/crio-486eb566c56ea465eda65206b899158fe6490e88b7ed7d1864335819af21f471 WatchSource:0}: Error finding container 486eb566c56ea465eda65206b899158fe6490e88b7ed7d1864335819af21f471: Status 404 returned error can't find the container with id 486eb566c56ea465eda65206b899158fe6490e88b7ed7d1864335819af21f471 Jun 10 00:35:14.503587 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:14.503556 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a071ffa0cc2d42bd342637b19e0cdf8.slice/crio-f236780c5b6ddec53ae882be1b0b482f63f966e348f157d4ef8f0ea6d09282de WatchSource:0}: Error finding container f236780c5b6ddec53ae882be1b0b482f63f966e348f157d4ef8f0ea6d09282de: Status 404 returned error can't find the container with id f236780c5b6ddec53ae882be1b0b482f63f966e348f157d4ef8f0ea6d09282de Jun 10 00:35:14.505397 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.505375 2577 apiserver.go:52] "Watching apiserver" Jun 10 00:35:14.510170 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.510156 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 00:35:14.522098 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.522075 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 00:35:14.522179 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.522083 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 00:35:14.522471 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.522451 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj","openshift-dns/node-resolver-4s4hx","openshift-multus/multus-69jtz","openshift-multus/multus-additional-cni-plugins-r9vb8","openshift-network-operator/iptables-alerter-gghdv","openshift-ovn-kubernetes/ovnkube-node-wq7wh","kube-system/global-pull-secret-syncer-5mx5g","openshift-cluster-node-tuning-operator/tuned-8gc4p","openshift-image-registry/node-ca-vs4nb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal","openshift-multus/network-metrics-daemon-957rh","openshift-network-diagnostics/network-check-target-dnm9g","kube-system/konnectivity-agent-wxcx7","kube-system/kube-apiserver-proxy-ip-10-0-131-237.ec2.internal"] Jun 10 00:35:14.524757 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.524740 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:14.524840 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:14.524817 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:14.525785 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.525767 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wxcx7" Jun 10 00:35:14.526742 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.526724 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.527960 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.527945 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.528508 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.528491 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l4wzk\"" Jun 10 00:35:14.528634 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.528620 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 00:35:14.529130 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.529106 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gghdv" Jun 10 00:35:14.529312 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.529191 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z7khh\"" Jun 10 00:35:14.529406 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.529329 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 00:35:14.529497 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.529459 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 00:35:14.529613 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.529597 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 00:35:14.529674 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.529645 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 00:35:14.529957 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.529943 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 00:35:14.530105 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.530092 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 00:35:14.530405 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.530391 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.531010 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.530990 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cgwlj\"" Jun 10 00:35:14.531010 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.531003 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 00:35:14.531210 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.531078 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9d2x\" (UniqueName: \"kubernetes.io/projected/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-kube-api-access-c9d2x\") pod \"network-metrics-daemon-957rh\" (UID: \"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2\") " pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:14.531210 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.531117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs\") pod \"network-metrics-daemon-957rh\" (UID: \"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2\") " pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:14.531425 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.531397 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b64m5\"" Jun 10 00:35:14.531563 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.531542 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:35:14.531748 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.531734 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:14.531824 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:14.531802 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:14.532139 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.532122 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 00:35:14.532305 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.532222 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 00:35:14.532565 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.532549 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 00:35:14.532960 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.532933 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 00:35:14.533034 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.533016 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:14.533087 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:14.533067 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:14.533390 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.533366 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 00:35:14.533539 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.533399 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 00:35:14.533539 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.533432 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 00:35:14.533539 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.533432 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 00:35:14.533539 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.533466 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g8468\"" Jun 10 00:35:14.534367 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.534269 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vs4nb" Jun 10 00:35:14.535512 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.535497 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.536917 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.536902 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.539925 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.539906 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 00:35:14.540232 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.540214 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bfh8p\"" Jun 10 00:35:14.540324 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.540287 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 00:35:14.540324 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.540295 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 00:35:14.540578 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.540564 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 00:35:14.540672 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.540653 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 00:35:14.540672 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.540666 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 00:35:14.540776 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.540658 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 00:35:14.540827 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.540788 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4qmb8\"" Jun 10 00:35:14.541297 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.541171 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:35:14.541297 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.541281 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-drtgv\"" Jun 10 00:35:14.541297 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.541287 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4s4hx" Jun 10 00:35:14.544071 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.544054 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 00:35:14.544071 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.544064 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 00:35:14.544249 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.544089 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2jz9r\"" Jun 10 00:35:14.544531 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.544518 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 00:35:14.557537 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.557493 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 00:30:13 +0000 UTC" deadline="2027-11-17 21:09:09.095156013 +0000 UTC" Jun 10 00:35:14.557614 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.557537 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12620h33m54.537622384s" Jun 10 00:35:14.597251 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.597158 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal" event={"ID":"ea5cb07e64b230b7e9101e78080a625c","Type":"ContainerStarted","Data":"486eb566c56ea465eda65206b899158fe6490e88b7ed7d1864335819af21f471"} Jun 10 00:35:14.598115 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.598097 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-237.ec2.internal" event={"ID":"7a071ffa0cc2d42bd342637b19e0cdf8","Type":"ContainerStarted","Data":"f236780c5b6ddec53ae882be1b0b482f63f966e348f157d4ef8f0ea6d09282de"} Jun 10 00:35:14.623324 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.623300 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lw6hw" Jun 10 00:35:14.623407 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.623337 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 00:35:14.631787 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.631768 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-slash\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.631881 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.631803 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.631881 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.631828 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9f4j\" (UniqueName: \"kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j\") pod \"network-check-target-dnm9g\" (UID: \"889f95d7-8f05-4b78-968a-a5fc872ad302\") " pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:14.631881 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.631853 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed5d0b4d-14e2-4195-80bd-b21fa955dc69-host\") pod \"node-ca-vs4nb\" (UID: \"ed5d0b4d-14e2-4195-80bd-b21fa955dc69\") " pod="openshift-image-registry/node-ca-vs4nb" Jun 10 00:35:14.631881 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.631876 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-tmp\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.632091 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.631896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/900bf028-67cb-4c4a-92e6-40a73c642ec3-os-release\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.632091 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.631937 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-multus-cni-dir\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.632091 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.631967 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-multus-conf-dir\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.632091 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.631982 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-run-systemd\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.632091 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.631998 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-run-openvswitch\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.632091 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632018 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed5d0b4d-14e2-4195-80bd-b21fa955dc69-serviceca\") pod \"node-ca-vs4nb\" (UID: \"ed5d0b4d-14e2-4195-80bd-b21fa955dc69\") " pod="openshift-image-registry/node-ca-vs4nb" Jun 10 00:35:14.632091 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632035 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/900bf028-67cb-4c4a-92e6-40a73c642ec3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.632091 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632052 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/812904bb-3cde-4d32-bca3-1f3c6efbf99d-env-overrides\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.632091 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632070 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-multus-socket-dir-parent\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.632436 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632105 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.632436 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632148 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-run-netns\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.632436 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632161 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lw6hw" Jun 10 00:35:14.632436 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632173 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-sysconfig\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.632436 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632225 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-sysctl-conf\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.632436 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632259 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/900bf028-67cb-4c4a-92e6-40a73c642ec3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.632436 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632290 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/812904bb-3cde-4d32-bca3-1f3c6efbf99d-ovn-node-metrics-cert\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.632436 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632312 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-socket-dir\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.632436 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632326 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-os-release\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.632436 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-etc-kubernetes\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.632436 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632353 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/812904bb-3cde-4d32-bca3-1f3c6efbf99d-ovnkube-script-lib\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.632436 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632369 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-run\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.632436 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632386 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2k42\" (UniqueName: \"kubernetes.io/projected/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-kube-api-access-v2k42\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.632436 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632403 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9tmt\" (UniqueName: \"kubernetes.io/projected/900bf028-67cb-4c4a-92e6-40a73c642ec3-kube-api-access-j9tmt\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.632995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632456 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-run-ovn-kubernetes\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.632995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632489 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/812904bb-3cde-4d32-bca3-1f3c6efbf99d-ovnkube-config\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.632995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9d2x\" (UniqueName: \"kubernetes.io/projected/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-kube-api-access-c9d2x\") pod \"network-metrics-daemon-957rh\" (UID: \"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2\") " pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:14.632995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632573 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-hostroot\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.632995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-etc-openvswitch\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.632995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632679 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-node-log\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.632995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632703 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-log-socket\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.632995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632728 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs\") pod \"network-metrics-daemon-957rh\" (UID: \"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2\") " pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:14.632995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632756 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1380799b-1285-43c3-8c5d-d7f2b94278b8-kubelet-config\") pod \"global-pull-secret-syncer-5mx5g\" (UID: \"1380799b-1285-43c3-8c5d-d7f2b94278b8\") " pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:14.632995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632780 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-device-dir\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.632995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632804 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89d37dfe-78b5-4500-acd0-6cca4e681d0e-hosts-file\") pod \"node-resolver-4s4hx\" (UID: \"89d37dfe-78b5-4500-acd0-6cca4e681d0e\") " pod="openshift-dns/node-resolver-4s4hx" Jun 10 00:35:14.632995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632828 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-var-lib-kubelet\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.632995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632851 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-systemd-units\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.632995 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:14.632855 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:14.632995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-var-lib-openvswitch\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.632995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-cni-netd\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.633617 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:14.632919 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs podName:ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:15.132901851 +0000 UTC m=+1.956807687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs") pod "network-metrics-daemon-957rh" (UID: "ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:14.633617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh8fm\" (UniqueName: \"kubernetes.io/projected/89d37dfe-78b5-4500-acd0-6cca4e681d0e-kube-api-access-dh8fm\") pod \"node-resolver-4s4hx\" (UID: \"89d37dfe-78b5-4500-acd0-6cca4e681d0e\") " pod="openshift-dns/node-resolver-4s4hx" Jun 10 00:35:14.633617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.632989 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f45e7ea-500d-43be-bf54-c8e375d90bdd-cni-binary-copy\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.633617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633011 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cvrf\" (UniqueName: \"kubernetes.io/projected/812904bb-3cde-4d32-bca3-1f3c6efbf99d-kube-api-access-8cvrf\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.633617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633030 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-modprobe-d\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.633617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bde5b60b-554b-4465-952a-663fd38656bb-konnectivity-ca\") pod \"konnectivity-agent-wxcx7\" (UID: \"bde5b60b-554b-4465-952a-663fd38656bb\") " pod="kube-system/konnectivity-agent-wxcx7" Jun 10 00:35:14.633617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633059 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/900bf028-67cb-4c4a-92e6-40a73c642ec3-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.633617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-sys-fs\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.633617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-var-lib-cni-multus\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.633617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f45e7ea-500d-43be-bf54-c8e375d90bdd-multus-daemon-config\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.633617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633130 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gt5v\" (UniqueName: \"kubernetes.io/projected/6f45e7ea-500d-43be-bf54-c8e375d90bdd-kube-api-access-9gt5v\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.633617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633146 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-sys\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.633617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633171 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-var-lib-kubelet\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.633617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633185 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-host\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.633617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633219 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1380799b-1285-43c3-8c5d-d7f2b94278b8-dbus\") pod \"global-pull-secret-syncer-5mx5g\" (UID: \"1380799b-1285-43c3-8c5d-d7f2b94278b8\") " pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:14.633617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633245 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64t8c\" (UniqueName: \"kubernetes.io/projected/4b988e04-4ce9-4739-abac-563b4dcf0f04-kube-api-access-64t8c\") pod \"iptables-alerter-gghdv\" (UID: \"4b988e04-4ce9-4739-abac-563b4dcf0f04\") " pod="openshift-network-operator/iptables-alerter-gghdv" Jun 10 00:35:14.634230 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633262 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7ht2\" (UniqueName: \"kubernetes.io/projected/ed5d0b4d-14e2-4195-80bd-b21fa955dc69-kube-api-access-t7ht2\") pod \"node-ca-vs4nb\" (UID: \"ed5d0b4d-14e2-4195-80bd-b21fa955dc69\") " pod="openshift-image-registry/node-ca-vs4nb" Jun 10 00:35:14.634230 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-tuned\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.634230 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/900bf028-67cb-4c4a-92e6-40a73c642ec3-cnibin\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.634230 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633346 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret\") pod \"global-pull-secret-syncer-5mx5g\" (UID: \"1380799b-1285-43c3-8c5d-d7f2b94278b8\") " pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:14.634230 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633372 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.634230 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633394 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-run-k8s-cni-cncf-io\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.634230 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-kubernetes\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.634230 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633535 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bde5b60b-554b-4465-952a-663fd38656bb-agent-certs\") pod \"konnectivity-agent-wxcx7\" (UID: \"bde5b60b-554b-4465-952a-663fd38656bb\") " pod="kube-system/konnectivity-agent-wxcx7" Jun 10 00:35:14.634230 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633550 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-system-cni-dir\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.634230 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-run-multus-certs\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.634230 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-cni-bin\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.634230 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633636 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/900bf028-67cb-4c4a-92e6-40a73c642ec3-system-cni-dir\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.634230 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-registration-dir\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.634230 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633730 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89d37dfe-78b5-4500-acd0-6cca4e681d0e-tmp-dir\") pod \"node-resolver-4s4hx\" (UID: \"89d37dfe-78b5-4500-acd0-6cca4e681d0e\") " pod="openshift-dns/node-resolver-4s4hx" Jun 10 00:35:14.634230 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633760 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-cnibin\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.634230 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633788 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b988e04-4ce9-4739-abac-563b4dcf0f04-host-slash\") pod \"iptables-alerter-gghdv\" (UID: \"4b988e04-4ce9-4739-abac-563b4dcf0f04\") " pod="openshift-network-operator/iptables-alerter-gghdv" Jun 10 00:35:14.634698 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633811 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-run-netns\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.634698 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633833 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b988e04-4ce9-4739-abac-563b4dcf0f04-iptables-alerter-script\") pod \"iptables-alerter-gghdv\" (UID: \"4b988e04-4ce9-4739-abac-563b4dcf0f04\") " pod="openshift-network-operator/iptables-alerter-gghdv" Jun 10 00:35:14.634698 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633863 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-kubelet\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.634698 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-systemd\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.634698 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/900bf028-67cb-4c4a-92e6-40a73c642ec3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.634698 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.633939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjkbj\" (UniqueName: \"kubernetes.io/projected/d081cb3a-6523-414a-a978-78aae151c057-kube-api-access-gjkbj\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.634698 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.634006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-var-lib-cni-bin\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.634698 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.634025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-run-ovn\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.634698 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.634038 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-sysctl-d\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.634698 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.634051 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-lib-modules\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.638991 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.638972 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 00:35:14.641831 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.641808 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9d2x\" (UniqueName: \"kubernetes.io/projected/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-kube-api-access-c9d2x\") pod \"network-metrics-daemon-957rh\" (UID: \"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2\") " pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:14.734673 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734637 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.734673 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-run-netns\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.734892 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-sysconfig\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.734892 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-sysctl-conf\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.734892 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/900bf028-67cb-4c4a-92e6-40a73c642ec3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.734892 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/812904bb-3cde-4d32-bca3-1f3c6efbf99d-ovn-node-metrics-cert\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.734892 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734732 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-run-netns\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.734892 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734737 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.734892 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734745 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-socket-dir\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.734892 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734796 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-sysconfig\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.734892 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-os-release\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.734892 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734864 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-etc-kubernetes\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.734892 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734888 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/812904bb-3cde-4d32-bca3-1f3c6efbf99d-ovnkube-script-lib\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-run\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734930 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-socket-dir\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2k42\" (UniqueName: \"kubernetes.io/projected/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-kube-api-access-v2k42\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734967 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9tmt\" (UniqueName: \"kubernetes.io/projected/900bf028-67cb-4c4a-92e6-40a73c642ec3-kube-api-access-j9tmt\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734992 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-run-ovn-kubernetes\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734998 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/900bf028-67cb-4c4a-92e6-40a73c642ec3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/812904bb-3cde-4d32-bca3-1f3c6efbf99d-ovnkube-config\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.734999 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-sysctl-conf\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735065 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-etc-kubernetes\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735170 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-hostroot\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735250 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-hostroot\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735267 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-run\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-etc-openvswitch\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735312 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-run-ovn-kubernetes\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-node-log\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-log-socket\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735357 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-etc-openvswitch\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.735426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735370 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-os-release\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1380799b-1285-43c3-8c5d-d7f2b94278b8-kubelet-config\") pod \"global-pull-secret-syncer-5mx5g\" (UID: \"1380799b-1285-43c3-8c5d-d7f2b94278b8\") " pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735401 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-device-dir\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735404 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-node-log\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735411 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-log-socket\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735424 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89d37dfe-78b5-4500-acd0-6cca4e681d0e-hosts-file\") pod \"node-resolver-4s4hx\" (UID: \"89d37dfe-78b5-4500-acd0-6cca4e681d0e\") " pod="openshift-dns/node-resolver-4s4hx" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735449 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-var-lib-kubelet\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735464 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1380799b-1285-43c3-8c5d-d7f2b94278b8-kubelet-config\") pod \"global-pull-secret-syncer-5mx5g\" (UID: \"1380799b-1285-43c3-8c5d-d7f2b94278b8\") " pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735472 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-systemd-units\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735504 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89d37dfe-78b5-4500-acd0-6cca4e681d0e-hosts-file\") pod \"node-resolver-4s4hx\" (UID: \"89d37dfe-78b5-4500-acd0-6cca4e681d0e\") " pod="openshift-dns/node-resolver-4s4hx" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735507 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-systemd-units\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735505 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-var-lib-openvswitch\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735467 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-device-dir\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735539 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-var-lib-openvswitch\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735537 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-cni-netd\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735573 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh8fm\" (UniqueName: \"kubernetes.io/projected/89d37dfe-78b5-4500-acd0-6cca4e681d0e-kube-api-access-dh8fm\") pod \"node-resolver-4s4hx\" (UID: \"89d37dfe-78b5-4500-acd0-6cca4e681d0e\") " pod="openshift-dns/node-resolver-4s4hx" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735550 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-var-lib-kubelet\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735577 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-cni-netd\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.736276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735596 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f45e7ea-500d-43be-bf54-c8e375d90bdd-cni-binary-copy\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.737106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735623 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cvrf\" (UniqueName: \"kubernetes.io/projected/812904bb-3cde-4d32-bca3-1f3c6efbf99d-kube-api-access-8cvrf\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.737106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735645 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-modprobe-d\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.737106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bde5b60b-554b-4465-952a-663fd38656bb-konnectivity-ca\") pod \"konnectivity-agent-wxcx7\" (UID: \"bde5b60b-554b-4465-952a-663fd38656bb\") " pod="kube-system/konnectivity-agent-wxcx7" Jun 10 00:35:14.737106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735693 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/900bf028-67cb-4c4a-92e6-40a73c642ec3-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.737106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-sys-fs\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.737106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735739 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-var-lib-cni-multus\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.737106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735768 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f45e7ea-500d-43be-bf54-c8e375d90bdd-multus-daemon-config\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.737106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gt5v\" (UniqueName: \"kubernetes.io/projected/6f45e7ea-500d-43be-bf54-c8e375d90bdd-kube-api-access-9gt5v\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.737106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735819 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-sys\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.737106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735846 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-var-lib-kubelet\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.737106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735848 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-sys-fs\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.737106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735846 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-var-lib-cni-multus\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.737106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735870 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-host\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.737106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735906 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1380799b-1285-43c3-8c5d-d7f2b94278b8-dbus\") pod \"global-pull-secret-syncer-5mx5g\" (UID: \"1380799b-1285-43c3-8c5d-d7f2b94278b8\") " pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:14.737106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735918 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-host\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.737106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735934 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64t8c\" (UniqueName: \"kubernetes.io/projected/4b988e04-4ce9-4739-abac-563b4dcf0f04-kube-api-access-64t8c\") pod \"iptables-alerter-gghdv\" (UID: \"4b988e04-4ce9-4739-abac-563b4dcf0f04\") " pod="openshift-network-operator/iptables-alerter-gghdv" Jun 10 00:35:14.737106 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735957 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/812904bb-3cde-4d32-bca3-1f3c6efbf99d-ovnkube-script-lib\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.737992 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735972 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-sys\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.737992 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736023 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-var-lib-kubelet\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.737992 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.735963 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7ht2\" (UniqueName: \"kubernetes.io/projected/ed5d0b4d-14e2-4195-80bd-b21fa955dc69-kube-api-access-t7ht2\") pod \"node-ca-vs4nb\" (UID: \"ed5d0b4d-14e2-4195-80bd-b21fa955dc69\") " pod="openshift-image-registry/node-ca-vs4nb" Jun 10 00:35:14.737992 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736069 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-tuned\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.737992 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736095 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/900bf028-67cb-4c4a-92e6-40a73c642ec3-cnibin\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.737992 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret\") pod \"global-pull-secret-syncer-5mx5g\" (UID: \"1380799b-1285-43c3-8c5d-d7f2b94278b8\") " pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:14.737992 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.737992 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-run-k8s-cni-cncf-io\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.737992 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736219 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-kubernetes\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.737992 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736220 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1380799b-1285-43c3-8c5d-d7f2b94278b8-dbus\") pod \"global-pull-secret-syncer-5mx5g\" (UID: \"1380799b-1285-43c3-8c5d-d7f2b94278b8\") " pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:14.737992 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736282 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-kubernetes\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.737992 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736331 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f45e7ea-500d-43be-bf54-c8e375d90bdd-cni-binary-copy\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.737992 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:14.736337 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:14.737992 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:14.736392 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret podName:1380799b-1285-43c3-8c5d-d7f2b94278b8 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:15.236372223 +0000 UTC m=+2.060278068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret") pod "global-pull-secret-syncer-5mx5g" (UID: "1380799b-1285-43c3-8c5d-d7f2b94278b8") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:14.737992 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736437 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f45e7ea-500d-43be-bf54-c8e375d90bdd-multus-daemon-config\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.737992 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736444 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-modprobe-d\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.737992 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736489 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/900bf028-67cb-4c4a-92e6-40a73c642ec3-cnibin\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.738870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736506 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.738870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736539 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-run-k8s-cni-cncf-io\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.738870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736637 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bde5b60b-554b-4465-952a-663fd38656bb-agent-certs\") pod \"konnectivity-agent-wxcx7\" (UID: \"bde5b60b-554b-4465-952a-663fd38656bb\") " pod="kube-system/konnectivity-agent-wxcx7" Jun 10 00:35:14.738870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736668 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-system-cni-dir\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.738870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736692 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-run-multus-certs\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.738870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-cni-bin\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.738870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736741 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/900bf028-67cb-4c4a-92e6-40a73c642ec3-system-cni-dir\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.738870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736763 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-registration-dir\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.738870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736768 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/812904bb-3cde-4d32-bca3-1f3c6efbf99d-ovnkube-config\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.738870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736783 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/900bf028-67cb-4c4a-92e6-40a73c642ec3-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.738870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89d37dfe-78b5-4500-acd0-6cca4e681d0e-tmp-dir\") pod \"node-resolver-4s4hx\" (UID: \"89d37dfe-78b5-4500-acd0-6cca4e681d0e\") " pod="openshift-dns/node-resolver-4s4hx" Jun 10 00:35:14.738870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736808 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bde5b60b-554b-4465-952a-663fd38656bb-konnectivity-ca\") pod \"konnectivity-agent-wxcx7\" (UID: \"bde5b60b-554b-4465-952a-663fd38656bb\") " pod="kube-system/konnectivity-agent-wxcx7" Jun 10 00:35:14.738870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736830 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-cni-bin\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.738870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-cnibin\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.738870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736845 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d081cb3a-6523-414a-a978-78aae151c057-registration-dir\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.738870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736854 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-system-cni-dir\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.738870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736861 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b988e04-4ce9-4739-abac-563b4dcf0f04-host-slash\") pod \"iptables-alerter-gghdv\" (UID: \"4b988e04-4ce9-4739-abac-563b4dcf0f04\") " pod="openshift-network-operator/iptables-alerter-gghdv" Jun 10 00:35:14.739490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736872 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/900bf028-67cb-4c4a-92e6-40a73c642ec3-system-cni-dir\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.739490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736879 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-run-multus-certs\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.739490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736886 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-run-netns\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.739490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b988e04-4ce9-4739-abac-563b4dcf0f04-iptables-alerter-script\") pod \"iptables-alerter-gghdv\" (UID: \"4b988e04-4ce9-4739-abac-563b4dcf0f04\") " pod="openshift-network-operator/iptables-alerter-gghdv" Jun 10 00:35:14.739490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736925 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-kubelet\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.739490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736951 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-run-netns\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.739490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736970 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-kubelet\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.739490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736970 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-cnibin\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.739490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-systemd\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.739490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.736989 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b988e04-4ce9-4739-abac-563b4dcf0f04-host-slash\") pod \"iptables-alerter-gghdv\" (UID: \"4b988e04-4ce9-4739-abac-563b4dcf0f04\") " pod="openshift-network-operator/iptables-alerter-gghdv" Jun 10 00:35:14.739490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/900bf028-67cb-4c4a-92e6-40a73c642ec3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.739490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737046 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-systemd\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.739490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737083 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjkbj\" (UniqueName: \"kubernetes.io/projected/d081cb3a-6523-414a-a978-78aae151c057-kube-api-access-gjkbj\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.739490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737139 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-var-lib-cni-bin\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.739490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737145 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89d37dfe-78b5-4500-acd0-6cca4e681d0e-tmp-dir\") pod \"node-resolver-4s4hx\" (UID: \"89d37dfe-78b5-4500-acd0-6cca4e681d0e\") " pod="openshift-dns/node-resolver-4s4hx" Jun 10 00:35:14.739490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-run-ovn\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.739490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-sysctl-d\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-lib-modules\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737252 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-run-ovn\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737285 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-slash\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737287 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-host-var-lib-cni-bin\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737476 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b988e04-4ce9-4739-abac-563b4dcf0f04-iptables-alerter-script\") pod \"iptables-alerter-gghdv\" (UID: \"4b988e04-4ce9-4739-abac-563b4dcf0f04\") " pod="openshift-network-operator/iptables-alerter-gghdv" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737492 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9f4j\" (UniqueName: \"kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j\") pod \"network-check-target-dnm9g\" (UID: \"889f95d7-8f05-4b78-968a-a5fc872ad302\") " pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed5d0b4d-14e2-4195-80bd-b21fa955dc69-host\") pod \"node-ca-vs4nb\" (UID: \"ed5d0b4d-14e2-4195-80bd-b21fa955dc69\") " pod="openshift-image-registry/node-ca-vs4nb" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737569 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/900bf028-67cb-4c4a-92e6-40a73c642ec3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737582 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-lib-modules\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737594 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-tmp\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737622 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/900bf028-67cb-4c4a-92e6-40a73c642ec3-os-release\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737637 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-slash\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737647 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-multus-cni-dir\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737666 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-sysctl-d\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737703 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed5d0b4d-14e2-4195-80bd-b21fa955dc69-host\") pod \"node-ca-vs4nb\" (UID: \"ed5d0b4d-14e2-4195-80bd-b21fa955dc69\") " pod="openshift-image-registry/node-ca-vs4nb" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-multus-conf-dir\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.739963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737760 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-run-systemd\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.740494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737780 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/812904bb-3cde-4d32-bca3-1f3c6efbf99d-ovn-node-metrics-cert\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.740494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737785 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-run-openvswitch\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.740494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737832 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-run-systemd\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.740494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737875 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-multus-cni-dir\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.740494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737886 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/900bf028-67cb-4c4a-92e6-40a73c642ec3-os-release\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.740494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737910 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.740494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737918 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/812904bb-3cde-4d32-bca3-1f3c6efbf99d-run-openvswitch\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.740494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737924 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-multus-conf-dir\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.740494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed5d0b4d-14e2-4195-80bd-b21fa955dc69-serviceca\") pod \"node-ca-vs4nb\" (UID: \"ed5d0b4d-14e2-4195-80bd-b21fa955dc69\") " pod="openshift-image-registry/node-ca-vs4nb" Jun 10 00:35:14.740494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.737971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/900bf028-67cb-4c4a-92e6-40a73c642ec3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.740494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.738070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/812904bb-3cde-4d32-bca3-1f3c6efbf99d-env-overrides\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.740494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.738394 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed5d0b4d-14e2-4195-80bd-b21fa955dc69-serviceca\") pod \"node-ca-vs4nb\" (UID: \"ed5d0b4d-14e2-4195-80bd-b21fa955dc69\") " pod="openshift-image-registry/node-ca-vs4nb" Jun 10 00:35:14.740494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.738502 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/900bf028-67cb-4c4a-92e6-40a73c642ec3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.740494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.738546 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-multus-socket-dir-parent\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.740494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.738601 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f45e7ea-500d-43be-bf54-c8e375d90bdd-multus-socket-dir-parent\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.740494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.738730 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-etc-tuned\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.740494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.738848 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/812904bb-3cde-4d32-bca3-1f3c6efbf99d-env-overrides\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.741014 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.739409 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bde5b60b-554b-4465-952a-663fd38656bb-agent-certs\") pod \"konnectivity-agent-wxcx7\" (UID: \"bde5b60b-554b-4465-952a-663fd38656bb\") " pod="kube-system/konnectivity-agent-wxcx7" Jun 10 00:35:14.741014 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.739937 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-tmp\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.743089 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.743064 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2k42\" (UniqueName: \"kubernetes.io/projected/0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d-kube-api-access-v2k42\") pod \"tuned-8gc4p\" (UID: \"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d\") " pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.743193 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:14.743128 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:14.743193 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:14.743146 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:14.743193 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:14.743169 2577 projected.go:196] Error preparing data for projected volume kube-api-access-j9f4j for pod openshift-network-diagnostics/network-check-target-dnm9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:14.743400 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:14.743281 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j podName:889f95d7-8f05-4b78-968a-a5fc872ad302 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:15.243264022 +0000 UTC m=+2.067169875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j9f4j" (UniqueName: "kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j") pod "network-check-target-dnm9g" (UID: "889f95d7-8f05-4b78-968a-a5fc872ad302") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:14.743400 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.743346 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh8fm\" (UniqueName: \"kubernetes.io/projected/89d37dfe-78b5-4500-acd0-6cca4e681d0e-kube-api-access-dh8fm\") pod \"node-resolver-4s4hx\" (UID: \"89d37dfe-78b5-4500-acd0-6cca4e681d0e\") " pod="openshift-dns/node-resolver-4s4hx" Jun 10 00:35:14.743730 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.743712 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9tmt\" (UniqueName: \"kubernetes.io/projected/900bf028-67cb-4c4a-92e6-40a73c642ec3-kube-api-access-j9tmt\") pod \"multus-additional-cni-plugins-r9vb8\" (UID: \"900bf028-67cb-4c4a-92e6-40a73c642ec3\") " pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.745080 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.745051 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64t8c\" (UniqueName: \"kubernetes.io/projected/4b988e04-4ce9-4739-abac-563b4dcf0f04-kube-api-access-64t8c\") pod \"iptables-alerter-gghdv\" (UID: \"4b988e04-4ce9-4739-abac-563b4dcf0f04\") " pod="openshift-network-operator/iptables-alerter-gghdv" Jun 10 00:35:14.745494 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.745470 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cvrf\" (UniqueName: \"kubernetes.io/projected/812904bb-3cde-4d32-bca3-1f3c6efbf99d-kube-api-access-8cvrf\") pod \"ovnkube-node-wq7wh\" (UID: \"812904bb-3cde-4d32-bca3-1f3c6efbf99d\") " pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.745621 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.745604 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gt5v\" (UniqueName: \"kubernetes.io/projected/6f45e7ea-500d-43be-bf54-c8e375d90bdd-kube-api-access-9gt5v\") pod \"multus-69jtz\" (UID: \"6f45e7ea-500d-43be-bf54-c8e375d90bdd\") " pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.745984 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.745965 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7ht2\" (UniqueName: \"kubernetes.io/projected/ed5d0b4d-14e2-4195-80bd-b21fa955dc69-kube-api-access-t7ht2\") pod \"node-ca-vs4nb\" (UID: \"ed5d0b4d-14e2-4195-80bd-b21fa955dc69\") " pod="openshift-image-registry/node-ca-vs4nb" Jun 10 00:35:14.746788 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.746768 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjkbj\" (UniqueName: \"kubernetes.io/projected/d081cb3a-6523-414a-a978-78aae151c057-kube-api-access-gjkbj\") pod \"aws-ebs-csi-driver-node-9rwwj\" (UID: \"d081cb3a-6523-414a-a978-78aae151c057\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.837090 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.837054 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wxcx7" Jun 10 00:35:14.843932 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.843904 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-69jtz" Jun 10 00:35:14.845568 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:14.845486 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde5b60b_554b_4465_952a_663fd38656bb.slice/crio-40308fcd6a7eab13d90cf0d86f713d0faf88c36d169c4bde677279d80db9f2d9 WatchSource:0}: Error finding container 40308fcd6a7eab13d90cf0d86f713d0faf88c36d169c4bde677279d80db9f2d9: Status 404 returned error can't find the container with id 40308fcd6a7eab13d90cf0d86f713d0faf88c36d169c4bde677279d80db9f2d9 Jun 10 00:35:14.847482 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.847438 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:14.850618 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.850595 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r9vb8" Jun 10 00:35:14.851353 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:14.851335 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f45e7ea_500d_43be_bf54_c8e375d90bdd.slice/crio-8325ae745793f3df13a4537a831b87eec626e7f18190c5356491a3d21305d584 WatchSource:0}: Error finding container 8325ae745793f3df13a4537a831b87eec626e7f18190c5356491a3d21305d584: Status 404 returned error can't find the container with id 8325ae745793f3df13a4537a831b87eec626e7f18190c5356491a3d21305d584 Jun 10 00:35:14.855863 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.855846 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gghdv" Jun 10 00:35:14.858185 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:14.858160 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod900bf028_67cb_4c4a_92e6_40a73c642ec3.slice/crio-4c8da8ff4288f87e6ec8456cfb568b37175cd2c3871d74a13336d9baf1d480bd WatchSource:0}: Error finding container 4c8da8ff4288f87e6ec8456cfb568b37175cd2c3871d74a13336d9baf1d480bd: Status 404 returned error can't find the container with id 4c8da8ff4288f87e6ec8456cfb568b37175cd2c3871d74a13336d9baf1d480bd Jun 10 00:35:14.860363 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.860344 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:14.863654 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:14.863625 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b988e04_4ce9_4739_abac_563b4dcf0f04.slice/crio-85a46abeb9fcb6539c147092f4a208b99e96534d8f30fcf38bc6660fd95a43c7 WatchSource:0}: Error finding container 85a46abeb9fcb6539c147092f4a208b99e96534d8f30fcf38bc6660fd95a43c7: Status 404 returned error can't find the container with id 85a46abeb9fcb6539c147092f4a208b99e96534d8f30fcf38bc6660fd95a43c7 Jun 10 00:35:14.865919 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.865900 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vs4nb" Jun 10 00:35:14.869460 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:14.869437 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod812904bb_3cde_4d32_bca3_1f3c6efbf99d.slice/crio-d41ade352275954ee363775f28cd36d3177dae1b18884823b1182eb17c2cf691 WatchSource:0}: Error finding container d41ade352275954ee363775f28cd36d3177dae1b18884823b1182eb17c2cf691: Status 404 returned error can't find the container with id d41ade352275954ee363775f28cd36d3177dae1b18884823b1182eb17c2cf691 Jun 10 00:35:14.870654 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.870582 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" Jun 10 00:35:14.875859 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.875838 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" Jun 10 00:35:14.875955 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:14.875886 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded5d0b4d_14e2_4195_80bd_b21fa955dc69.slice/crio-4ae865a2265e674b6ccd8d4357010f1c9c006fc8035a4794bafefd8767600dd1 WatchSource:0}: Error finding container 4ae865a2265e674b6ccd8d4357010f1c9c006fc8035a4794bafefd8767600dd1: Status 404 returned error can't find the container with id 4ae865a2265e674b6ccd8d4357010f1c9c006fc8035a4794bafefd8767600dd1 Jun 10 00:35:14.878507 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:14.878491 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dc81fb8_27a2_47cc_abd9_5b1841f5ca0d.slice/crio-43704aebf80655e97d1fa0d9f0e3d6deec4a18d749b6356d29bfde3656329585 WatchSource:0}: Error finding container 43704aebf80655e97d1fa0d9f0e3d6deec4a18d749b6356d29bfde3656329585: Status 404 returned error can't find the container with id 43704aebf80655e97d1fa0d9f0e3d6deec4a18d749b6356d29bfde3656329585 Jun 10 00:35:14.880012 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:14.879907 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4s4hx" Jun 10 00:35:14.883951 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:14.883927 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd081cb3a_6523_414a_a978_78aae151c057.slice/crio-357b5becdea7dda43fd8b2c55f77e81e31e662cc093bc582368340b0d081f6ff WatchSource:0}: Error finding container 357b5becdea7dda43fd8b2c55f77e81e31e662cc093bc582368340b0d081f6ff: Status 404 returned error can't find the container with id 357b5becdea7dda43fd8b2c55f77e81e31e662cc093bc582368340b0d081f6ff Jun 10 00:35:14.888165 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:14.888143 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d37dfe_78b5_4500_acd0_6cca4e681d0e.slice/crio-8ea1a29e577183913512e09b881ac4c8ca44391229fb5fce5948d0c00426186c WatchSource:0}: Error finding container 8ea1a29e577183913512e09b881ac4c8ca44391229fb5fce5948d0c00426186c: Status 404 returned error can't find the container with id 8ea1a29e577183913512e09b881ac4c8ca44391229fb5fce5948d0c00426186c Jun 10 00:35:15.064350 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:15.064320 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:15.140328 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:15.140249 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs\") pod \"network-metrics-daemon-957rh\" (UID: \"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2\") " pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:15.140492 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:15.140382 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:15.140492 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:15.140460 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs podName:ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:16.140439829 +0000 UTC m=+2.964345668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs") pod "network-metrics-daemon-957rh" (UID: "ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:15.241329 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:15.241290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret\") pod \"global-pull-secret-syncer-5mx5g\" (UID: \"1380799b-1285-43c3-8c5d-d7f2b94278b8\") " pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:15.241502 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:15.241443 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:15.241576 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:15.241522 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret podName:1380799b-1285-43c3-8c5d-d7f2b94278b8 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:16.241501114 +0000 UTC m=+3.065406969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret") pod "global-pull-secret-syncer-5mx5g" (UID: "1380799b-1285-43c3-8c5d-d7f2b94278b8") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:15.343270 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:15.342504 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9f4j\" (UniqueName: \"kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j\") pod \"network-check-target-dnm9g\" (UID: \"889f95d7-8f05-4b78-968a-a5fc872ad302\") " pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:15.343270 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:15.342791 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:15.343270 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:15.342817 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:15.343270 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:15.342830 2577 projected.go:196] Error preparing data for projected volume kube-api-access-j9f4j for pod openshift-network-diagnostics/network-check-target-dnm9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:15.343270 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:15.342890 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j podName:889f95d7-8f05-4b78-968a-a5fc872ad302 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:16.342870449 +0000 UTC m=+3.166776291 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9f4j" (UniqueName: "kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j") pod "network-check-target-dnm9g" (UID: "889f95d7-8f05-4b78-968a-a5fc872ad302") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:15.562802 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:15.562720 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:15.628272 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:15.628232 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" event={"ID":"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d","Type":"ContainerStarted","Data":"43704aebf80655e97d1fa0d9f0e3d6deec4a18d749b6356d29bfde3656329585"} Jun 10 00:35:15.634794 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:15.634734 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:30:14 +0000 UTC" deadline="2028-01-02 04:49:23.489634403 +0000 UTC" Jun 10 00:35:15.634794 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:15.634792 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13708h14m7.854846465s" Jun 10 00:35:15.640019 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:15.639947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vs4nb" event={"ID":"ed5d0b4d-14e2-4195-80bd-b21fa955dc69","Type":"ContainerStarted","Data":"4ae865a2265e674b6ccd8d4357010f1c9c006fc8035a4794bafefd8767600dd1"} Jun 10 00:35:15.655366 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:15.655292 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gghdv" event={"ID":"4b988e04-4ce9-4739-abac-563b4dcf0f04","Type":"ContainerStarted","Data":"85a46abeb9fcb6539c147092f4a208b99e96534d8f30fcf38bc6660fd95a43c7"} Jun 10 00:35:15.667226 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:15.667169 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9vb8" event={"ID":"900bf028-67cb-4c4a-92e6-40a73c642ec3","Type":"ContainerStarted","Data":"4c8da8ff4288f87e6ec8456cfb568b37175cd2c3871d74a13336d9baf1d480bd"} Jun 10 00:35:15.683287 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:15.683187 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4s4hx" event={"ID":"89d37dfe-78b5-4500-acd0-6cca4e681d0e","Type":"ContainerStarted","Data":"8ea1a29e577183913512e09b881ac4c8ca44391229fb5fce5948d0c00426186c"} Jun 10 00:35:15.703953 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:15.703914 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" event={"ID":"d081cb3a-6523-414a-a978-78aae151c057","Type":"ContainerStarted","Data":"357b5becdea7dda43fd8b2c55f77e81e31e662cc093bc582368340b0d081f6ff"} Jun 10 00:35:15.712511 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:15.712475 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" event={"ID":"812904bb-3cde-4d32-bca3-1f3c6efbf99d","Type":"ContainerStarted","Data":"d41ade352275954ee363775f28cd36d3177dae1b18884823b1182eb17c2cf691"} Jun 10 00:35:15.723777 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:15.723725 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-69jtz" event={"ID":"6f45e7ea-500d-43be-bf54-c8e375d90bdd","Type":"ContainerStarted","Data":"8325ae745793f3df13a4537a831b87eec626e7f18190c5356491a3d21305d584"} Jun 10 00:35:15.727851 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:15.727820 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wxcx7" event={"ID":"bde5b60b-554b-4465-952a-663fd38656bb","Type":"ContainerStarted","Data":"40308fcd6a7eab13d90cf0d86f713d0faf88c36d169c4bde677279d80db9f2d9"} Jun 10 00:35:16.149668 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:16.149628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs\") pod \"network-metrics-daemon-957rh\" (UID: \"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2\") " pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:16.149844 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:16.149765 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:16.149844 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:16.149835 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs podName:ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:18.149815757 +0000 UTC m=+4.973721612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs") pod "network-metrics-daemon-957rh" (UID: "ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:16.179126 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:16.179096 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 00:35:16.250908 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:16.250868 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret\") pod \"global-pull-secret-syncer-5mx5g\" (UID: \"1380799b-1285-43c3-8c5d-d7f2b94278b8\") " pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:16.251079 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:16.251051 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:16.251148 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:16.251129 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret podName:1380799b-1285-43c3-8c5d-d7f2b94278b8 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:18.251110789 +0000 UTC m=+5.075016649 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret") pod "global-pull-secret-syncer-5mx5g" (UID: "1380799b-1285-43c3-8c5d-d7f2b94278b8") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:16.352155 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:16.352115 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9f4j\" (UniqueName: \"kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j\") pod \"network-check-target-dnm9g\" (UID: \"889f95d7-8f05-4b78-968a-a5fc872ad302\") " pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:16.352405 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:16.352387 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:16.352470 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:16.352412 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:16.352470 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:16.352426 2577 projected.go:196] Error preparing data for projected volume kube-api-access-j9f4j for pod openshift-network-diagnostics/network-check-target-dnm9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:16.352567 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:16.352486 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j podName:889f95d7-8f05-4b78-968a-a5fc872ad302 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:18.352468441 +0000 UTC m=+5.176374276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9f4j" (UniqueName: "kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j") pod "network-check-target-dnm9g" (UID: "889f95d7-8f05-4b78-968a-a5fc872ad302") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:16.593767 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:16.593732 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:16.594334 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:16.593879 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:16.594334 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:16.594298 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:16.594457 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:16.594392 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:16.594510 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:16.594495 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:16.594879 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:16.594568 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:16.635234 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:16.635156 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:30:14 +0000 UTC" deadline="2028-03-01 18:32:40.5147181 +0000 UTC" Jun 10 00:35:16.635234 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:16.635190 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15137h57m23.879532847s" Jun 10 00:35:18.169125 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:18.169035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs\") pod \"network-metrics-daemon-957rh\" (UID: \"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2\") " pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:18.169632 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:18.169211 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:18.169632 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:18.169305 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs podName:ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:22.169260626 +0000 UTC m=+8.993166465 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs") pod "network-metrics-daemon-957rh" (UID: "ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:18.270418 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:18.270379 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret\") pod \"global-pull-secret-syncer-5mx5g\" (UID: \"1380799b-1285-43c3-8c5d-d7f2b94278b8\") " pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:18.270600 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:18.270546 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:18.270667 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:18.270630 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret podName:1380799b-1285-43c3-8c5d-d7f2b94278b8 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:22.270609276 +0000 UTC m=+9.094515123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret") pod "global-pull-secret-syncer-5mx5g" (UID: "1380799b-1285-43c3-8c5d-d7f2b94278b8") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:18.371764 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:18.371715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9f4j\" (UniqueName: \"kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j\") pod \"network-check-target-dnm9g\" (UID: \"889f95d7-8f05-4b78-968a-a5fc872ad302\") " pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:18.371957 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:18.371908 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:18.371957 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:18.371932 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:18.371957 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:18.371944 2577 projected.go:196] Error preparing data for projected volume kube-api-access-j9f4j for pod openshift-network-diagnostics/network-check-target-dnm9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:18.372107 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:18.372011 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j podName:889f95d7-8f05-4b78-968a-a5fc872ad302 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:22.371991048 +0000 UTC m=+9.195896886 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9f4j" (UniqueName: "kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j") pod "network-check-target-dnm9g" (UID: "889f95d7-8f05-4b78-968a-a5fc872ad302") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:18.594616 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:18.594119 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:18.594616 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:18.594275 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:18.594616 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:18.594371 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:18.594616 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:18.594488 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:18.594616 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:18.594547 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:18.594616 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:18.594619 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:20.594292 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:20.594174 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:20.594292 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:20.594211 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:20.594292 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:20.594196 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:20.594802 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:20.594323 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:20.594802 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:20.594409 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:20.594802 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:20.594492 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:22.202518 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:22.202481 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs\") pod \"network-metrics-daemon-957rh\" (UID: \"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2\") " pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:22.202985 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:22.202620 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:22.202985 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:22.202685 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs podName:ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:30.202667784 +0000 UTC m=+17.026573622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs") pod "network-metrics-daemon-957rh" (UID: "ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:22.303327 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:22.303253 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret\") pod \"global-pull-secret-syncer-5mx5g\" (UID: \"1380799b-1285-43c3-8c5d-d7f2b94278b8\") " pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:22.303518 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:22.303382 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:22.303518 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:22.303445 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret podName:1380799b-1285-43c3-8c5d-d7f2b94278b8 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:30.303427508 +0000 UTC m=+17.127333345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret") pod "global-pull-secret-syncer-5mx5g" (UID: "1380799b-1285-43c3-8c5d-d7f2b94278b8") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:22.403880 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:22.403844 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9f4j\" (UniqueName: \"kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j\") pod \"network-check-target-dnm9g\" (UID: \"889f95d7-8f05-4b78-968a-a5fc872ad302\") " pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:22.404058 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:22.403989 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:22.404058 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:22.404009 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:22.404058 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:22.404019 2577 projected.go:196] Error preparing data for projected volume kube-api-access-j9f4j for pod openshift-network-diagnostics/network-check-target-dnm9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:22.404263 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:22.404071 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j podName:889f95d7-8f05-4b78-968a-a5fc872ad302 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:30.404051672 +0000 UTC m=+17.227957508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9f4j" (UniqueName: "kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j") pod "network-check-target-dnm9g" (UID: "889f95d7-8f05-4b78-968a-a5fc872ad302") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:22.594497 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:22.594417 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:22.594660 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:22.594540 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:22.594660 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:22.594561 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:22.594763 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:22.594679 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:22.594763 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:22.594705 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:22.594863 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:22.594763 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:24.593644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:24.593607 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:24.594101 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:24.593653 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:24.594101 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:24.593732 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:24.594101 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:24.593607 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:24.594101 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:24.593875 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:24.594101 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:24.593969 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:26.594045 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:26.594015 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:26.594457 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:26.594009 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:26.594457 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:26.594135 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:26.594457 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:26.594142 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:26.594457 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:26.594196 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:26.594457 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:26.594288 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:28.594433 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:28.594404 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:28.594908 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:28.594443 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:28.594908 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:28.594443 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:28.594908 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:28.594530 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:28.594908 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:28.594619 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:28.594908 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:28.594694 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:30.263427 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:30.263393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs\") pod \"network-metrics-daemon-957rh\" (UID: \"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2\") " pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:30.263827 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:30.263522 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:30.263827 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:30.263578 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs podName:ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:46.263561541 +0000 UTC m=+33.087467392 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs") pod "network-metrics-daemon-957rh" (UID: "ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:30.364008 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:30.363974 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret\") pod \"global-pull-secret-syncer-5mx5g\" (UID: \"1380799b-1285-43c3-8c5d-d7f2b94278b8\") " pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:30.364188 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:30.364158 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:30.364261 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:30.364251 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret podName:1380799b-1285-43c3-8c5d-d7f2b94278b8 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:46.36423179 +0000 UTC m=+33.188137630 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret") pod "global-pull-secret-syncer-5mx5g" (UID: "1380799b-1285-43c3-8c5d-d7f2b94278b8") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:30.465036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:30.464993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9f4j\" (UniqueName: \"kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j\") pod \"network-check-target-dnm9g\" (UID: \"889f95d7-8f05-4b78-968a-a5fc872ad302\") " pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:30.465217 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:30.465130 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:30.465217 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:30.465159 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:30.465217 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:30.465171 2577 projected.go:196] Error preparing data for projected volume kube-api-access-j9f4j for pod openshift-network-diagnostics/network-check-target-dnm9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:30.465361 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:30.465244 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j podName:889f95d7-8f05-4b78-968a-a5fc872ad302 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:46.465224756 +0000 UTC m=+33.289130599 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9f4j" (UniqueName: "kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j") pod "network-check-target-dnm9g" (UID: "889f95d7-8f05-4b78-968a-a5fc872ad302") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:30.593852 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:30.593771 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:30.593852 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:30.593794 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:30.593852 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:30.593812 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:30.594106 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:30.593895 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:30.594106 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:30.593949 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:30.594106 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:30.594045 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:32.594026 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:32.593990 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:32.594550 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:32.593997 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:32.594550 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:32.594106 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:32.594550 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:32.593997 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:32.594550 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:32.594217 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:32.594550 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:32.594319 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:34.593877 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:34.593840 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:34.593877 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:34.593873 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:34.594300 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:34.593840 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:34.594300 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:34.593936 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:34.594300 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:34.594016 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:34.594300 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:34.594080 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:35.776265 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:35.775851 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-237.ec2.internal" event={"ID":"7a071ffa0cc2d42bd342637b19e0cdf8","Type":"ContainerStarted","Data":"8f4c7312ce702271beff80659c893496d36b243e128da3b12b05b8f60a3f9e4e"} Jun 10 00:35:35.779502 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:35.779484 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 00:35:35.779878 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:35.779854 2577 generic.go:356] "Generic (PLEG): container finished" podID="812904bb-3cde-4d32-bca3-1f3c6efbf99d" containerID="eef69df2cdddd06f456544c9c2081d85a301828c532e88d33a13fc0a3f9a6980" exitCode=1 Jun 10 00:35:35.779978 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:35.779927 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" event={"ID":"812904bb-3cde-4d32-bca3-1f3c6efbf99d","Type":"ContainerStarted","Data":"72fc567daf31bfecbc44e89800225a496c0abae15e1920adffa987910d1d504a"} Jun 10 00:35:35.780057 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:35.780026 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" event={"ID":"812904bb-3cde-4d32-bca3-1f3c6efbf99d","Type":"ContainerDied","Data":"eef69df2cdddd06f456544c9c2081d85a301828c532e88d33a13fc0a3f9a6980"} Jun 10 00:35:35.780112 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:35.780081 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" event={"ID":"812904bb-3cde-4d32-bca3-1f3c6efbf99d","Type":"ContainerStarted","Data":"2b49543f42565e71d222933c772199ecfb3930df58d2d9377c2aea589932567d"} Jun 10 00:35:35.782964 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:35.782943 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-69jtz" event={"ID":"6f45e7ea-500d-43be-bf54-c8e375d90bdd","Type":"ContainerStarted","Data":"1ce13404114c559f2956658377e05c6c413b43ca6a6bd7f2089ec6bd1c368af1"} Jun 10 00:35:35.784384 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:35.784363 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" event={"ID":"0dc81fb8-27a2-47cc-abd9-5b1841f5ca0d","Type":"ContainerStarted","Data":"5890467a62d508d127914ff43cf39222b99616a228d78dc41dc21806d987a3c3"} Jun 10 00:35:35.791109 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:35.790956 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-237.ec2.internal" podStartSLOduration=21.790940339 podStartE2EDuration="21.790940339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:35.790444056 +0000 UTC m=+22.614349914" watchObservedRunningTime="2026-06-10 00:35:35.790940339 +0000 UTC m=+22.614846199" Jun 10 00:35:35.807393 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:35.807359 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8gc4p" podStartSLOduration=1.908058299 podStartE2EDuration="21.80734605s" totalImagesPullingTime="19.899287751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:35.807163777 +0000 UTC m=+22.631069634" watchObservedRunningTime="2026-06-10 00:35:35.80734605 +0000 UTC m=+22.631251909" Jun 10 00:35:35.824079 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:35.823985 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-69jtz" podStartSLOduration=2.862440417 podStartE2EDuration="22.823967939s" totalImagesPullingTime="19.961527522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:35.823777839 +0000 UTC m=+22.647683689" watchObservedRunningTime="2026-06-10 00:35:35.823967939 +0000 UTC m=+22.647873798" Jun 10 00:35:36.594276 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.594073 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:36.594573 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.594139 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:36.594573 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:36.594368 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:36.594573 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:36.594467 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:36.594573 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.594139 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:36.594573 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:36.594563 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:36.788621 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.788351 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wxcx7" event={"ID":"bde5b60b-554b-4465-952a-663fd38656bb","Type":"ContainerStarted","Data":"43f375498d3cb42ba01caf16fdd9f317be450c168ec5b4c29cd14b8f9938f545"} Jun 10 00:35:36.790290 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.790257 2577 generic.go:356] "Generic (PLEG): container finished" podID="ea5cb07e64b230b7e9101e78080a625c" containerID="508b49cdd7142ee440322adf4125167c52791208133939b31da7b3d50745a8ef" exitCode=0 Jun 10 00:35:36.790435 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.790341 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal" event={"ID":"ea5cb07e64b230b7e9101e78080a625c","Type":"ContainerDied","Data":"508b49cdd7142ee440322adf4125167c52791208133939b31da7b3d50745a8ef"} Jun 10 00:35:36.791995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.791937 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vs4nb" event={"ID":"ed5d0b4d-14e2-4195-80bd-b21fa955dc69","Type":"ContainerStarted","Data":"e34b2a9d7223e2179a8939876b7d090ead5f14c6e8f42ed5e9e46e761b91dbfa"} Jun 10 00:35:36.794738 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.793912 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gghdv" event={"ID":"4b988e04-4ce9-4739-abac-563b4dcf0f04","Type":"ContainerStarted","Data":"9379648c9cbceda6619eabe2b3e65ace34a1bf87b9101f911396cf84235ea9f6"} Jun 10 00:35:36.796560 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.796535 2577 generic.go:356] "Generic (PLEG): container finished" podID="900bf028-67cb-4c4a-92e6-40a73c642ec3" containerID="c3a8804c4d775e7b9e05ea4cbe0301cb7fc578dd461aa5675b26cf7ebe3bf91e" exitCode=0 Jun 10 00:35:36.796651 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.796624 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9vb8" event={"ID":"900bf028-67cb-4c4a-92e6-40a73c642ec3","Type":"ContainerDied","Data":"c3a8804c4d775e7b9e05ea4cbe0301cb7fc578dd461aa5675b26cf7ebe3bf91e"} Jun 10 00:35:36.798240 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.798213 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4s4hx" event={"ID":"89d37dfe-78b5-4500-acd0-6cca4e681d0e","Type":"ContainerStarted","Data":"9adef8cd4b14c9c30d9bec1c5399636ecac83fe2bf18286fec6cf64b88344a94"} Jun 10 00:35:36.799757 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.799727 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" event={"ID":"d081cb3a-6523-414a-a978-78aae151c057","Type":"ContainerStarted","Data":"d3a20870b3ed2ff51f4dda88c01220f288768e951d996ce3068c52e7cbccb089"} Jun 10 00:35:36.802879 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.802860 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 00:35:36.803306 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.803249 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" event={"ID":"812904bb-3cde-4d32-bca3-1f3c6efbf99d","Type":"ContainerStarted","Data":"fdc784b7cd8974c9aca0534f1910c2939186d949ce8b8b6e65b03bf3f96c90b2"} Jun 10 00:35:36.803381 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.803323 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" event={"ID":"812904bb-3cde-4d32-bca3-1f3c6efbf99d","Type":"ContainerStarted","Data":"3871ac5d4317af92976b69730789d64273926e5e567540eb09414dd9cae37b38"} Jun 10 00:35:36.803381 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.803355 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" event={"ID":"812904bb-3cde-4d32-bca3-1f3c6efbf99d","Type":"ContainerStarted","Data":"c15177dab7c8ecc3ae58083c4e1f0eff6aceee67bbe421e9e5dfb117a95ca758"} Jun 10 00:35:36.804015 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.803979 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wxcx7" podStartSLOduration=12.088500647 podStartE2EDuration="23.803965803s" totalImagesPullingTime="11.715465156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:36.803321878 +0000 UTC m=+23.627227737" watchObservedRunningTime="2026-06-10 00:35:36.803965803 +0000 UTC m=+23.627871661" Jun 10 00:35:36.844344 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.844239 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4s4hx" podStartSLOduration=2.955535379 podStartE2EDuration="22.84421988s" totalImagesPullingTime="19.888684501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:36.844001914 +0000 UTC m=+23.667907793" watchObservedRunningTime="2026-06-10 00:35:36.84421988 +0000 UTC m=+23.668125738" Jun 10 00:35:36.874180 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.874132 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gghdv" podStartSLOduration=3.960217484 podStartE2EDuration="23.874119s" totalImagesPullingTime="19.913901516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:36.874040644 +0000 UTC m=+23.697946499" watchObservedRunningTime="2026-06-10 00:35:36.874119 +0000 UTC m=+23.698024857" Jun 10 00:35:36.895935 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:36.895899 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vs4nb" podStartSLOduration=2.993683091 podStartE2EDuration="22.895888777s" totalImagesPullingTime="19.902205686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:36.895408427 +0000 UTC m=+23.719314286" watchObservedRunningTime="2026-06-10 00:35:36.895888777 +0000 UTC m=+23.719794635" Jun 10 00:35:37.135399 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:37.135376 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 00:35:37.596154 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:37.596036 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T00:35:37.135396598Z","UUID":"f376fc7a-0970-4bcc-886c-5ac2dd61bf4f","Handler":null,"Name":"","Endpoint":""} Jun 10 00:35:37.597895 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:37.597873 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 00:35:37.598025 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:37.597919 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 00:35:37.808215 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:37.808173 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" event={"ID":"d081cb3a-6523-414a-a978-78aae151c057","Type":"ContainerStarted","Data":"10c3dfc302a094636a452d1e1ea5f4cbbd9f9a703f523e8ab1584dac512da29d"} Jun 10 00:35:37.810186 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:37.810119 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal" event={"ID":"ea5cb07e64b230b7e9101e78080a625c","Type":"ContainerStarted","Data":"9cdb004939254a8b85932457fac64e7f97a571d0eca4e33704d108580c53c9ff"} Jun 10 00:35:37.826935 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:37.826894 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-237.ec2.internal" podStartSLOduration=23.826879216000002 podStartE2EDuration="23.826879216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:37.826596074 +0000 UTC m=+24.650501933" watchObservedRunningTime="2026-06-10 00:35:37.826879216 +0000 UTC m=+24.650785073" Jun 10 00:35:38.594407 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:38.594376 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:38.594583 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:38.594376 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:38.594583 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:38.594492 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:38.594696 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:38.594581 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:38.594696 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:38.594376 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:38.594860 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:38.594717 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:38.815459 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:38.815426 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" event={"ID":"d081cb3a-6523-414a-a978-78aae151c057","Type":"ContainerStarted","Data":"f5a4e2603e3c94d9ee8bb04929c9f47a619162d3314a62e24866a38bfac3fc29"} Jun 10 00:35:38.818821 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:38.818792 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 00:35:38.819256 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:38.819231 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" event={"ID":"812904bb-3cde-4d32-bca3-1f3c6efbf99d","Type":"ContainerStarted","Data":"94056687973cfa83733e09daca0f612fe86617831cdee7d873a48a38c7f494f1"} Jun 10 00:35:38.835023 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:38.834981 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rwwj" podStartSLOduration=7.245203736 podStartE2EDuration="24.834966862s" totalImagesPullingTime="17.589763126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:38.834285617 +0000 UTC m=+25.658191478" watchObservedRunningTime="2026-06-10 00:35:38.834966862 +0000 UTC m=+25.658872755" Jun 10 00:35:39.848360 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:39.848242 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wxcx7" Jun 10 00:35:39.848831 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:39.848814 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wxcx7" Jun 10 00:35:40.594285 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:40.594185 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:40.594448 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:40.594185 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:40.594448 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:40.594186 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:40.594448 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:40.594411 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:40.594591 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:40.594315 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:40.594591 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:40.594486 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:40.825458 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:40.825414 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9vb8" event={"ID":"900bf028-67cb-4c4a-92e6-40a73c642ec3","Type":"ContainerStarted","Data":"15d5789a369d79ec3207ae70b4bea7a2b62dc691c95a0ebf8e17c2516fe3be3a"} Jun 10 00:35:40.830829 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:40.830809 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 00:35:40.831182 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:40.831156 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" event={"ID":"812904bb-3cde-4d32-bca3-1f3c6efbf99d","Type":"ContainerStarted","Data":"a1682638b31bde150485cf48fd72296b28309b566a79321d2249a7e99b75e9ad"} Jun 10 00:35:40.831709 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:40.831294 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wxcx7" Jun 10 00:35:40.831803 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:40.831710 2577 scope.go:117] "RemoveContainer" containerID="eef69df2cdddd06f456544c9c2081d85a301828c532e88d33a13fc0a3f9a6980" Jun 10 00:35:40.831998 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:40.831979 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wxcx7" Jun 10 00:35:41.834987 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:41.834812 2577 generic.go:356] "Generic (PLEG): container finished" podID="900bf028-67cb-4c4a-92e6-40a73c642ec3" containerID="15d5789a369d79ec3207ae70b4bea7a2b62dc691c95a0ebf8e17c2516fe3be3a" exitCode=0 Jun 10 00:35:41.835562 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:41.834893 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9vb8" event={"ID":"900bf028-67cb-4c4a-92e6-40a73c642ec3","Type":"ContainerDied","Data":"15d5789a369d79ec3207ae70b4bea7a2b62dc691c95a0ebf8e17c2516fe3be3a"} Jun 10 00:35:41.839066 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:41.839049 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 00:35:41.839444 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:41.839423 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" event={"ID":"812904bb-3cde-4d32-bca3-1f3c6efbf99d","Type":"ContainerStarted","Data":"ca506b999ef48071804a7a47685fced1e3eb4133ba26f0f6a57a9d5776659806"} Jun 10 00:35:41.839612 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:41.839595 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:41.839684 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:41.839665 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:41.839756 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:41.839714 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:41.854691 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:41.854670 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:41.854833 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:41.854820 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:35:41.884046 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:41.883993 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" podStartSLOduration=8.352262195 podStartE2EDuration="28.883975386s" totalImagesPullingTime="20.531713191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:41.883668454 +0000 UTC m=+28.707574326" watchObservedRunningTime="2026-06-10 00:35:41.883975386 +0000 UTC m=+28.707881245" Jun 10 00:35:42.593981 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:42.593954 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:42.594180 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:42.593954 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:42.594180 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:42.594062 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:42.594180 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:42.593954 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:42.594180 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:42.594128 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:42.594339 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:42.594194 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:42.659150 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:42.659118 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dnm9g"] Jun 10 00:35:42.661780 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:42.661755 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5mx5g"] Jun 10 00:35:42.664562 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:42.664541 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-957rh"] Jun 10 00:35:42.841169 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:42.841132 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:42.841169 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:42.841132 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:42.841767 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:42.841234 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:42.841767 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:42.841367 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:42.841767 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:42.841409 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:42.841767 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:42.841484 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:43.845784 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:43.845746 2577 generic.go:356] "Generic (PLEG): container finished" podID="900bf028-67cb-4c4a-92e6-40a73c642ec3" containerID="a68ffea829d8042f8104234020f3d9497b997b8e99bee247ff69ded3e72e1fcc" exitCode=0 Jun 10 00:35:43.846283 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:43.845832 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9vb8" event={"ID":"900bf028-67cb-4c4a-92e6-40a73c642ec3","Type":"ContainerDied","Data":"a68ffea829d8042f8104234020f3d9497b997b8e99bee247ff69ded3e72e1fcc"} Jun 10 00:35:44.593790 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:44.593760 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:44.593937 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:44.593852 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:44.593937 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:44.593887 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:44.593937 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:44.593909 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:44.594055 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:44.593975 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:44.594113 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:44.594046 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:45.852685 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:45.852495 2577 generic.go:356] "Generic (PLEG): container finished" podID="900bf028-67cb-4c4a-92e6-40a73c642ec3" containerID="71eba25a2d9b68917218b16c6bff1581c067316cb169202431a07116a185a6e0" exitCode=0 Jun 10 00:35:45.853157 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:45.852580 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9vb8" event={"ID":"900bf028-67cb-4c4a-92e6-40a73c642ec3","Type":"ContainerDied","Data":"71eba25a2d9b68917218b16c6bff1581c067316cb169202431a07116a185a6e0"} Jun 10 00:35:46.283351 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:46.283314 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs\") pod \"network-metrics-daemon-957rh\" (UID: \"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2\") " pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:46.283521 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:46.283438 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:46.283521 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:46.283493 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs podName:ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:18.283480245 +0000 UTC m=+65.107386086 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs") pod "network-metrics-daemon-957rh" (UID: "ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 00:35:46.384007 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:46.383975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret\") pod \"global-pull-secret-syncer-5mx5g\" (UID: \"1380799b-1285-43c3-8c5d-d7f2b94278b8\") " pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:46.384192 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:46.384105 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:46.384192 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:46.384173 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret podName:1380799b-1285-43c3-8c5d-d7f2b94278b8 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:18.384154711 +0000 UTC m=+65.208060561 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret") pod "global-pull-secret-syncer-5mx5g" (UID: "1380799b-1285-43c3-8c5d-d7f2b94278b8") : object "kube-system"/"original-pull-secret" not registered Jun 10 00:35:46.485042 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:46.485004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9f4j\" (UniqueName: \"kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j\") pod \"network-check-target-dnm9g\" (UID: \"889f95d7-8f05-4b78-968a-a5fc872ad302\") " pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:46.485229 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:46.485214 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 00:35:46.485292 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:46.485243 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 00:35:46.485292 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:46.485257 2577 projected.go:196] Error preparing data for projected volume kube-api-access-j9f4j for pod openshift-network-diagnostics/network-check-target-dnm9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:46.485394 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:46.485325 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j podName:889f95d7-8f05-4b78-968a-a5fc872ad302 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:18.485306338 +0000 UTC m=+65.309212194 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9f4j" (UniqueName: "kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j") pod "network-check-target-dnm9g" (UID: "889f95d7-8f05-4b78-968a-a5fc872ad302") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 00:35:46.593910 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:46.593827 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:46.594059 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:46.593838 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:46.594059 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:46.593961 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnm9g" podUID="889f95d7-8f05-4b78-968a-a5fc872ad302" Jun 10 00:35:46.594059 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:46.593970 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:46.594238 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:46.594056 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mx5g" podUID="1380799b-1285-43c3-8c5d-d7f2b94278b8" Jun 10 00:35:46.594238 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:46.594152 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:35:48.021154 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.021126 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-237.ec2.internal" event="NodeReady" Jun 10 00:35:48.021637 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.021282 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 00:35:48.062414 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.062382 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74978b5b5d-slrwd"] Jun 10 00:35:48.066815 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.066785 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.069563 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.069520 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 00:35:48.069563 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.069535 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 00:35:48.069777 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.069638 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wfgj8\"" Jun 10 00:35:48.069839 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.069818 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 00:35:48.075561 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.075464 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 00:35:48.083886 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.083864 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74978b5b5d-slrwd"] Jun 10 00:35:48.085363 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.085338 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5zhlc"] Jun 10 00:35:48.089356 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.089334 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2zvxw"] Jun 10 00:35:48.089491 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.089472 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5zhlc" Jun 10 00:35:48.092115 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.092095 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 00:35:48.092322 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.092095 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-42gc7\"" Jun 10 00:35:48.092322 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.092096 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 00:35:48.093081 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.093065 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2zvxw" Jun 10 00:35:48.095553 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.095526 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 00:35:48.095553 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.095551 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2q8pl\"" Jun 10 00:35:48.095694 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.095601 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 00:35:48.095854 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.095837 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 00:35:48.100696 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.100674 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5zhlc"] Jun 10 00:35:48.115429 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.115396 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2zvxw"] Jun 10 00:35:48.197780 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.197749 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-ca-trust-extracted\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.197970 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.197788 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-trusted-ca\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.197970 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.197818 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6fj2\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-kube-api-access-d6fj2\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.197970 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.197872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-config-volume\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:35:48.197970 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.197914 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1e34cf6-3e84-46d9-9255-e1adae9cb707-cert\") pod \"ingress-canary-2zvxw\" (UID: \"f1e34cf6-3e84-46d9-9255-e1adae9cb707\") " pod="openshift-ingress-canary/ingress-canary-2zvxw" Jun 10 00:35:48.197970 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.197939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-bound-sa-token\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.198229 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.198016 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-certificates\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.198229 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.198048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-installation-pull-secrets\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.198229 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.198127 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:35:48.198229 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.198160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69vfs\" (UniqueName: \"kubernetes.io/projected/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-kube-api-access-69vfs\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:35:48.198431 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.198229 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-image-registry-private-configuration\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.198431 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.198295 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svvzb\" (UniqueName: \"kubernetes.io/projected/f1e34cf6-3e84-46d9-9255-e1adae9cb707-kube-api-access-svvzb\") pod \"ingress-canary-2zvxw\" (UID: \"f1e34cf6-3e84-46d9-9255-e1adae9cb707\") " pod="openshift-ingress-canary/ingress-canary-2zvxw" Jun 10 00:35:48.198431 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.198325 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.198431 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.198348 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-tmp-dir\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:35:48.299587 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.299512 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-installation-pull-secrets\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.299587 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.299571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:35:48.299785 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:48.299660 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:35:48.299785 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:48.299707 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls podName:ad7c9a9b-90a0-4731-9879-86b04dabe8d4 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:48.799693234 +0000 UTC m=+35.623599071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls") pod "dns-default-5zhlc" (UID: "ad7c9a9b-90a0-4731-9879-86b04dabe8d4") : secret "dns-default-metrics-tls" not found Jun 10 00:35:48.299785 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.299760 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69vfs\" (UniqueName: \"kubernetes.io/projected/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-kube-api-access-69vfs\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:35:48.299938 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.299812 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-image-registry-private-configuration\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.299938 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.299848 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svvzb\" (UniqueName: \"kubernetes.io/projected/f1e34cf6-3e84-46d9-9255-e1adae9cb707-kube-api-access-svvzb\") pod \"ingress-canary-2zvxw\" (UID: \"f1e34cf6-3e84-46d9-9255-e1adae9cb707\") " pod="openshift-ingress-canary/ingress-canary-2zvxw" Jun 10 00:35:48.299938 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.299872 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.299938 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.299896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-tmp-dir\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:35:48.300122 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:48.300078 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:35:48.300122 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:48.300091 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74978b5b5d-slrwd: secret "image-registry-tls" not found Jun 10 00:35:48.300241 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:48.300127 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls podName:6a7a514e-dd73-4c2a-8a22-a291c6cd0b17 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:48.800114357 +0000 UTC m=+35.624020211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls") pod "image-registry-74978b5b5d-slrwd" (UID: "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17") : secret "image-registry-tls" not found Jun 10 00:35:48.300241 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.300152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-ca-trust-extracted\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.300241 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.300184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-trusted-ca\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.300241 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.300222 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-tmp-dir\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:35:48.300241 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.300228 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6fj2\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-kube-api-access-d6fj2\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.300444 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.300253 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-config-volume\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:35:48.302136 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.300812 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1e34cf6-3e84-46d9-9255-e1adae9cb707-cert\") pod \"ingress-canary-2zvxw\" (UID: \"f1e34cf6-3e84-46d9-9255-e1adae9cb707\") " pod="openshift-ingress-canary/ingress-canary-2zvxw" Jun 10 00:35:48.302136 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.300868 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-bound-sa-token\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.302136 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.300932 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-certificates\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.302136 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.301078 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-ca-trust-extracted\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.302136 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.301563 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-certificates\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.302136 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.301838 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-config-volume\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:35:48.305001 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.303021 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-trusted-ca\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.306661 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.306640 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1e34cf6-3e84-46d9-9255-e1adae9cb707-cert\") pod \"ingress-canary-2zvxw\" (UID: \"f1e34cf6-3e84-46d9-9255-e1adae9cb707\") " pod="openshift-ingress-canary/ingress-canary-2zvxw" Jun 10 00:35:48.306930 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.306902 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-installation-pull-secrets\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.307093 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.307073 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-image-registry-private-configuration\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.337875 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.337831 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69vfs\" (UniqueName: \"kubernetes.io/projected/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-kube-api-access-69vfs\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:35:48.338015 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.337907 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svvzb\" (UniqueName: \"kubernetes.io/projected/f1e34cf6-3e84-46d9-9255-e1adae9cb707-kube-api-access-svvzb\") pod \"ingress-canary-2zvxw\" (UID: \"f1e34cf6-3e84-46d9-9255-e1adae9cb707\") " pod="openshift-ingress-canary/ingress-canary-2zvxw" Jun 10 00:35:48.338015 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.337907 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6fj2\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-kube-api-access-d6fj2\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.338913 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.338889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-bound-sa-token\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.407723 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.407650 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2zvxw" Jun 10 00:35:48.593553 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.593481 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:35:48.593717 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.593481 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:35:48.593717 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.593481 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:35:48.596424 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.596359 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 00:35:48.596424 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.596387 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 00:35:48.596424 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.596406 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xnfsk\"" Jun 10 00:35:48.596424 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.596423 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 00:35:48.596697 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.596683 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 00:35:48.596776 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.596762 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vbn9h\"" Jun 10 00:35:48.805530 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.805491 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:35:48.805711 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:48.805538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:48.805711 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:48.805660 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:35:48.805711 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:48.805676 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:35:48.805711 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:48.805689 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74978b5b5d-slrwd: secret "image-registry-tls" not found Jun 10 00:35:48.806048 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:48.805742 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls podName:6a7a514e-dd73-4c2a-8a22-a291c6cd0b17 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:49.805724311 +0000 UTC m=+36.629630156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls") pod "image-registry-74978b5b5d-slrwd" (UID: "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17") : secret "image-registry-tls" not found Jun 10 00:35:48.806048 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:48.805760 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls podName:ad7c9a9b-90a0-4731-9879-86b04dabe8d4 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:49.805751275 +0000 UTC m=+36.629657111 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls") pod "dns-default-5zhlc" (UID: "ad7c9a9b-90a0-4731-9879-86b04dabe8d4") : secret "dns-default-metrics-tls" not found Jun 10 00:35:49.813341 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:49.813309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:35:49.813717 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:49.813363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:49.813717 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:49.813539 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:35:49.813717 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:49.813554 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74978b5b5d-slrwd: secret "image-registry-tls" not found Jun 10 00:35:49.813717 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:49.813613 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls podName:6a7a514e-dd73-4c2a-8a22-a291c6cd0b17 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:51.813594263 +0000 UTC m=+38.637500118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls") pod "image-registry-74978b5b5d-slrwd" (UID: "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17") : secret "image-registry-tls" not found Jun 10 00:35:49.814114 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:49.814031 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:35:49.814114 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:49.814082 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls podName:ad7c9a9b-90a0-4731-9879-86b04dabe8d4 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:51.814066512 +0000 UTC m=+38.637972351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls") pod "dns-default-5zhlc" (UID: "ad7c9a9b-90a0-4731-9879-86b04dabe8d4") : secret "dns-default-metrics-tls" not found Jun 10 00:35:49.848973 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:49.848824 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2zvxw"] Jun 10 00:35:49.852535 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:49.852502 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e34cf6_3e84_46d9_9255_e1adae9cb707.slice/crio-0d2e678ca266703279de1ab630f27c0be24615364927fdaaacf96eb2d5f7d75c WatchSource:0}: Error finding container 0d2e678ca266703279de1ab630f27c0be24615364927fdaaacf96eb2d5f7d75c: Status 404 returned error can't find the container with id 0d2e678ca266703279de1ab630f27c0be24615364927fdaaacf96eb2d5f7d75c Jun 10 00:35:49.867150 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:49.867122 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2zvxw" event={"ID":"f1e34cf6-3e84-46d9-9255-e1adae9cb707","Type":"ContainerStarted","Data":"0d2e678ca266703279de1ab630f27c0be24615364927fdaaacf96eb2d5f7d75c"} Jun 10 00:35:50.368887 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.368802 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd"] Jun 10 00:35:50.371490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.371475 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" Jun 10 00:35:50.375521 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.375496 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 00:35:50.375521 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.375498 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 10 00:35:50.375703 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.375499 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 00:35:50.375703 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.375587 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 00:35:50.375703 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.375499 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-hf6gq\"" Jun 10 00:35:50.382932 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.382914 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd"] Jun 10 00:35:50.519029 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.518993 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdzqq\" (UniqueName: \"kubernetes.io/projected/4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f-kube-api-access-tdzqq\") pod \"managed-serviceaccount-addon-agent-845b7c5878-czfzd\" (UID: \"4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" Jun 10 00:35:50.519029 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.519036 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-845b7c5878-czfzd\" (UID: \"4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" Jun 10 00:35:50.619678 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.619581 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdzqq\" (UniqueName: \"kubernetes.io/projected/4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f-kube-api-access-tdzqq\") pod \"managed-serviceaccount-addon-agent-845b7c5878-czfzd\" (UID: \"4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" Jun 10 00:35:50.619678 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.619644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-845b7c5878-czfzd\" (UID: \"4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" Jun 10 00:35:50.623795 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.623768 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-845b7c5878-czfzd\" (UID: \"4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" Jun 10 00:35:50.627740 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.627710 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdzqq\" (UniqueName: \"kubernetes.io/projected/4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f-kube-api-access-tdzqq\") pod \"managed-serviceaccount-addon-agent-845b7c5878-czfzd\" (UID: \"4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" Jun 10 00:35:50.687750 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.687712 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" Jun 10 00:35:50.835925 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.835896 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd"] Jun 10 00:35:50.839322 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:35:50.839292 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f9d8f87_16d8_4ceb_88f1_209c7ec6ab2f.slice/crio-ac3a45cf19480ae05804800dc963c59c57fa4145af66f9faddfe88976dd5bef5 WatchSource:0}: Error finding container ac3a45cf19480ae05804800dc963c59c57fa4145af66f9faddfe88976dd5bef5: Status 404 returned error can't find the container with id ac3a45cf19480ae05804800dc963c59c57fa4145af66f9faddfe88976dd5bef5 Jun 10 00:35:50.870911 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.870840 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" event={"ID":"4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f","Type":"ContainerStarted","Data":"ac3a45cf19480ae05804800dc963c59c57fa4145af66f9faddfe88976dd5bef5"} Jun 10 00:35:50.878154 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.878116 2577 generic.go:356] "Generic (PLEG): container finished" podID="900bf028-67cb-4c4a-92e6-40a73c642ec3" containerID="fe3344140275c9ec6725f630ecff3862bc6e0370da095dbb1f44240cd4560cdd" exitCode=0 Jun 10 00:35:50.878297 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:50.878156 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9vb8" event={"ID":"900bf028-67cb-4c4a-92e6-40a73c642ec3","Type":"ContainerDied","Data":"fe3344140275c9ec6725f630ecff3862bc6e0370da095dbb1f44240cd4560cdd"} Jun 10 00:35:51.832606 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:51.832563 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:51.832799 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:51.832693 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:35:51.832799 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:51.832726 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:35:51.832799 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:51.832742 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74978b5b5d-slrwd: secret "image-registry-tls" not found Jun 10 00:35:51.832799 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:51.832787 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:35:51.832979 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:51.832817 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls podName:6a7a514e-dd73-4c2a-8a22-a291c6cd0b17 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:55.832799162 +0000 UTC m=+42.656705001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls") pod "image-registry-74978b5b5d-slrwd" (UID: "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17") : secret "image-registry-tls" not found Jun 10 00:35:51.832979 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:51.832835 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls podName:ad7c9a9b-90a0-4731-9879-86b04dabe8d4 nodeName:}" failed. No retries permitted until 2026-06-10 00:35:55.832826521 +0000 UTC m=+42.656732358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls") pod "dns-default-5zhlc" (UID: "ad7c9a9b-90a0-4731-9879-86b04dabe8d4") : secret "dns-default-metrics-tls" not found Jun 10 00:35:51.884830 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:51.884792 2577 generic.go:356] "Generic (PLEG): container finished" podID="900bf028-67cb-4c4a-92e6-40a73c642ec3" containerID="673802ee2ba1b81bc6cb301eb7c9f8a03d518f3eeb2456aa0209bc36d20c01be" exitCode=0 Jun 10 00:35:51.885556 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:51.884877 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9vb8" event={"ID":"900bf028-67cb-4c4a-92e6-40a73c642ec3","Type":"ContainerDied","Data":"673802ee2ba1b81bc6cb301eb7c9f8a03d518f3eeb2456aa0209bc36d20c01be"} Jun 10 00:35:52.891317 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:52.891018 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2zvxw" event={"ID":"f1e34cf6-3e84-46d9-9255-e1adae9cb707","Type":"ContainerStarted","Data":"924f2dce04387469eda16847544c33f237fd954b3914e03512e97628f4ef231e"} Jun 10 00:35:52.896085 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:52.896051 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9vb8" event={"ID":"900bf028-67cb-4c4a-92e6-40a73c642ec3","Type":"ContainerStarted","Data":"d2474caea306ac5a5311bf4d208081bb5bf52449eba6acd8347da1ebf38189e9"} Jun 10 00:35:52.932125 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:52.932045 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2zvxw" podStartSLOduration=2.4948120449999998 podStartE2EDuration="4.932027494s" totalImagesPullingTime="2.437215449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:52.931789015 +0000 UTC m=+39.755694873" watchObservedRunningTime="2026-06-10 00:35:52.932027494 +0000 UTC m=+39.755933353" Jun 10 00:35:53.000261 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:52.999965 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r9vb8" podStartSLOduration=10.205507866 podStartE2EDuration="39.999945572s" totalImagesPullingTime="29.794437706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:52.999171057 +0000 UTC m=+39.823076916" watchObservedRunningTime="2026-06-10 00:35:52.999945572 +0000 UTC m=+39.823851431" Jun 10 00:35:54.902791 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:54.902752 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" event={"ID":"4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f","Type":"ContainerStarted","Data":"8382dcaddb29600abb384908bce1c5a03c37a79e37cfc51f558d2eefd5e8af62"} Jun 10 00:35:54.920761 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:54.920712 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" podStartSLOduration=1.032217562 podStartE2EDuration="4.920682736s" totalImagesPullingTime="3.888465174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:54.920153225 +0000 UTC m=+41.744059098" watchObservedRunningTime="2026-06-10 00:35:54.920682736 +0000 UTC m=+41.744588625" Jun 10 00:35:55.863901 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:55.863816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:35:55.863901 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:35:55.863862 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:35:55.864073 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:55.863976 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:35:55.864073 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:55.864040 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls podName:ad7c9a9b-90a0-4731-9879-86b04dabe8d4 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:03.864025785 +0000 UTC m=+50.687931626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls") pod "dns-default-5zhlc" (UID: "ad7c9a9b-90a0-4731-9879-86b04dabe8d4") : secret "dns-default-metrics-tls" not found Jun 10 00:35:55.864073 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:55.863978 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:35:55.864175 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:55.864082 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74978b5b5d-slrwd: secret "image-registry-tls" not found Jun 10 00:35:55.864175 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:35:55.864121 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls podName:6a7a514e-dd73-4c2a-8a22-a291c6cd0b17 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:03.864110864 +0000 UTC m=+50.688016700 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls") pod "image-registry-74978b5b5d-slrwd" (UID: "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17") : secret "image-registry-tls" not found Jun 10 00:36:03.928637 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:03.928603 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:36:03.929151 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:03.928746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:36:03.929151 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:36:03.928782 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:36:03.929151 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:36:03.928805 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74978b5b5d-slrwd: secret "image-registry-tls" not found Jun 10 00:36:03.929151 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:36:03.928834 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:36:03.929151 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:36:03.928892 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls podName:ad7c9a9b-90a0-4731-9879-86b04dabe8d4 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:19.928874064 +0000 UTC m=+66.752779912 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls") pod "dns-default-5zhlc" (UID: "ad7c9a9b-90a0-4731-9879-86b04dabe8d4") : secret "dns-default-metrics-tls" not found Jun 10 00:36:03.929151 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:36:03.928933 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls podName:6a7a514e-dd73-4c2a-8a22-a291c6cd0b17 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:19.928913098 +0000 UTC m=+66.752818938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls") pod "image-registry-74978b5b5d-slrwd" (UID: "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17") : secret "image-registry-tls" not found Jun 10 00:36:13.856210 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:13.856170 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wq7wh" Jun 10 00:36:18.336283 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:18.336237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs\") pod \"network-metrics-daemon-957rh\" (UID: \"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2\") " pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:36:18.339145 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:18.339124 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 00:36:18.347406 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:36:18.347389 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 00:36:18.347511 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:36:18.347458 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs podName:ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:22.347435826 +0000 UTC m=+129.171341675 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs") pod "network-metrics-daemon-957rh" (UID: "ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2") : secret "metrics-daemon-secret" not found Jun 10 00:36:18.436811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:18.436769 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret\") pod \"global-pull-secret-syncer-5mx5g\" (UID: \"1380799b-1285-43c3-8c5d-d7f2b94278b8\") " pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:36:18.439618 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:18.439598 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 00:36:18.450864 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:18.450839 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1380799b-1285-43c3-8c5d-d7f2b94278b8-original-pull-secret\") pod \"global-pull-secret-syncer-5mx5g\" (UID: \"1380799b-1285-43c3-8c5d-d7f2b94278b8\") " pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:36:18.537552 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:18.537503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9f4j\" (UniqueName: \"kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j\") pod \"network-check-target-dnm9g\" (UID: \"889f95d7-8f05-4b78-968a-a5fc872ad302\") " pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:36:18.540497 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:18.540474 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 00:36:18.550432 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:18.550407 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 00:36:18.561032 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:18.561008 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9f4j\" (UniqueName: \"kubernetes.io/projected/889f95d7-8f05-4b78-968a-a5fc872ad302-kube-api-access-j9f4j\") pod \"network-check-target-dnm9g\" (UID: \"889f95d7-8f05-4b78-968a-a5fc872ad302\") " pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:36:18.614662 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:18.614593 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xnfsk\"" Jun 10 00:36:18.616661 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:18.616644 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mx5g" Jun 10 00:36:18.622000 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:18.621986 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:36:18.748872 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:36:18.748836 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1380799b_1285_43c3_8c5d_d7f2b94278b8.slice/crio-2f0056e98af9532e630603cedbec5b96bd9cd900e0afdc22d632221a9b7859c4 WatchSource:0}: Error finding container 2f0056e98af9532e630603cedbec5b96bd9cd900e0afdc22d632221a9b7859c4: Status 404 returned error can't find the container with id 2f0056e98af9532e630603cedbec5b96bd9cd900e0afdc22d632221a9b7859c4 Jun 10 00:36:18.749461 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:18.749432 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5mx5g"] Jun 10 00:36:18.762597 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:18.762572 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dnm9g"] Jun 10 00:36:18.765503 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:36:18.765480 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod889f95d7_8f05_4b78_968a_a5fc872ad302.slice/crio-11e9a26c7126f6a425dedc52b6b03d7899e4dc8722e01f53c901c145b8589c2d WatchSource:0}: Error finding container 11e9a26c7126f6a425dedc52b6b03d7899e4dc8722e01f53c901c145b8589c2d: Status 404 returned error can't find the container with id 11e9a26c7126f6a425dedc52b6b03d7899e4dc8722e01f53c901c145b8589c2d Jun 10 00:36:18.960016 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:18.959974 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dnm9g" event={"ID":"889f95d7-8f05-4b78-968a-a5fc872ad302","Type":"ContainerStarted","Data":"11e9a26c7126f6a425dedc52b6b03d7899e4dc8722e01f53c901c145b8589c2d"} Jun 10 00:36:18.961048 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:18.961025 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5mx5g" event={"ID":"1380799b-1285-43c3-8c5d-d7f2b94278b8","Type":"ContainerStarted","Data":"2f0056e98af9532e630603cedbec5b96bd9cd900e0afdc22d632221a9b7859c4"} Jun 10 00:36:19.947103 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:19.946925 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:36:19.947103 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:19.946995 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:36:19.947103 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:36:19.947076 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:36:19.947730 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:36:19.947150 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls podName:ad7c9a9b-90a0-4731-9879-86b04dabe8d4 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:51.947131592 +0000 UTC m=+98.771037430 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls") pod "dns-default-5zhlc" (UID: "ad7c9a9b-90a0-4731-9879-86b04dabe8d4") : secret "dns-default-metrics-tls" not found Jun 10 00:36:19.947730 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:36:19.947162 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:36:19.947730 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:36:19.947182 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74978b5b5d-slrwd: secret "image-registry-tls" not found Jun 10 00:36:19.947730 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:36:19.947257 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls podName:6a7a514e-dd73-4c2a-8a22-a291c6cd0b17 nodeName:}" failed. No retries permitted until 2026-06-10 00:36:51.947238957 +0000 UTC m=+98.771144794 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls") pod "image-registry-74978b5b5d-slrwd" (UID: "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17") : secret "image-registry-tls" not found Jun 10 00:36:23.974824 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:23.974792 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dnm9g" event={"ID":"889f95d7-8f05-4b78-968a-a5fc872ad302","Type":"ContainerStarted","Data":"c6b888523874f57c15bf9f80663bd52d71a0d4cd321aac439a984e84856bf455"} Jun 10 00:36:23.975109 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:23.974905 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:36:23.990478 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:23.990424 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dnm9g" podStartSLOduration=67.584246949 podStartE2EDuration="1m10.99041087s" totalImagesPullingTime="3.406163921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:36:23.988983357 +0000 UTC m=+70.812889227" watchObservedRunningTime="2026-06-10 00:36:23.99041087 +0000 UTC m=+70.814316727" Jun 10 00:36:24.978994 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:24.978955 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5mx5g" event={"ID":"1380799b-1285-43c3-8c5d-d7f2b94278b8","Type":"ContainerStarted","Data":"edd863fef3d22b1188aa7802dd74b082b2e279c91c766fd760392dae12b82012"} Jun 10 00:36:24.994412 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:24.994349 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5mx5g" podStartSLOduration=65.771397469 podStartE2EDuration="1m10.994330804s" totalImagesPullingTime="5.222933335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:35:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:36:24.994096237 +0000 UTC m=+71.818002095" watchObservedRunningTime="2026-06-10 00:36:24.994330804 +0000 UTC m=+71.818236657" Jun 10 00:36:51.970361 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:51.970244 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:36:51.970361 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:51.970289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:36:51.970838 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:36:51.970379 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:36:51.970838 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:36:51.970390 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74978b5b5d-slrwd: secret "image-registry-tls" not found Jun 10 00:36:51.970838 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:36:51.970394 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:36:51.970838 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:36:51.970456 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls podName:6a7a514e-dd73-4c2a-8a22-a291c6cd0b17 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:55.970436671 +0000 UTC m=+162.794342507 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls") pod "image-registry-74978b5b5d-slrwd" (UID: "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17") : secret "image-registry-tls" not found Jun 10 00:36:51.970838 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:36:51.970470 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls podName:ad7c9a9b-90a0-4731-9879-86b04dabe8d4 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:55.970463125 +0000 UTC m=+162.794368960 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls") pod "dns-default-5zhlc" (UID: "ad7c9a9b-90a0-4731-9879-86b04dabe8d4") : secret "dns-default-metrics-tls" not found Jun 10 00:36:54.981664 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:36:54.981634 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dnm9g" Jun 10 00:37:22.385061 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:22.385009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs\") pod \"network-metrics-daemon-957rh\" (UID: \"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2\") " pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:37:22.385556 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:22.385158 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 00:37:22.385556 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:22.385245 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs podName:ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2 nodeName:}" failed. No retries permitted until 2026-06-10 00:39:24.385229427 +0000 UTC m=+251.209135266 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs") pod "network-metrics-daemon-957rh" (UID: "ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2") : secret "metrics-daemon-secret" not found Jun 10 00:37:51.078243 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:51.078177 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" podUID="6a7a514e-dd73-4c2a-8a22-a291c6cd0b17" Jun 10 00:37:51.101090 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:51.101046 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5zhlc" podUID="ad7c9a9b-90a0-4731-9879-86b04dabe8d4" Jun 10 00:37:51.186986 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:51.186959 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5zhlc" Jun 10 00:37:51.187137 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:51.186959 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:37:51.604354 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:51.604320 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-957rh" podUID="ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2" Jun 10 00:37:55.198378 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.198347 2577 generic.go:356] "Generic (PLEG): container finished" podID="4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f" containerID="8382dcaddb29600abb384908bce1c5a03c37a79e37cfc51f558d2eefd5e8af62" exitCode=255 Jun 10 00:37:55.198731 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.198397 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" event={"ID":"4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f","Type":"ContainerDied","Data":"8382dcaddb29600abb384908bce1c5a03c37a79e37cfc51f558d2eefd5e8af62"} Jun 10 00:37:55.206785 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.206766 2577 scope.go:117] "RemoveContainer" containerID="8382dcaddb29600abb384908bce1c5a03c37a79e37cfc51f558d2eefd5e8af62" Jun 10 00:37:55.757844 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.757809 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-f78lj"] Jun 10 00:37:55.759907 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.759891 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.762755 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.762717 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 00:37:55.762949 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.762934 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 00:37:55.763755 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.763736 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-96j6g\"" Jun 10 00:37:55.763864 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.763786 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 00:37:55.765448 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.765430 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 00:37:55.768004 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.767982 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 00:37:55.778293 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.778264 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-f78lj"] Jun 10 00:37:55.824490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.824456 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c8ea57d-a827-45d8-9418-b3cee86b69b5-serving-cert\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.824490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.824492 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1c8ea57d-a827-45d8-9418-b3cee86b69b5-snapshots\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.824693 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.824599 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c8ea57d-a827-45d8-9418-b3cee86b69b5-tmp\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.824693 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.824632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c8ea57d-a827-45d8-9418-b3cee86b69b5-service-ca-bundle\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.824693 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.824670 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c8ea57d-a827-45d8-9418-b3cee86b69b5-trusted-ca-bundle\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.824693 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.824686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s9pc\" (UniqueName: \"kubernetes.io/projected/1c8ea57d-a827-45d8-9418-b3cee86b69b5-kube-api-access-2s9pc\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.858540 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.858510 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-f4d5c5585-pngc5"] Jun 10 00:37:55.860621 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.860596 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:55.863357 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.863340 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 10 00:37:55.863482 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.863460 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 00:37:55.863642 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.863623 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 10 00:37:55.863854 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.863821 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zmlxx\"" Jun 10 00:37:55.863970 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.863829 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 10 00:37:55.864183 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.864166 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 10 00:37:55.864298 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.864232 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 00:37:55.875147 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.875122 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f4d5c5585-pngc5"] Jun 10 00:37:55.925492 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.925461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1c8ea57d-a827-45d8-9418-b3cee86b69b5-snapshots\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.925492 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.925493 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-default-certificate\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:55.925713 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.925540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c8ea57d-a827-45d8-9418-b3cee86b69b5-trusted-ca-bundle\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.925713 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.925561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s9pc\" (UniqueName: \"kubernetes.io/projected/1c8ea57d-a827-45d8-9418-b3cee86b69b5-kube-api-access-2s9pc\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.925713 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.925612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c8ea57d-a827-45d8-9418-b3cee86b69b5-serving-cert\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.925713 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.925648 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:55.925877 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.925740 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l69kq\" (UniqueName: \"kubernetes.io/projected/8a6490e7-05a3-45a3-a080-4e2306c47840-kube-api-access-l69kq\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:55.925877 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.925797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-stats-auth\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:55.925877 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.925834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c8ea57d-a827-45d8-9418-b3cee86b69b5-tmp\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.925877 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.925853 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c8ea57d-a827-45d8-9418-b3cee86b69b5-service-ca-bundle\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.926054 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.925879 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:55.926150 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.926126 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1c8ea57d-a827-45d8-9418-b3cee86b69b5-snapshots\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.926298 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.926151 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c8ea57d-a827-45d8-9418-b3cee86b69b5-tmp\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.926428 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.926405 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c8ea57d-a827-45d8-9418-b3cee86b69b5-service-ca-bundle\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.926565 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.926549 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c8ea57d-a827-45d8-9418-b3cee86b69b5-trusted-ca-bundle\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.927860 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.927828 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c8ea57d-a827-45d8-9418-b3cee86b69b5-serving-cert\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.935702 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.935679 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s9pc\" (UniqueName: \"kubernetes.io/projected/1c8ea57d-a827-45d8-9418-b3cee86b69b5-kube-api-access-2s9pc\") pod \"insights-operator-896549976-f78lj\" (UID: \"1c8ea57d-a827-45d8-9418-b3cee86b69b5\") " pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:55.955761 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.955742 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2"] Jun 10 00:37:55.957692 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.957679 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2" Jun 10 00:37:55.960300 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.960281 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 10 00:37:55.960405 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.960340 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wgjks\"" Jun 10 00:37:55.960405 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.960365 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 10 00:37:55.960589 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.960575 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 10 00:37:55.966511 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:55.966486 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2"] Jun 10 00:37:56.026886 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.026800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-stats-auth\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:56.026886 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.026838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:37:56.026886 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.026867 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:56.026886 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.026887 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-default-certificate\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:56.027231 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.026918 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ljnl2\" (UID: \"d7f747ad-5619-4ed6-9e20-0b479efb906c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2" Jun 10 00:37:56.027231 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.026951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:37:56.027231 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.026999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:56.027231 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:56.027032 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle podName:8a6490e7-05a3-45a3-a080-4e2306c47840 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:56.527009276 +0000 UTC m=+163.350915113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle") pod "router-default-f4d5c5585-pngc5" (UID: "8a6490e7-05a3-45a3-a080-4e2306c47840") : configmap references non-existent config key: service-ca.crt Jun 10 00:37:56.027231 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.027065 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l69kq\" (UniqueName: \"kubernetes.io/projected/8a6490e7-05a3-45a3-a080-4e2306c47840-kube-api-access-l69kq\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:56.027231 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:56.027073 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 00:37:56.027231 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:56.027075 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 00:37:56.027231 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:56.027096 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74978b5b5d-slrwd: secret "image-registry-tls" not found Jun 10 00:37:56.027231 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:56.027101 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 00:37:56.027231 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:56.027115 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs podName:8a6490e7-05a3-45a3-a080-4e2306c47840 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:56.52710189 +0000 UTC m=+163.351007737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs") pod "router-default-f4d5c5585-pngc5" (UID: "8a6490e7-05a3-45a3-a080-4e2306c47840") : secret "router-metrics-certs-default" not found Jun 10 00:37:56.027231 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.027099 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frg7k\" (UniqueName: \"kubernetes.io/projected/d7f747ad-5619-4ed6-9e20-0b479efb906c-kube-api-access-frg7k\") pod \"cluster-samples-operator-854f8b96b6-ljnl2\" (UID: \"d7f747ad-5619-4ed6-9e20-0b479efb906c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2" Jun 10 00:37:56.027231 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:56.027140 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls podName:6a7a514e-dd73-4c2a-8a22-a291c6cd0b17 nodeName:}" failed. No retries permitted until 2026-06-10 00:39:58.027123757 +0000 UTC m=+284.851029594 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls") pod "image-registry-74978b5b5d-slrwd" (UID: "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17") : secret "image-registry-tls" not found Jun 10 00:37:56.027231 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:56.027165 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls podName:ad7c9a9b-90a0-4731-9879-86b04dabe8d4 nodeName:}" failed. No retries permitted until 2026-06-10 00:39:58.027155965 +0000 UTC m=+284.851061802 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls") pod "dns-default-5zhlc" (UID: "ad7c9a9b-90a0-4731-9879-86b04dabe8d4") : secret "dns-default-metrics-tls" not found Jun 10 00:37:56.029313 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.029285 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-stats-auth\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:56.029415 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.029331 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-default-certificate\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:56.035194 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.035172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l69kq\" (UniqueName: \"kubernetes.io/projected/8a6490e7-05a3-45a3-a080-4e2306c47840-kube-api-access-l69kq\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:56.068903 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.068877 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-f78lj" Jun 10 00:37:56.127851 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.127804 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ljnl2\" (UID: \"d7f747ad-5619-4ed6-9e20-0b479efb906c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2" Jun 10 00:37:56.128013 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.127961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frg7k\" (UniqueName: \"kubernetes.io/projected/d7f747ad-5619-4ed6-9e20-0b479efb906c-kube-api-access-frg7k\") pod \"cluster-samples-operator-854f8b96b6-ljnl2\" (UID: \"d7f747ad-5619-4ed6-9e20-0b479efb906c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2" Jun 10 00:37:56.128086 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:56.128028 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 00:37:56.128142 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:56.128095 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls podName:d7f747ad-5619-4ed6-9e20-0b479efb906c nodeName:}" failed. No retries permitted until 2026-06-10 00:37:56.628077125 +0000 UTC m=+163.451982964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ljnl2" (UID: "d7f747ad-5619-4ed6-9e20-0b479efb906c") : secret "samples-operator-tls" not found Jun 10 00:37:56.136329 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.136303 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frg7k\" (UniqueName: \"kubernetes.io/projected/d7f747ad-5619-4ed6-9e20-0b479efb906c-kube-api-access-frg7k\") pod \"cluster-samples-operator-854f8b96b6-ljnl2\" (UID: \"d7f747ad-5619-4ed6-9e20-0b479efb906c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2" Jun 10 00:37:56.185520 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.185493 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-f78lj"] Jun 10 00:37:56.188031 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:37:56.188004 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c8ea57d_a827_45d8_9418_b3cee86b69b5.slice/crio-febd15cc085d4e33eb9f929fe18ab6e3435e34abea877cb5731c8e7a96173574 WatchSource:0}: Error finding container febd15cc085d4e33eb9f929fe18ab6e3435e34abea877cb5731c8e7a96173574: Status 404 returned error can't find the container with id febd15cc085d4e33eb9f929fe18ab6e3435e34abea877cb5731c8e7a96173574 Jun 10 00:37:56.202897 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.202866 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-f78lj" event={"ID":"1c8ea57d-a827-45d8-9418-b3cee86b69b5","Type":"ContainerStarted","Data":"febd15cc085d4e33eb9f929fe18ab6e3435e34abea877cb5731c8e7a96173574"} Jun 10 00:37:56.205059 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.205035 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" event={"ID":"4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f","Type":"ContainerStarted","Data":"7524f85993a19b29e8c76ee957075aae56f0cffde7306aa9100a18125cfe1452"} Jun 10 00:37:56.531454 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.531400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:56.531731 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.531500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:56.531731 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:56.531591 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 00:37:56.531731 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:56.531605 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle podName:8a6490e7-05a3-45a3-a080-4e2306c47840 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:57.531586145 +0000 UTC m=+164.355491981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle") pod "router-default-f4d5c5585-pngc5" (UID: "8a6490e7-05a3-45a3-a080-4e2306c47840") : configmap references non-existent config key: service-ca.crt Jun 10 00:37:56.531731 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:56.531632 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs podName:8a6490e7-05a3-45a3-a080-4e2306c47840 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:57.531624948 +0000 UTC m=+164.355530783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs") pod "router-default-f4d5c5585-pngc5" (UID: "8a6490e7-05a3-45a3-a080-4e2306c47840") : secret "router-metrics-certs-default" not found Jun 10 00:37:56.632330 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:56.632292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ljnl2\" (UID: \"d7f747ad-5619-4ed6-9e20-0b479efb906c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2" Jun 10 00:37:56.632485 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:56.632428 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 00:37:56.632485 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:56.632479 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls podName:d7f747ad-5619-4ed6-9e20-0b479efb906c nodeName:}" failed. No retries permitted until 2026-06-10 00:37:57.632468165 +0000 UTC m=+164.456374006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ljnl2" (UID: "d7f747ad-5619-4ed6-9e20-0b479efb906c") : secret "samples-operator-tls" not found Jun 10 00:37:57.539119 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:57.539080 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:57.539557 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:57.539138 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:57.539557 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:57.539266 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle podName:8a6490e7-05a3-45a3-a080-4e2306c47840 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:59.539253849 +0000 UTC m=+166.363159685 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle") pod "router-default-f4d5c5585-pngc5" (UID: "8a6490e7-05a3-45a3-a080-4e2306c47840") : configmap references non-existent config key: service-ca.crt Jun 10 00:37:57.539557 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:57.539266 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 00:37:57.539557 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:57.539335 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs podName:8a6490e7-05a3-45a3-a080-4e2306c47840 nodeName:}" failed. No retries permitted until 2026-06-10 00:37:59.539316574 +0000 UTC m=+166.363222410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs") pod "router-default-f4d5c5585-pngc5" (UID: "8a6490e7-05a3-45a3-a080-4e2306c47840") : secret "router-metrics-certs-default" not found Jun 10 00:37:57.640438 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:57.640405 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ljnl2\" (UID: \"d7f747ad-5619-4ed6-9e20-0b479efb906c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2" Jun 10 00:37:57.640579 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:57.640547 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 00:37:57.640619 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:57.640607 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls podName:d7f747ad-5619-4ed6-9e20-0b479efb906c nodeName:}" failed. No retries permitted until 2026-06-10 00:37:59.640593161 +0000 UTC m=+166.464499000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ljnl2" (UID: "d7f747ad-5619-4ed6-9e20-0b479efb906c") : secret "samples-operator-tls" not found Jun 10 00:37:59.217803 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:59.217769 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-f78lj" event={"ID":"1c8ea57d-a827-45d8-9418-b3cee86b69b5","Type":"ContainerStarted","Data":"d02c0580eec2642f65e2444980b7171755002261af2d56e028df0133af3553f0"} Jun 10 00:37:59.234361 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:59.234316 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-f78lj" podStartSLOduration=2.130651883 podStartE2EDuration="4.234301929s" totalImagesPullingTime="2.103650046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:37:59.233445332 +0000 UTC m=+166.057351192" watchObservedRunningTime="2026-06-10 00:37:59.234301929 +0000 UTC m=+166.058207787" Jun 10 00:37:59.557947 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:59.557858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:59.557947 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:59.557913 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:37:59.558132 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:59.558008 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 00:37:59.558132 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:59.558020 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle podName:8a6490e7-05a3-45a3-a080-4e2306c47840 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:03.558006545 +0000 UTC m=+170.381912381 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle") pod "router-default-f4d5c5585-pngc5" (UID: "8a6490e7-05a3-45a3-a080-4e2306c47840") : configmap references non-existent config key: service-ca.crt Jun 10 00:37:59.558132 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:59.558082 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs podName:8a6490e7-05a3-45a3-a080-4e2306c47840 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:03.55806905 +0000 UTC m=+170.381974890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs") pod "router-default-f4d5c5585-pngc5" (UID: "8a6490e7-05a3-45a3-a080-4e2306c47840") : secret "router-metrics-certs-default" not found Jun 10 00:37:59.658429 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:37:59.658396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ljnl2\" (UID: \"d7f747ad-5619-4ed6-9e20-0b479efb906c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2" Jun 10 00:37:59.658589 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:59.658544 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 00:37:59.658633 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:37:59.658627 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls podName:d7f747ad-5619-4ed6-9e20-0b479efb906c nodeName:}" failed. No retries permitted until 2026-06-10 00:38:03.658594365 +0000 UTC m=+170.482500206 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ljnl2" (UID: "d7f747ad-5619-4ed6-9e20-0b479efb906c") : secret "samples-operator-tls" not found Jun 10 00:38:00.620032 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:00.620007 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4s4hx_89d37dfe-78b5-4500-acd0-6cca4e681d0e/dns-node-resolver/0.log" Jun 10 00:38:02.020000 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:02.019918 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vs4nb_ed5d0b4d-14e2-4195-80bd-b21fa955dc69/node-ca/0.log" Jun 10 00:38:02.419865 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:02.419777 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2zvxw_f1e34cf6-3e84-46d9-9255-e1adae9cb707/serve-healthcheck-canary/0.log" Jun 10 00:38:03.588397 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.588348 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:38:03.588781 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.588417 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:38:03.588781 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:38:03.588503 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 00:38:03.588781 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:38:03.588526 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle podName:8a6490e7-05a3-45a3-a080-4e2306c47840 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:11.588510112 +0000 UTC m=+178.412415952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle") pod "router-default-f4d5c5585-pngc5" (UID: "8a6490e7-05a3-45a3-a080-4e2306c47840") : configmap references non-existent config key: service-ca.crt Jun 10 00:38:03.588781 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:38:03.588553 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs podName:8a6490e7-05a3-45a3-a080-4e2306c47840 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:11.588540968 +0000 UTC m=+178.412446803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs") pod "router-default-f4d5c5585-pngc5" (UID: "8a6490e7-05a3-45a3-a080-4e2306c47840") : secret "router-metrics-certs-default" not found Jun 10 00:38:03.634768 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.634737 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-rxqps"] Jun 10 00:38:03.636441 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.636427 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-rxqps" Jun 10 00:38:03.639994 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.639971 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 10 00:38:03.640115 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.639993 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 10 00:38:03.640115 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.640014 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 10 00:38:03.641320 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.641301 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 10 00:38:03.641374 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.641311 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-n9mpm\"" Jun 10 00:38:03.649016 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.648991 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-rxqps"] Jun 10 00:38:03.689616 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.689583 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ljnl2\" (UID: \"d7f747ad-5619-4ed6-9e20-0b479efb906c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2" Jun 10 00:38:03.689795 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:38:03.689732 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 00:38:03.689795 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.689769 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/48bd8ef2-f20f-4073-8a37-111ccff644be-signing-key\") pod \"service-ca-7d74d578b8-rxqps\" (UID: \"48bd8ef2-f20f-4073-8a37-111ccff644be\") " pod="openshift-service-ca/service-ca-7d74d578b8-rxqps" Jun 10 00:38:03.689894 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:38:03.689800 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls podName:d7f747ad-5619-4ed6-9e20-0b479efb906c nodeName:}" failed. No retries permitted until 2026-06-10 00:38:11.689779588 +0000 UTC m=+178.513685429 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ljnl2" (UID: "d7f747ad-5619-4ed6-9e20-0b479efb906c") : secret "samples-operator-tls" not found Jun 10 00:38:03.689942 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.689926 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlj5j\" (UniqueName: \"kubernetes.io/projected/48bd8ef2-f20f-4073-8a37-111ccff644be-kube-api-access-qlj5j\") pod \"service-ca-7d74d578b8-rxqps\" (UID: \"48bd8ef2-f20f-4073-8a37-111ccff644be\") " pod="openshift-service-ca/service-ca-7d74d578b8-rxqps" Jun 10 00:38:03.689980 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.689952 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/48bd8ef2-f20f-4073-8a37-111ccff644be-signing-cabundle\") pod \"service-ca-7d74d578b8-rxqps\" (UID: \"48bd8ef2-f20f-4073-8a37-111ccff644be\") " pod="openshift-service-ca/service-ca-7d74d578b8-rxqps" Jun 10 00:38:03.790912 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.790878 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/48bd8ef2-f20f-4073-8a37-111ccff644be-signing-key\") pod \"service-ca-7d74d578b8-rxqps\" (UID: \"48bd8ef2-f20f-4073-8a37-111ccff644be\") " pod="openshift-service-ca/service-ca-7d74d578b8-rxqps" Jun 10 00:38:03.791036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.790942 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlj5j\" (UniqueName: \"kubernetes.io/projected/48bd8ef2-f20f-4073-8a37-111ccff644be-kube-api-access-qlj5j\") pod \"service-ca-7d74d578b8-rxqps\" (UID: \"48bd8ef2-f20f-4073-8a37-111ccff644be\") " pod="openshift-service-ca/service-ca-7d74d578b8-rxqps" Jun 10 00:38:03.791036 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.790964 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/48bd8ef2-f20f-4073-8a37-111ccff644be-signing-cabundle\") pod \"service-ca-7d74d578b8-rxqps\" (UID: \"48bd8ef2-f20f-4073-8a37-111ccff644be\") " pod="openshift-service-ca/service-ca-7d74d578b8-rxqps" Jun 10 00:38:03.791629 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.791609 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/48bd8ef2-f20f-4073-8a37-111ccff644be-signing-cabundle\") pod \"service-ca-7d74d578b8-rxqps\" (UID: \"48bd8ef2-f20f-4073-8a37-111ccff644be\") " pod="openshift-service-ca/service-ca-7d74d578b8-rxqps" Jun 10 00:38:03.793395 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.793374 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/48bd8ef2-f20f-4073-8a37-111ccff644be-signing-key\") pod \"service-ca-7d74d578b8-rxqps\" (UID: \"48bd8ef2-f20f-4073-8a37-111ccff644be\") " pod="openshift-service-ca/service-ca-7d74d578b8-rxqps" Jun 10 00:38:03.799260 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.799232 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlj5j\" (UniqueName: \"kubernetes.io/projected/48bd8ef2-f20f-4073-8a37-111ccff644be-kube-api-access-qlj5j\") pod \"service-ca-7d74d578b8-rxqps\" (UID: \"48bd8ef2-f20f-4073-8a37-111ccff644be\") " pod="openshift-service-ca/service-ca-7d74d578b8-rxqps" Jun 10 00:38:03.944613 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:03.944592 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-rxqps" Jun 10 00:38:04.064235 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:04.064183 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-rxqps"] Jun 10 00:38:04.067089 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:38:04.067062 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48bd8ef2_f20f_4073_8a37_111ccff644be.slice/crio-186e9aef80ad9132e198f4fce8fc31dcf662b41a4f7b880ddf1de5ba5437f618 WatchSource:0}: Error finding container 186e9aef80ad9132e198f4fce8fc31dcf662b41a4f7b880ddf1de5ba5437f618: Status 404 returned error can't find the container with id 186e9aef80ad9132e198f4fce8fc31dcf662b41a4f7b880ddf1de5ba5437f618 Jun 10 00:38:04.234716 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:04.234625 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-rxqps" event={"ID":"48bd8ef2-f20f-4073-8a37-111ccff644be","Type":"ContainerStarted","Data":"186e9aef80ad9132e198f4fce8fc31dcf662b41a4f7b880ddf1de5ba5437f618"} Jun 10 00:38:04.593875 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:04.593794 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:38:06.242649 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:06.242614 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-rxqps" event={"ID":"48bd8ef2-f20f-4073-8a37-111ccff644be","Type":"ContainerStarted","Data":"17344c89fdb273114084dd4490bc72b6d1e6e6d636f5892ce068c9434a7e8da3"} Jun 10 00:38:06.258869 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:06.258812 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-rxqps" podStartSLOduration=1.186753686 podStartE2EDuration="3.258796593s" totalImagesPullingTime="2.072042907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:06.257671255 +0000 UTC m=+173.081577112" watchObservedRunningTime="2026-06-10 00:38:06.258796593 +0000 UTC m=+173.082702450" Jun 10 00:38:11.656363 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:11.656323 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:38:11.656772 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:11.656419 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:38:11.656772 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:38:11.656495 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle podName:8a6490e7-05a3-45a3-a080-4e2306c47840 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:27.656475269 +0000 UTC m=+194.480381108 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle") pod "router-default-f4d5c5585-pngc5" (UID: "8a6490e7-05a3-45a3-a080-4e2306c47840") : configmap references non-existent config key: service-ca.crt Jun 10 00:38:11.656772 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:38:11.656528 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 00:38:11.656772 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:38:11.656573 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs podName:8a6490e7-05a3-45a3-a080-4e2306c47840 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:27.656561908 +0000 UTC m=+194.480467744 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs") pod "router-default-f4d5c5585-pngc5" (UID: "8a6490e7-05a3-45a3-a080-4e2306c47840") : secret "router-metrics-certs-default" not found Jun 10 00:38:11.757670 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:11.757625 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ljnl2\" (UID: \"d7f747ad-5619-4ed6-9e20-0b479efb906c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2" Jun 10 00:38:11.760098 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:11.760072 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7f747ad-5619-4ed6-9e20-0b479efb906c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ljnl2\" (UID: \"d7f747ad-5619-4ed6-9e20-0b479efb906c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2" Jun 10 00:38:11.866520 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:11.866495 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2" Jun 10 00:38:11.988755 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:11.988727 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2"] Jun 10 00:38:12.262034 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:12.262000 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2" event={"ID":"d7f747ad-5619-4ed6-9e20-0b479efb906c","Type":"ContainerStarted","Data":"b52bd18d0205df2d8aa692a90ab6691cbaf5bd72d1c92c16800fca12fbddd360"} Jun 10 00:38:15.272866 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:15.272831 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2" event={"ID":"d7f747ad-5619-4ed6-9e20-0b479efb906c","Type":"ContainerStarted","Data":"d85b3ee8cdf16129e7d6951711122434fab5de1754313baea54bd302a8d981f8"} Jun 10 00:38:15.273369 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:15.272880 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2" event={"ID":"d7f747ad-5619-4ed6-9e20-0b479efb906c","Type":"ContainerStarted","Data":"ed1cc904cce5a46887b165f7a6411144a08df676aa92c1f3c4b4236423258f55"} Jun 10 00:38:15.288374 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:15.288326 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ljnl2" podStartSLOduration=17.92240647 podStartE2EDuration="20.288310624s" totalImagesPullingTime="2.365904154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:15.287577957 +0000 UTC m=+182.111483826" watchObservedRunningTime="2026-06-10 00:38:15.288310624 +0000 UTC m=+182.112216460" Jun 10 00:38:22.289716 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.289685 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-gdlrx"] Jun 10 00:38:22.295085 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.295066 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rqr7x"] Jun 10 00:38:22.295283 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.295216 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-gdlrx" Jun 10 00:38:22.298746 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.298725 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rqr7x" Jun 10 00:38:22.298859 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.298750 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 00:38:22.298859 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.298770 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xz8g2\"" Jun 10 00:38:22.298978 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.298882 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 00:38:22.301464 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.301443 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7l2vh\"" Jun 10 00:38:22.301655 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.301628 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 00:38:22.302410 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.302395 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 00:38:22.307891 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.307867 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-gdlrx"] Jun 10 00:38:22.310364 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.310347 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rqr7x"] Jun 10 00:38:22.446046 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.446011 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r78nh\" (UniqueName: \"kubernetes.io/projected/d482d069-9bae-4693-845b-dee273c9eb18-kube-api-access-r78nh\") pod \"insights-runtime-extractor-rqr7x\" (UID: \"d482d069-9bae-4693-845b-dee273c9eb18\") " pod="openshift-insights/insights-runtime-extractor-rqr7x" Jun 10 00:38:22.446233 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.446069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nw8j\" (UniqueName: \"kubernetes.io/projected/3d133a50-44da-4220-a81d-94f7790b6da8-kube-api-access-7nw8j\") pod \"downloads-6657875f97-gdlrx\" (UID: \"3d133a50-44da-4220-a81d-94f7790b6da8\") " pod="openshift-console/downloads-6657875f97-gdlrx" Jun 10 00:38:22.446233 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.446149 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d482d069-9bae-4693-845b-dee273c9eb18-crio-socket\") pod \"insights-runtime-extractor-rqr7x\" (UID: \"d482d069-9bae-4693-845b-dee273c9eb18\") " pod="openshift-insights/insights-runtime-extractor-rqr7x" Jun 10 00:38:22.446312 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.446236 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d482d069-9bae-4693-845b-dee273c9eb18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rqr7x\" (UID: \"d482d069-9bae-4693-845b-dee273c9eb18\") " pod="openshift-insights/insights-runtime-extractor-rqr7x" Jun 10 00:38:22.446312 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.446266 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d482d069-9bae-4693-845b-dee273c9eb18-data-volume\") pod \"insights-runtime-extractor-rqr7x\" (UID: \"d482d069-9bae-4693-845b-dee273c9eb18\") " pod="openshift-insights/insights-runtime-extractor-rqr7x" Jun 10 00:38:22.446312 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.446283 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d482d069-9bae-4693-845b-dee273c9eb18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rqr7x\" (UID: \"d482d069-9bae-4693-845b-dee273c9eb18\") " pod="openshift-insights/insights-runtime-extractor-rqr7x" Jun 10 00:38:22.547496 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.547406 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d482d069-9bae-4693-845b-dee273c9eb18-crio-socket\") pod \"insights-runtime-extractor-rqr7x\" (UID: \"d482d069-9bae-4693-845b-dee273c9eb18\") " pod="openshift-insights/insights-runtime-extractor-rqr7x" Jun 10 00:38:22.547496 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.547473 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d482d069-9bae-4693-845b-dee273c9eb18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rqr7x\" (UID: \"d482d069-9bae-4693-845b-dee273c9eb18\") " pod="openshift-insights/insights-runtime-extractor-rqr7x" Jun 10 00:38:22.547689 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.547506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d482d069-9bae-4693-845b-dee273c9eb18-data-volume\") pod \"insights-runtime-extractor-rqr7x\" (UID: \"d482d069-9bae-4693-845b-dee273c9eb18\") " pod="openshift-insights/insights-runtime-extractor-rqr7x" Jun 10 00:38:22.547689 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.547524 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d482d069-9bae-4693-845b-dee273c9eb18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rqr7x\" (UID: \"d482d069-9bae-4693-845b-dee273c9eb18\") " pod="openshift-insights/insights-runtime-extractor-rqr7x" Jun 10 00:38:22.547689 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.547555 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r78nh\" (UniqueName: \"kubernetes.io/projected/d482d069-9bae-4693-845b-dee273c9eb18-kube-api-access-r78nh\") pod \"insights-runtime-extractor-rqr7x\" (UID: \"d482d069-9bae-4693-845b-dee273c9eb18\") " pod="openshift-insights/insights-runtime-extractor-rqr7x" Jun 10 00:38:22.547689 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.547610 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nw8j\" (UniqueName: \"kubernetes.io/projected/3d133a50-44da-4220-a81d-94f7790b6da8-kube-api-access-7nw8j\") pod \"downloads-6657875f97-gdlrx\" (UID: \"3d133a50-44da-4220-a81d-94f7790b6da8\") " pod="openshift-console/downloads-6657875f97-gdlrx" Jun 10 00:38:22.547689 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.547554 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d482d069-9bae-4693-845b-dee273c9eb18-crio-socket\") pod \"insights-runtime-extractor-rqr7x\" (UID: \"d482d069-9bae-4693-845b-dee273c9eb18\") " pod="openshift-insights/insights-runtime-extractor-rqr7x" Jun 10 00:38:22.547965 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.547930 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d482d069-9bae-4693-845b-dee273c9eb18-data-volume\") pod \"insights-runtime-extractor-rqr7x\" (UID: \"d482d069-9bae-4693-845b-dee273c9eb18\") " pod="openshift-insights/insights-runtime-extractor-rqr7x" Jun 10 00:38:22.548257 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.548239 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d482d069-9bae-4693-845b-dee273c9eb18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rqr7x\" (UID: \"d482d069-9bae-4693-845b-dee273c9eb18\") " pod="openshift-insights/insights-runtime-extractor-rqr7x" Jun 10 00:38:22.550030 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.550011 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d482d069-9bae-4693-845b-dee273c9eb18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rqr7x\" (UID: \"d482d069-9bae-4693-845b-dee273c9eb18\") " pod="openshift-insights/insights-runtime-extractor-rqr7x" Jun 10 00:38:22.555706 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.555682 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r78nh\" (UniqueName: \"kubernetes.io/projected/d482d069-9bae-4693-845b-dee273c9eb18-kube-api-access-r78nh\") pod \"insights-runtime-extractor-rqr7x\" (UID: \"d482d069-9bae-4693-845b-dee273c9eb18\") " pod="openshift-insights/insights-runtime-extractor-rqr7x" Jun 10 00:38:22.556111 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.556093 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nw8j\" (UniqueName: \"kubernetes.io/projected/3d133a50-44da-4220-a81d-94f7790b6da8-kube-api-access-7nw8j\") pod \"downloads-6657875f97-gdlrx\" (UID: \"3d133a50-44da-4220-a81d-94f7790b6da8\") " pod="openshift-console/downloads-6657875f97-gdlrx" Jun 10 00:38:22.605428 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.605395 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-gdlrx" Jun 10 00:38:22.611306 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.611277 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rqr7x" Jun 10 00:38:22.747852 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.747801 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-gdlrx"] Jun 10 00:38:22.752672 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:38:22.752643 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d133a50_44da_4220_a81d_94f7790b6da8.slice/crio-b1bbc81e3533e00eda386b3e17a40824a56881ecd64d3867055f9ea33e1b5eb5 WatchSource:0}: Error finding container b1bbc81e3533e00eda386b3e17a40824a56881ecd64d3867055f9ea33e1b5eb5: Status 404 returned error can't find the container with id b1bbc81e3533e00eda386b3e17a40824a56881ecd64d3867055f9ea33e1b5eb5 Jun 10 00:38:22.764093 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:22.764066 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rqr7x"] Jun 10 00:38:22.767822 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:38:22.767799 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd482d069_9bae_4693_845b_dee273c9eb18.slice/crio-bca51e22bd13f54f1de253437e3c0ad98803f4ecc0bcb2bb38f23aceb6559a48 WatchSource:0}: Error finding container bca51e22bd13f54f1de253437e3c0ad98803f4ecc0bcb2bb38f23aceb6559a48: Status 404 returned error can't find the container with id bca51e22bd13f54f1de253437e3c0ad98803f4ecc0bcb2bb38f23aceb6559a48 Jun 10 00:38:23.295093 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:23.295057 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-gdlrx" event={"ID":"3d133a50-44da-4220-a81d-94f7790b6da8","Type":"ContainerStarted","Data":"b1bbc81e3533e00eda386b3e17a40824a56881ecd64d3867055f9ea33e1b5eb5"} Jun 10 00:38:23.296504 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:23.296478 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rqr7x" event={"ID":"d482d069-9bae-4693-845b-dee273c9eb18","Type":"ContainerStarted","Data":"d5a5b3d8c71307036a63186f8821c8c01953216c182bf4d935ac8628215ffd16"} Jun 10 00:38:23.296612 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:23.296528 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rqr7x" event={"ID":"d482d069-9bae-4693-845b-dee273c9eb18","Type":"ContainerStarted","Data":"bca51e22bd13f54f1de253437e3c0ad98803f4ecc0bcb2bb38f23aceb6559a48"} Jun 10 00:38:24.302008 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:24.301976 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rqr7x" event={"ID":"d482d069-9bae-4693-845b-dee273c9eb18","Type":"ContainerStarted","Data":"c25c3f37e3f3b269485e0f4f7ef9cc733a989cd297d942aab77457f03f6d55cc"} Jun 10 00:38:26.312627 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:26.312580 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rqr7x" event={"ID":"d482d069-9bae-4693-845b-dee273c9eb18","Type":"ContainerStarted","Data":"bdeee68e652d82c0a7b46ce8cc3f8ead3d48014b1a8be91e95d3ac7f40a237f0"} Jun 10 00:38:26.331702 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:26.331647 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rqr7x" podStartSLOduration=1.820036888 podStartE2EDuration="4.331632307s" totalImagesPullingTime="2.511595419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:38:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:26.330856524 +0000 UTC m=+193.154762415" watchObservedRunningTime="2026-06-10 00:38:26.331632307 +0000 UTC m=+193.155538165" Jun 10 00:38:27.693108 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:27.693070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:38:27.693656 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:27.693159 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:38:27.693907 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:27.693880 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a6490e7-05a3-45a3-a080-4e2306c47840-service-ca-bundle\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:38:27.695693 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:27.695671 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a6490e7-05a3-45a3-a080-4e2306c47840-metrics-certs\") pod \"router-default-f4d5c5585-pngc5\" (UID: \"8a6490e7-05a3-45a3-a080-4e2306c47840\") " pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:38:27.972549 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:27.972474 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zmlxx\"" Jun 10 00:38:27.980734 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:27.980707 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:38:28.118773 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:28.118687 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f4d5c5585-pngc5"] Jun 10 00:38:28.121488 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:38:28.121456 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a6490e7_05a3_45a3_a080_4e2306c47840.slice/crio-3ee9f1e854881703942939388cf783ef9aa166a69b63ea4b009b5147243fddc4 WatchSource:0}: Error finding container 3ee9f1e854881703942939388cf783ef9aa166a69b63ea4b009b5147243fddc4: Status 404 returned error can't find the container with id 3ee9f1e854881703942939388cf783ef9aa166a69b63ea4b009b5147243fddc4 Jun 10 00:38:28.321462 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:28.321365 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f4d5c5585-pngc5" event={"ID":"8a6490e7-05a3-45a3-a080-4e2306c47840","Type":"ContainerStarted","Data":"20ed5d55e590262d04c18cde37b081225ff9ef98c087a2e13896c883998ee858"} Jun 10 00:38:28.321462 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:28.321429 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f4d5c5585-pngc5" event={"ID":"8a6490e7-05a3-45a3-a080-4e2306c47840","Type":"ContainerStarted","Data":"3ee9f1e854881703942939388cf783ef9aa166a69b63ea4b009b5147243fddc4"} Jun 10 00:38:28.339047 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:28.339000 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-f4d5c5585-pngc5" podStartSLOduration=33.338984276 podStartE2EDuration="33.338984276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:37:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:28.338312367 +0000 UTC m=+195.162218238" watchObservedRunningTime="2026-06-10 00:38:28.338984276 +0000 UTC m=+195.162890181" Jun 10 00:38:28.980866 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:28.980831 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:38:28.983826 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:28.983803 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:38:29.326583 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:29.326491 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:38:29.327856 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:29.327825 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-f4d5c5585-pngc5" Jun 10 00:38:30.818282 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:30.818239 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-jc74d"] Jun 10 00:38:30.820585 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:30.820561 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-jc74d" Jun 10 00:38:30.823214 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:30.823174 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 10 00:38:30.823325 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:30.823253 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qqcxm\"" Jun 10 00:38:30.827751 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:30.827694 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-jc74d"] Jun 10 00:38:30.921239 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:30.921185 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/553b8ef6-88de-4d3f-86f5-3bbe1f726d51-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-jc74d\" (UID: \"553b8ef6-88de-4d3f-86f5-3bbe1f726d51\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-jc74d" Jun 10 00:38:31.021899 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:31.021861 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/553b8ef6-88de-4d3f-86f5-3bbe1f726d51-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-jc74d\" (UID: \"553b8ef6-88de-4d3f-86f5-3bbe1f726d51\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-jc74d" Jun 10 00:38:31.022085 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:38:31.022045 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 10 00:38:31.022146 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:38:31.022119 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/553b8ef6-88de-4d3f-86f5-3bbe1f726d51-tls-certificates podName:553b8ef6-88de-4d3f-86f5-3bbe1f726d51 nodeName:}" failed. No retries permitted until 2026-06-10 00:38:31.522099958 +0000 UTC m=+198.346005805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/553b8ef6-88de-4d3f-86f5-3bbe1f726d51-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-jc74d" (UID: "553b8ef6-88de-4d3f-86f5-3bbe1f726d51") : secret "prometheus-operator-admission-webhook-tls" not found Jun 10 00:38:31.525923 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:31.525883 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/553b8ef6-88de-4d3f-86f5-3bbe1f726d51-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-jc74d\" (UID: \"553b8ef6-88de-4d3f-86f5-3bbe1f726d51\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-jc74d" Jun 10 00:38:31.528725 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:31.528698 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/553b8ef6-88de-4d3f-86f5-3bbe1f726d51-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-jc74d\" (UID: \"553b8ef6-88de-4d3f-86f5-3bbe1f726d51\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-jc74d" Jun 10 00:38:31.732125 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:31.732087 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-jc74d" Jun 10 00:38:31.849988 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:31.849956 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-jc74d"] Jun 10 00:38:31.853759 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:38:31.853731 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod553b8ef6_88de_4d3f_86f5_3bbe1f726d51.slice/crio-e121e3705085eb408bb43365ee2a11c88acbb62cca5064b95f31d7ea70304124 WatchSource:0}: Error finding container e121e3705085eb408bb43365ee2a11c88acbb62cca5064b95f31d7ea70304124: Status 404 returned error can't find the container with id e121e3705085eb408bb43365ee2a11c88acbb62cca5064b95f31d7ea70304124 Jun 10 00:38:32.338159 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:32.338119 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-jc74d" event={"ID":"553b8ef6-88de-4d3f-86f5-3bbe1f726d51","Type":"ContainerStarted","Data":"e121e3705085eb408bb43365ee2a11c88acbb62cca5064b95f31d7ea70304124"} Jun 10 00:38:33.343512 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:33.343435 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-jc74d" event={"ID":"553b8ef6-88de-4d3f-86f5-3bbe1f726d51","Type":"ContainerStarted","Data":"9fc6e929c948d66bec3816596bc736f9a8a20bac6a95f6c9d3d6a761af3b9947"} Jun 10 00:38:33.343992 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:33.343797 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-jc74d" Jun 10 00:38:33.349493 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:33.349469 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-jc74d" Jun 10 00:38:33.359242 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:33.359184 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-jc74d" podStartSLOduration=2.404899065 podStartE2EDuration="3.359167813s" totalImagesPullingTime="954.268748ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:33.358234455 +0000 UTC m=+200.182140315" watchObservedRunningTime="2026-06-10 00:38:33.359167813 +0000 UTC m=+200.183073672" Jun 10 00:38:33.880984 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:33.880948 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-9tb62"] Jun 10 00:38:33.883398 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:33.883356 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" Jun 10 00:38:33.885995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:33.885969 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6gjzv\"" Jun 10 00:38:33.886139 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:33.886010 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 10 00:38:33.887260 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:33.887135 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 00:38:33.887260 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:33.887193 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 00:38:33.887260 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:33.887239 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 00:38:33.887550 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:33.887221 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 10 00:38:33.893025 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:33.893001 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-9tb62"] Jun 10 00:38:34.044819 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:34.044781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f93ea029-e1fd-4677-b3bf-18c79a013822-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-9tb62\" (UID: \"f93ea029-e1fd-4677-b3bf-18c79a013822\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" Jun 10 00:38:34.045001 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:34.044873 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f93ea029-e1fd-4677-b3bf-18c79a013822-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-9tb62\" (UID: \"f93ea029-e1fd-4677-b3bf-18c79a013822\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" Jun 10 00:38:34.045001 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:34.044892 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f93ea029-e1fd-4677-b3bf-18c79a013822-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-9tb62\" (UID: \"f93ea029-e1fd-4677-b3bf-18c79a013822\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" Jun 10 00:38:34.045001 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:34.044914 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rw5r\" (UniqueName: \"kubernetes.io/projected/f93ea029-e1fd-4677-b3bf-18c79a013822-kube-api-access-8rw5r\") pod \"prometheus-operator-7f7d445d84-9tb62\" (UID: \"f93ea029-e1fd-4677-b3bf-18c79a013822\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" Jun 10 00:38:34.146192 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:34.146104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f93ea029-e1fd-4677-b3bf-18c79a013822-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-9tb62\" (UID: \"f93ea029-e1fd-4677-b3bf-18c79a013822\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" Jun 10 00:38:34.146192 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:34.146156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f93ea029-e1fd-4677-b3bf-18c79a013822-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-9tb62\" (UID: \"f93ea029-e1fd-4677-b3bf-18c79a013822\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" Jun 10 00:38:34.146439 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:34.146193 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rw5r\" (UniqueName: \"kubernetes.io/projected/f93ea029-e1fd-4677-b3bf-18c79a013822-kube-api-access-8rw5r\") pod \"prometheus-operator-7f7d445d84-9tb62\" (UID: \"f93ea029-e1fd-4677-b3bf-18c79a013822\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" Jun 10 00:38:34.146439 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:34.146273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f93ea029-e1fd-4677-b3bf-18c79a013822-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-9tb62\" (UID: \"f93ea029-e1fd-4677-b3bf-18c79a013822\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" Jun 10 00:38:34.146979 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:34.146950 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f93ea029-e1fd-4677-b3bf-18c79a013822-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-9tb62\" (UID: \"f93ea029-e1fd-4677-b3bf-18c79a013822\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" Jun 10 00:38:34.148886 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:34.148859 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f93ea029-e1fd-4677-b3bf-18c79a013822-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-9tb62\" (UID: \"f93ea029-e1fd-4677-b3bf-18c79a013822\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" Jun 10 00:38:34.149146 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:34.149126 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f93ea029-e1fd-4677-b3bf-18c79a013822-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-9tb62\" (UID: \"f93ea029-e1fd-4677-b3bf-18c79a013822\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" Jun 10 00:38:34.153977 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:34.153954 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rw5r\" (UniqueName: \"kubernetes.io/projected/f93ea029-e1fd-4677-b3bf-18c79a013822-kube-api-access-8rw5r\") pod \"prometheus-operator-7f7d445d84-9tb62\" (UID: \"f93ea029-e1fd-4677-b3bf-18c79a013822\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" Jun 10 00:38:34.193408 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:34.193378 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" Jun 10 00:38:34.318866 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:34.318814 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-9tb62"] Jun 10 00:38:34.321258 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:38:34.321230 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93ea029_e1fd_4677_b3bf_18c79a013822.slice/crio-411d21d121c298df6211dd1c19dd4242e7922a51c44deb459b3eb602f4417d6a WatchSource:0}: Error finding container 411d21d121c298df6211dd1c19dd4242e7922a51c44deb459b3eb602f4417d6a: Status 404 returned error can't find the container with id 411d21d121c298df6211dd1c19dd4242e7922a51c44deb459b3eb602f4417d6a Jun 10 00:38:34.348100 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:34.348071 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" event={"ID":"f93ea029-e1fd-4677-b3bf-18c79a013822","Type":"ContainerStarted","Data":"411d21d121c298df6211dd1c19dd4242e7922a51c44deb459b3eb602f4417d6a"} Jun 10 00:38:36.357114 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:36.357079 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" event={"ID":"f93ea029-e1fd-4677-b3bf-18c79a013822","Type":"ContainerStarted","Data":"9ba398135da2374c01f51baf78f3214a7c7793616248eac917d0425544434eba"} Jun 10 00:38:36.357491 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:36.357129 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" event={"ID":"f93ea029-e1fd-4677-b3bf-18c79a013822","Type":"ContainerStarted","Data":"ae2f023160f8bc5fbe0b3b3564cab61b1f2537a9a334eb27b3f52a2d899b12d1"} Jun 10 00:38:36.372708 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:36.372668 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-9tb62" podStartSLOduration=1.764049773 podStartE2EDuration="3.372654953s" totalImagesPullingTime="1.60860518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:36.371372504 +0000 UTC m=+203.195278398" watchObservedRunningTime="2026-06-10 00:38:36.372654953 +0000 UTC m=+203.196560810" Jun 10 00:38:38.230383 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.230344 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv"] Jun 10 00:38:38.234185 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.234162 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.236794 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.236767 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 10 00:38:38.238219 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.238183 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 10 00:38:38.238639 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.238289 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-22gb8\"" Jun 10 00:38:38.238639 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.238432 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 10 00:38:38.241310 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.241287 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x9pb4"] Jun 10 00:38:38.245945 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.245889 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv"] Jun 10 00:38:38.246053 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.246034 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.250378 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.249789 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c5gdb\"" Jun 10 00:38:38.250378 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.249846 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 00:38:38.250378 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.250090 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 00:38:38.250378 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.250319 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 00:38:38.281837 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.281181 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-metrics-client-ca\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.281837 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.281243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.281837 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.281277 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.281837 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.281323 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-sys\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.281837 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.281347 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.281837 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.281370 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.281837 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.281393 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-textfile\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.281837 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.281426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-tls\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.281837 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.281471 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.281837 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.281503 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-accelerators-collector-config\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.281837 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.281537 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-wtmp\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.281837 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.281571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.281837 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.281592 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-root\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.281837 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.281620 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8xdf\" (UniqueName: \"kubernetes.io/projected/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-kube-api-access-k8xdf\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.281837 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.281643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrgsw\" (UniqueName: \"kubernetes.io/projected/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-kube-api-access-hrgsw\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.382175 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.382137 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.382367 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.382184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-accelerators-collector-config\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.382367 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.382238 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-wtmp\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.382367 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.382267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.382367 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.382291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-root\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.382367 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.382316 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8xdf\" (UniqueName: \"kubernetes.io/projected/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-kube-api-access-k8xdf\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.382367 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.382339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrgsw\" (UniqueName: \"kubernetes.io/projected/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-kube-api-access-hrgsw\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.382680 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.382421 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-metrics-client-ca\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.382680 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.382448 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.382680 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.382476 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.382680 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.382518 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-sys\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.382680 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.382540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.382680 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.382562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.382680 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.382584 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-textfile\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.382680 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.382606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-tls\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.383081 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:38:38.382733 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 00:38:38.383081 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:38:38.382785 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-tls podName:3cd74bd0-98f9-4ae1-98a4-f6f8b063266b nodeName:}" failed. No retries permitted until 2026-06-10 00:38:38.882768527 +0000 UTC m=+205.706674370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-tls") pod "node-exporter-x9pb4" (UID: "3cd74bd0-98f9-4ae1-98a4-f6f8b063266b") : secret "node-exporter-tls" not found Jun 10 00:38:38.383081 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.382969 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.383573 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.383548 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-accelerators-collector-config\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.383693 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.383636 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.383693 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.383644 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-textfile\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.383884 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.383706 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-sys\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.383884 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.383751 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-root\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.383884 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.383868 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-wtmp\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.384515 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.384111 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.384715 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.384694 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-metrics-client-ca\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.386332 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.386309 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.387248 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.387191 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.387330 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.387261 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.392064 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.392024 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8xdf\" (UniqueName: \"kubernetes.io/projected/e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f-kube-api-access-k8xdf\") pod \"kube-state-metrics-57bbf8bfb5-znpgv\" (UID: \"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.392553 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.392467 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrgsw\" (UniqueName: \"kubernetes.io/projected/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-kube-api-access-hrgsw\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.548266 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.548170 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" Jun 10 00:38:38.727412 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.727380 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv"] Jun 10 00:38:38.731115 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:38:38.731082 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ebb2ff_f2c5_4bef_b311_ccd6f0d23f0f.slice/crio-43dd14a7fcd32856ace0f6bd9986ac3aef7a7028afe95ccc6fbfb83a2ad1123b WatchSource:0}: Error finding container 43dd14a7fcd32856ace0f6bd9986ac3aef7a7028afe95ccc6fbfb83a2ad1123b: Status 404 returned error can't find the container with id 43dd14a7fcd32856ace0f6bd9986ac3aef7a7028afe95ccc6fbfb83a2ad1123b Jun 10 00:38:38.885848 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:38.885752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-tls\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:38.886000 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:38:38.885906 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 00:38:38.886000 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:38:38.885971 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-tls podName:3cd74bd0-98f9-4ae1-98a4-f6f8b063266b nodeName:}" failed. No retries permitted until 2026-06-10 00:38:39.88595577 +0000 UTC m=+206.709861606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-tls") pod "node-exporter-x9pb4" (UID: "3cd74bd0-98f9-4ae1-98a4-f6f8b063266b") : secret "node-exporter-tls" not found Jun 10 00:38:39.302554 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.302453 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 00:38:39.319909 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.319763 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.328304 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.325232 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 00:38:39.328304 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.325310 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 00:38:39.328304 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.325481 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 00:38:39.328304 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.325655 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 00:38:39.328304 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.325672 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 00:38:39.328304 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.325860 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 00:38:39.328304 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.325884 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 00:38:39.328304 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.326095 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dqh4h\"" Jun 10 00:38:39.328304 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.326358 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 00:38:39.328304 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.326478 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 00:38:39.328304 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.326640 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 00:38:39.374330 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.374277 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" event={"ID":"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f","Type":"ContainerStarted","Data":"43dd14a7fcd32856ace0f6bd9986ac3aef7a7028afe95ccc6fbfb83a2ad1123b"} Jun 10 00:38:39.390710 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.390674 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.390857 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.390746 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.390857 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.390790 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-config-out\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.390857 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.390838 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.391037 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.390872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.391037 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.390908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.391037 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.391007 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.391184 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.391068 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-web-config\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.391184 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.391129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.391184 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.391164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.391382 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.391221 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.391382 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.391311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.391382 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.391352 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffvpw\" (UniqueName: \"kubernetes.io/projected/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-kube-api-access-ffvpw\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.492429 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.492392 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.492429 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.492443 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.492675 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.492480 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.492755 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.492668 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffvpw\" (UniqueName: \"kubernetes.io/projected/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-kube-api-access-ffvpw\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.492755 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.492719 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.492859 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.492774 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.492859 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.492801 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-config-out\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.492859 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.492851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.492965 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.492883 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.492965 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.492899 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.492965 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.492921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.493091 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.492973 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.493091 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.493023 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-web-config\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.493091 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.493048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.494091 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.494063 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.494709 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.494686 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.496352 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.496308 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-config-out\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.496958 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.496936 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.497306 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.497263 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.498372 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.498332 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-web-config\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.498527 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.498512 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.498811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.498757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.498811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.498796 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.498983 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.498893 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.499889 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.499868 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.503463 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.503442 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffvpw\" (UniqueName: \"kubernetes.io/projected/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-kube-api-access-ffvpw\") pod \"alertmanager-main-0\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.636070 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.635996 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:38:39.896137 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.896048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-tls\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:39.898760 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:39.898730 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3cd74bd0-98f9-4ae1-98a4-f6f8b063266b-node-exporter-tls\") pod \"node-exporter-x9pb4\" (UID: \"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b\") " pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:40.063613 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:40.063574 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x9pb4" Jun 10 00:38:46.657470 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:38:46.657426 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cd74bd0_98f9_4ae1_98a4_f6f8b063266b.slice/crio-ca1f848d896e89c7a9d81661f060e0042ef2ba6166b59efb5a93816dc0de5dcd WatchSource:0}: Error finding container ca1f848d896e89c7a9d81661f060e0042ef2ba6166b59efb5a93816dc0de5dcd: Status 404 returned error can't find the container with id ca1f848d896e89c7a9d81661f060e0042ef2ba6166b59efb5a93816dc0de5dcd Jun 10 00:38:46.794006 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:46.793906 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 00:38:47.419784 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:47.418822 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" event={"ID":"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f","Type":"ContainerStarted","Data":"6cd9e5f0b76b1b59ea11485b8ed8daae0f32ada882d0f351b1609113fb9f60d3"} Jun 10 00:38:47.419784 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:47.418896 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" event={"ID":"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f","Type":"ContainerStarted","Data":"be4020b40e4879dcc18b3a1faaeaa24d81d08c92a1b08b2f115e30574f17f805"} Jun 10 00:38:47.419784 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:47.418923 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" event={"ID":"e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f","Type":"ContainerStarted","Data":"741c3700def3dec3214866e7411836ce8ffa6a591d10244d5a6ddf276e743f85"} Jun 10 00:38:47.424604 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:47.424567 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-gdlrx" event={"ID":"3d133a50-44da-4220-a81d-94f7790b6da8","Type":"ContainerStarted","Data":"35a9745b1dc89bee76d689b12ded87d220e5484e61ae6b65a719e25d085359ce"} Jun 10 00:38:47.427236 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:47.425790 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-gdlrx" Jun 10 00:38:47.428699 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:47.428637 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x9pb4" event={"ID":"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b","Type":"ContainerStarted","Data":"ca1f848d896e89c7a9d81661f060e0042ef2ba6166b59efb5a93816dc0de5dcd"} Jun 10 00:38:47.430225 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:47.430145 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23","Type":"ContainerStarted","Data":"21a25a3b82974293aa77ad1afb998d41fa96521e83905a579eb3ecbea0636c83"} Jun 10 00:38:47.446293 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:47.441297 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-gdlrx" Jun 10 00:38:47.475690 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:47.475483 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-znpgv" podStartSLOduration=1.5553219409999999 podStartE2EDuration="9.475460926s" totalImagesPullingTime="7.920138985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:47.45002404 +0000 UTC m=+214.273929910" watchObservedRunningTime="2026-06-10 00:38:47.475460926 +0000 UTC m=+214.299366783" Jun 10 00:38:48.438415 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:48.436748 2577 generic.go:356] "Generic (PLEG): container finished" podID="3cd74bd0-98f9-4ae1-98a4-f6f8b063266b" containerID="5375e76584fdd1980545c360b3a4ed4ae457eb2790db7f9ed032b7b96318182b" exitCode=0 Jun 10 00:38:48.438415 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:48.436861 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x9pb4" event={"ID":"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b","Type":"ContainerDied","Data":"5375e76584fdd1980545c360b3a4ed4ae457eb2790db7f9ed032b7b96318182b"} Jun 10 00:38:48.441438 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:48.441396 2577 generic.go:356] "Generic (PLEG): container finished" podID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerID="fd79cfab92d309891c95a280b32d3de77c1bbf8d1b385f06ff4685952563bda5" exitCode=0 Jun 10 00:38:48.441580 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:48.441531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23","Type":"ContainerDied","Data":"fd79cfab92d309891c95a280b32d3de77c1bbf8d1b385f06ff4685952563bda5"} Jun 10 00:38:48.456623 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:48.456558 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-gdlrx" podStartSLOduration=2.50571244 podStartE2EDuration="26.456538668s" totalImagesPullingTime="23.950826228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:47.479996112 +0000 UTC m=+214.303901971" watchObservedRunningTime="2026-06-10 00:38:48.456538668 +0000 UTC m=+215.280444530" Jun 10 00:38:49.448726 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:49.448687 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x9pb4" event={"ID":"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b","Type":"ContainerStarted","Data":"80a078055928aa7419a73a3531a68d849a65d47349beb92030bfa1e37f492dac"} Jun 10 00:38:49.449440 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:49.448746 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x9pb4" event={"ID":"3cd74bd0-98f9-4ae1-98a4-f6f8b063266b","Type":"ContainerStarted","Data":"0bc88c98c558cc448c5cc98e98c50b87ed5b61a4f4e3082ec8e27139583254fa"} Jun 10 00:38:49.468974 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:49.468915 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x9pb4" podStartSLOduration=9.812502307 podStartE2EDuration="11.468896906s" totalImagesPullingTime="1.555970428s" totalInitContainerRuntime="100.424171ms" isStatefulPod=true podCreationTimestamp="2026-06-10 00:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:49.467882913 +0000 UTC m=+216.291788772" watchObservedRunningTime="2026-06-10 00:38:49.468896906 +0000 UTC m=+216.292802786" Jun 10 00:38:51.460666 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:51.460624 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23","Type":"ContainerStarted","Data":"e1405c030144870a65a5aa721ddd09cb8893f2ec4bc4dfcff956fe447cb42bbc"} Jun 10 00:38:51.461044 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:51.460758 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23","Type":"ContainerStarted","Data":"ad904021c3a3e94370ece7fdc47de016390e8cad3634b82ef26ba658f21530a7"} Jun 10 00:38:51.461044 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:51.460801 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23","Type":"ContainerStarted","Data":"c4ae916dc8afe3131ced7116b339bbf97afe9880a037c670561ec9de395388b3"} Jun 10 00:38:52.469836 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:52.469795 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23","Type":"ContainerStarted","Data":"e148c64cbfed5cda38e2da6252c51b92f802669fc769f95ca5d6a09b8d7e4a1f"} Jun 10 00:38:52.470380 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:52.469885 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23","Type":"ContainerStarted","Data":"6febeedc07e60a25ab0530bc877931d38af82368f9bf7f5012ad1334492a6502"} Jun 10 00:38:53.478501 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:53.478465 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23","Type":"ContainerStarted","Data":"c5e520694b3e6ef34199c8e41498d1710bf14aa3b4b5682908d7a7aa3b47d5f4"} Jun 10 00:38:53.504283 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:38:53.504224 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=9.072532222 podStartE2EDuration="14.504194918s" totalImagesPullingTime="5.40234401s" totalInitContainerRuntime="29.318686ms" isStatefulPod=false podCreationTimestamp="2026-06-10 00:38:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:53.503258412 +0000 UTC m=+220.327164282" watchObservedRunningTime="2026-06-10 00:38:53.504194918 +0000 UTC m=+220.328100776" Jun 10 00:39:24.408702 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:24.408655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs\") pod \"network-metrics-daemon-957rh\" (UID: \"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2\") " pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:39:24.410993 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:24.410970 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2-metrics-certs\") pod \"network-metrics-daemon-957rh\" (UID: \"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2\") " pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:39:24.697623 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:24.697594 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vbn9h\"" Jun 10 00:39:24.705707 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:24.705673 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-957rh" Jun 10 00:39:24.859118 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:24.858962 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-957rh"] Jun 10 00:39:24.861728 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:39:24.861693 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb6a6ce_ee5b_4489_925d_a3b2a32da8b2.slice/crio-a930f7c9e3a63533ca2f20116fa7143ce5e3a74e615e7ff7e70a4c9fc8b4a1f7 WatchSource:0}: Error finding container a930f7c9e3a63533ca2f20116fa7143ce5e3a74e615e7ff7e70a4c9fc8b4a1f7: Status 404 returned error can't find the container with id a930f7c9e3a63533ca2f20116fa7143ce5e3a74e615e7ff7e70a4c9fc8b4a1f7 Jun 10 00:39:25.598666 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:25.598628 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-957rh" event={"ID":"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2","Type":"ContainerStarted","Data":"a930f7c9e3a63533ca2f20116fa7143ce5e3a74e615e7ff7e70a4c9fc8b4a1f7"} Jun 10 00:39:26.600357 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:26.600324 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-957rh" event={"ID":"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2","Type":"ContainerStarted","Data":"0784d1230432bb05b47b694e49da5ffe754bbf438b927e9f7c27ae3cbaf49505"} Jun 10 00:39:26.600737 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:26.600372 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-957rh" event={"ID":"ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2","Type":"ContainerStarted","Data":"a52ea5ce2c20d6459652a9477c9d523ee97553b5bac3b179b7e050889d9a9444"} Jun 10 00:39:26.618024 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:26.615929 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-957rh" podStartSLOduration=252.380331331 podStartE2EDuration="4m13.615901294s" totalImagesPullingTime="1.235569963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:39:26.614909216 +0000 UTC m=+253.438815075" watchObservedRunningTime="2026-06-10 00:39:26.615901294 +0000 UTC m=+253.439807130" Jun 10 00:39:33.625077 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:33.625037 2577 generic.go:356] "Generic (PLEG): container finished" podID="1c8ea57d-a827-45d8-9418-b3cee86b69b5" containerID="d02c0580eec2642f65e2444980b7171755002261af2d56e028df0133af3553f0" exitCode=0 Jun 10 00:39:33.625504 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:33.625109 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-f78lj" event={"ID":"1c8ea57d-a827-45d8-9418-b3cee86b69b5","Type":"ContainerDied","Data":"d02c0580eec2642f65e2444980b7171755002261af2d56e028df0133af3553f0"} Jun 10 00:39:33.625504 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:33.625491 2577 scope.go:117] "RemoveContainer" containerID="d02c0580eec2642f65e2444980b7171755002261af2d56e028df0133af3553f0" Jun 10 00:39:34.630679 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:34.630648 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-f78lj" event={"ID":"1c8ea57d-a827-45d8-9418-b3cee86b69b5","Type":"ContainerStarted","Data":"5c100b1bc031d8b0b0ed92802b61781f356b4e2d42a54c649077996343282b16"} Jun 10 00:39:36.438672 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:36.438640 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cdc537f-4844-4601-a2f5-a0b1e3ff2c23/init-config-reloader/0.log" Jun 10 00:39:36.626315 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:36.626288 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cdc537f-4844-4601-a2f5-a0b1e3ff2c23/alertmanager/0.log" Jun 10 00:39:36.826575 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:36.826547 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cdc537f-4844-4601-a2f5-a0b1e3ff2c23/config-reloader/0.log" Jun 10 00:39:37.026357 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:37.026328 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cdc537f-4844-4601-a2f5-a0b1e3ff2c23/kube-rbac-proxy-web/0.log" Jun 10 00:39:37.226385 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:37.226360 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cdc537f-4844-4601-a2f5-a0b1e3ff2c23/kube-rbac-proxy/0.log" Jun 10 00:39:37.426430 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:37.426402 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cdc537f-4844-4601-a2f5-a0b1e3ff2c23/kube-rbac-proxy-metric/0.log" Jun 10 00:39:37.626528 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:37.626451 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cdc537f-4844-4601-a2f5-a0b1e3ff2c23/prom-label-proxy/0.log" Jun 10 00:39:38.026074 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:38.026035 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-znpgv_e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f/kube-state-metrics/0.log" Jun 10 00:39:38.226372 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:38.226328 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-znpgv_e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f/kube-rbac-proxy-main/0.log" Jun 10 00:39:38.426511 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:38.426400 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-znpgv_e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f/kube-rbac-proxy-self/0.log" Jun 10 00:39:39.625864 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:39.625832 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x9pb4_3cd74bd0-98f9-4ae1-98a4-f6f8b063266b/init-textfile/0.log" Jun 10 00:39:39.827035 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:39.827006 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x9pb4_3cd74bd0-98f9-4ae1-98a4-f6f8b063266b/node-exporter/0.log" Jun 10 00:39:40.026550 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:40.026502 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x9pb4_3cd74bd0-98f9-4ae1-98a4-f6f8b063266b/kube-rbac-proxy/0.log" Jun 10 00:39:42.828774 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:42.828732 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-9tb62_f93ea029-e1fd-4677-b3bf-18c79a013822/prometheus-operator/0.log" Jun 10 00:39:43.027543 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:43.027517 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-9tb62_f93ea029-e1fd-4677-b3bf-18c79a013822/kube-rbac-proxy/0.log" Jun 10 00:39:43.229696 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:43.229627 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-jc74d_553b8ef6-88de-4d3f-86f5-3bbe1f726d51/prometheus-operator-admission-webhook/0.log" Jun 10 00:39:46.228646 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:46.228614 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-gdlrx_3d133a50-44da-4220-a81d-94f7790b6da8/download-server/0.log" Jun 10 00:39:47.628434 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:47.628408 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4s4hx_89d37dfe-78b5-4500-acd0-6cca4e681d0e/dns-node-resolver/0.log" Jun 10 00:39:49.225831 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:49.225782 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vs4nb_ed5d0b4d-14e2-4195-80bd-b21fa955dc69/node-ca/0.log" Jun 10 00:39:49.427288 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:49.427259 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f4d5c5585-pngc5_8a6490e7-05a3-45a3-a080-4e2306c47840/router/0.log" Jun 10 00:39:49.627067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:49.626966 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2zvxw_f1e34cf6-3e84-46d9-9255-e1adae9cb707/serve-healthcheck-canary/0.log" Jun 10 00:39:54.188041 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:39:54.187999 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" podUID="6a7a514e-dd73-4c2a-8a22-a291c6cd0b17" Jun 10 00:39:54.188041 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:39:54.188011 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5zhlc" podUID="ad7c9a9b-90a0-4731-9879-86b04dabe8d4" Jun 10 00:39:54.707939 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:54.707907 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5zhlc" Jun 10 00:39:54.708128 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:54.707907 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:39:55.713062 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:55.713030 2577 generic.go:356] "Generic (PLEG): container finished" podID="4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f" containerID="7524f85993a19b29e8c76ee957075aae56f0cffde7306aa9100a18125cfe1452" exitCode=255 Jun 10 00:39:55.713468 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:55.713095 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" event={"ID":"4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f","Type":"ContainerDied","Data":"7524f85993a19b29e8c76ee957075aae56f0cffde7306aa9100a18125cfe1452"} Jun 10 00:39:55.713468 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:55.713140 2577 scope.go:117] "RemoveContainer" containerID="8382dcaddb29600abb384908bce1c5a03c37a79e37cfc51f558d2eefd5e8af62" Jun 10 00:39:55.719346 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:55.719329 2577 scope.go:117] "RemoveContainer" containerID="7524f85993a19b29e8c76ee957075aae56f0cffde7306aa9100a18125cfe1452" Jun 10 00:39:55.719505 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:39:55.719488 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-845b7c5878-czfzd_open-cluster-management-agent-addon(4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" podUID="4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f" Jun 10 00:39:58.106639 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.106592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:39:58.107132 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.106664 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:39:58.108936 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.108910 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad7c9a9b-90a0-4731-9879-86b04dabe8d4-metrics-tls\") pod \"dns-default-5zhlc\" (UID: \"ad7c9a9b-90a0-4731-9879-86b04dabe8d4\") " pod="openshift-dns/dns-default-5zhlc" Jun 10 00:39:58.109049 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.108977 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls\") pod \"image-registry-74978b5b5d-slrwd\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:39:58.312103 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.312064 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-42gc7\"" Jun 10 00:39:58.312103 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.312066 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wfgj8\"" Jun 10 00:39:58.319344 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.319325 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:39:58.319487 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.319469 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5zhlc" Jun 10 00:39:58.473596 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.473565 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5zhlc"] Jun 10 00:39:58.476196 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:39:58.476170 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad7c9a9b_90a0_4731_9879_86b04dabe8d4.slice/crio-1fae96c901b1d1febf28c00f216ff5db4a6ee7ed097f88541e9fc5bc210653d0 WatchSource:0}: Error finding container 1fae96c901b1d1febf28c00f216ff5db4a6ee7ed097f88541e9fc5bc210653d0: Status 404 returned error can't find the container with id 1fae96c901b1d1febf28c00f216ff5db4a6ee7ed097f88541e9fc5bc210653d0 Jun 10 00:39:58.505723 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.505693 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74978b5b5d-slrwd"] Jun 10 00:39:58.508574 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:39:58.508550 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a7a514e_dd73_4c2a_8a22_a291c6cd0b17.slice/crio-8753ed102fd0f8661caa991fe045ebdc313e38d01e6e873240fd5ccd6bb59993 WatchSource:0}: Error finding container 8753ed102fd0f8661caa991fe045ebdc313e38d01e6e873240fd5ccd6bb59993: Status 404 returned error can't find the container with id 8753ed102fd0f8661caa991fe045ebdc313e38d01e6e873240fd5ccd6bb59993 Jun 10 00:39:58.591829 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.591791 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 00:39:58.592103 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.592076 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="alertmanager" containerID="cri-o://c4ae916dc8afe3131ced7116b339bbf97afe9880a037c670561ec9de395388b3" gracePeriod=120 Jun 10 00:39:58.592178 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.592150 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="kube-rbac-proxy-metric" containerID="cri-o://e148c64cbfed5cda38e2da6252c51b92f802669fc769f95ca5d6a09b8d7e4a1f" gracePeriod=120 Jun 10 00:39:58.592268 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.592183 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="kube-rbac-proxy" containerID="cri-o://6febeedc07e60a25ab0530bc877931d38af82368f9bf7f5012ad1334492a6502" gracePeriod=120 Jun 10 00:39:58.592268 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.592174 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="kube-rbac-proxy-web" containerID="cri-o://e1405c030144870a65a5aa721ddd09cb8893f2ec4bc4dfcff956fe447cb42bbc" gracePeriod=120 Jun 10 00:39:58.592376 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.592151 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="prom-label-proxy" containerID="cri-o://c5e520694b3e6ef34199c8e41498d1710bf14aa3b4b5682908d7a7aa3b47d5f4" gracePeriod=120 Jun 10 00:39:58.592376 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.592249 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="config-reloader" containerID="cri-o://ad904021c3a3e94370ece7fdc47de016390e8cad3634b82ef26ba658f21530a7" gracePeriod=120 Jun 10 00:39:58.726659 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.726626 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5zhlc" event={"ID":"ad7c9a9b-90a0-4731-9879-86b04dabe8d4","Type":"ContainerStarted","Data":"1fae96c901b1d1febf28c00f216ff5db4a6ee7ed097f88541e9fc5bc210653d0"} Jun 10 00:39:58.728155 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.728127 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" event={"ID":"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17","Type":"ContainerStarted","Data":"0623bb206366ba6863bb036de54ee6eff2fb25cbb2190d3daad9c11e739a74bc"} Jun 10 00:39:58.728288 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.728176 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:39:58.728288 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.728195 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" event={"ID":"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17","Type":"ContainerStarted","Data":"8753ed102fd0f8661caa991fe045ebdc313e38d01e6e873240fd5ccd6bb59993"} Jun 10 00:39:58.731512 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.731490 2577 generic.go:356] "Generic (PLEG): container finished" podID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerID="c5e520694b3e6ef34199c8e41498d1710bf14aa3b4b5682908d7a7aa3b47d5f4" exitCode=0 Jun 10 00:39:58.731512 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.731512 2577 generic.go:356] "Generic (PLEG): container finished" podID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerID="e148c64cbfed5cda38e2da6252c51b92f802669fc769f95ca5d6a09b8d7e4a1f" exitCode=0 Jun 10 00:39:58.731645 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.731518 2577 generic.go:356] "Generic (PLEG): container finished" podID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerID="6febeedc07e60a25ab0530bc877931d38af82368f9bf7f5012ad1334492a6502" exitCode=0 Jun 10 00:39:58.731645 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.731524 2577 generic.go:356] "Generic (PLEG): container finished" podID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerID="ad904021c3a3e94370ece7fdc47de016390e8cad3634b82ef26ba658f21530a7" exitCode=0 Jun 10 00:39:58.731645 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.731529 2577 generic.go:356] "Generic (PLEG): container finished" podID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerID="c4ae916dc8afe3131ced7116b339bbf97afe9880a037c670561ec9de395388b3" exitCode=0 Jun 10 00:39:58.731645 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.731548 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23","Type":"ContainerDied","Data":"c5e520694b3e6ef34199c8e41498d1710bf14aa3b4b5682908d7a7aa3b47d5f4"} Jun 10 00:39:58.731645 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.731590 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23","Type":"ContainerDied","Data":"e148c64cbfed5cda38e2da6252c51b92f802669fc769f95ca5d6a09b8d7e4a1f"} Jun 10 00:39:58.731645 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.731616 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23","Type":"ContainerDied","Data":"6febeedc07e60a25ab0530bc877931d38af82368f9bf7f5012ad1334492a6502"} Jun 10 00:39:58.731645 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.731639 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23","Type":"ContainerDied","Data":"ad904021c3a3e94370ece7fdc47de016390e8cad3634b82ef26ba658f21530a7"} Jun 10 00:39:58.731856 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.731664 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23","Type":"ContainerDied","Data":"c4ae916dc8afe3131ced7116b339bbf97afe9880a037c670561ec9de395388b3"} Jun 10 00:39:58.746858 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:58.746815 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" podStartSLOduration=284.74680272 podStartE2EDuration="4m44.74680272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:39:58.745842403 +0000 UTC m=+285.569748262" watchObservedRunningTime="2026-06-10 00:39:58.74680272 +0000 UTC m=+285.570708577" Jun 10 00:39:59.740402 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:59.740362 2577 generic.go:356] "Generic (PLEG): container finished" podID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerID="e1405c030144870a65a5aa721ddd09cb8893f2ec4bc4dfcff956fe447cb42bbc" exitCode=0 Jun 10 00:39:59.740841 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:39:59.740430 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23","Type":"ContainerDied","Data":"e1405c030144870a65a5aa721ddd09cb8893f2ec4bc4dfcff956fe447cb42bbc"} Jun 10 00:40:00.264861 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.264834 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:00.327879 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.327851 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-metrics-client-ca\") pod \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " Jun 10 00:40:00.328026 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.327905 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-config-out\") pod \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " Jun 10 00:40:00.328026 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.327926 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy-web\") pod \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " Jun 10 00:40:00.328026 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.327946 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-config-volume\") pod \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " Jun 10 00:40:00.328026 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.327979 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-tls-assets\") pod \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " Jun 10 00:40:00.328026 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.327995 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " Jun 10 00:40:00.328026 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.328023 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-web-config\") pod \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " Jun 10 00:40:00.328346 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.328046 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-main-tls\") pod \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " Jun 10 00:40:00.328346 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.328075 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-cluster-tls-config\") pod \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " Jun 10 00:40:00.328346 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.328098 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy\") pod \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " Jun 10 00:40:00.328346 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.328124 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffvpw\" (UniqueName: \"kubernetes.io/projected/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-kube-api-access-ffvpw\") pod \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " Jun 10 00:40:00.328346 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.328163 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-alertmanager-main-db\") pod \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " Jun 10 00:40:00.328346 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.328225 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-alertmanager-trusted-ca-bundle\") pod \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\" (UID: \"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23\") " Jun 10 00:40:00.328346 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.328315 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" (UID: "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:00.328696 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.328640 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-metrics-client-ca\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:00.329260 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.329227 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" (UID: "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:00.329581 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.329550 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" (UID: "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:40:00.331086 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.331039 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" (UID: "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:00.332443 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.332405 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" (UID: "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:00.332533 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.332455 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" (UID: "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:00.332533 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.332474 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-config-out" (OuterVolumeSpecName: "config-out") pod "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" (UID: "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:40:00.332533 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.332479 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-config-volume" (OuterVolumeSpecName: "config-volume") pod "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" (UID: "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:00.332700 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.332586 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-kube-api-access-ffvpw" (OuterVolumeSpecName: "kube-api-access-ffvpw") pod "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" (UID: "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23"). InnerVolumeSpecName "kube-api-access-ffvpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:40:00.332700 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.332694 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" (UID: "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:40:00.333667 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.333636 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" (UID: "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:00.336421 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.336397 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" (UID: "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:00.343740 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.343720 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-web-config" (OuterVolumeSpecName: "web-config") pod "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" (UID: "3cdc537f-4844-4601-a2f5-a0b1e3ff2c23"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:00.430044 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.430013 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-config-out\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:00.430044 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.430043 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:00.430044 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.430052 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-config-volume\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:00.430285 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.430061 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-tls-assets\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:00.430285 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.430074 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:00.430285 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.430086 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-web-config\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:00.430285 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.430095 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-main-tls\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:00.430285 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.430105 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-cluster-tls-config\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:00.430285 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.430114 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:00.430285 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.430123 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffvpw\" (UniqueName: \"kubernetes.io/projected/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-kube-api-access-ffvpw\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:00.430285 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.430130 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-alertmanager-main-db\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:00.430285 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.430140 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:00.688441 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.688350 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" Jun 10 00:40:00.694324 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.694301 2577 scope.go:117] "RemoveContainer" containerID="7524f85993a19b29e8c76ee957075aae56f0cffde7306aa9100a18125cfe1452" Jun 10 00:40:00.694485 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:40:00.694468 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-845b7c5878-czfzd_open-cluster-management-agent-addon(4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" podUID="4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f" Jun 10 00:40:00.746484 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.746446 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5zhlc" event={"ID":"ad7c9a9b-90a0-4731-9879-86b04dabe8d4","Type":"ContainerStarted","Data":"d8a02b181b361daf52e642c394c4c10e968b11edd46d2306a23d4052c1756a0d"} Jun 10 00:40:00.746937 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.746506 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5zhlc" event={"ID":"ad7c9a9b-90a0-4731-9879-86b04dabe8d4","Type":"ContainerStarted","Data":"e9cb4638aea1f38d52c7aa547400f1b09ba9075627e9463186f8f8aeac139e98"} Jun 10 00:40:00.746937 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.746553 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5zhlc" Jun 10 00:40:00.749582 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.749562 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdc537f-4844-4601-a2f5-a0b1e3ff2c23","Type":"ContainerDied","Data":"21a25a3b82974293aa77ad1afb998d41fa96521e83905a579eb3ecbea0636c83"} Jun 10 00:40:00.749663 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.749592 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:00.749663 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.749628 2577 scope.go:117] "RemoveContainer" containerID="c5e520694b3e6ef34199c8e41498d1710bf14aa3b4b5682908d7a7aa3b47d5f4" Jun 10 00:40:00.762305 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.762195 2577 scope.go:117] "RemoveContainer" containerID="e148c64cbfed5cda38e2da6252c51b92f802669fc769f95ca5d6a09b8d7e4a1f" Jun 10 00:40:00.765081 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.765029 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5zhlc" podStartSLOduration=250.977101745 podStartE2EDuration="4m12.765011717s" totalImagesPullingTime="1.787909972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:40:00.763659597 +0000 UTC m=+287.587565457" watchObservedRunningTime="2026-06-10 00:40:00.765011717 +0000 UTC m=+287.588917577" Jun 10 00:40:00.770935 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.770917 2577 scope.go:117] "RemoveContainer" containerID="6febeedc07e60a25ab0530bc877931d38af82368f9bf7f5012ad1334492a6502" Jun 10 00:40:00.777934 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.777910 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 00:40:00.778158 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.778144 2577 scope.go:117] "RemoveContainer" containerID="e1405c030144870a65a5aa721ddd09cb8893f2ec4bc4dfcff956fe447cb42bbc" Jun 10 00:40:00.783142 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.783122 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 00:40:00.785260 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.785245 2577 scope.go:117] "RemoveContainer" containerID="ad904021c3a3e94370ece7fdc47de016390e8cad3634b82ef26ba658f21530a7" Jun 10 00:40:00.791965 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.791947 2577 scope.go:117] "RemoveContainer" containerID="c4ae916dc8afe3131ced7116b339bbf97afe9880a037c670561ec9de395388b3" Jun 10 00:40:00.798602 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.798586 2577 scope.go:117] "RemoveContainer" containerID="fd79cfab92d309891c95a280b32d3de77c1bbf8d1b385f06ff4685952563bda5" Jun 10 00:40:00.805930 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.805908 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 00:40:00.806360 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806342 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="kube-rbac-proxy-web" Jun 10 00:40:00.806411 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806362 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="kube-rbac-proxy-web" Jun 10 00:40:00.806411 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806371 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="alertmanager" Jun 10 00:40:00.806411 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806378 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="alertmanager" Jun 10 00:40:00.806411 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806387 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="init-config-reloader" Jun 10 00:40:00.806411 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806393 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="init-config-reloader" Jun 10 00:40:00.806411 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806399 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="kube-rbac-proxy" Jun 10 00:40:00.806411 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806404 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="kube-rbac-proxy" Jun 10 00:40:00.806411 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806412 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="kube-rbac-proxy-metric" Jun 10 00:40:00.806685 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806418 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="kube-rbac-proxy-metric" Jun 10 00:40:00.806685 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806428 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="prom-label-proxy" Jun 10 00:40:00.806685 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806433 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="prom-label-proxy" Jun 10 00:40:00.806685 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806439 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="config-reloader" Jun 10 00:40:00.806685 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806444 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="config-reloader" Jun 10 00:40:00.806685 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806494 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="kube-rbac-proxy" Jun 10 00:40:00.806685 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806501 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="prom-label-proxy" Jun 10 00:40:00.806685 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806508 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="kube-rbac-proxy-web" Jun 10 00:40:00.806685 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806515 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="kube-rbac-proxy-metric" Jun 10 00:40:00.806685 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806522 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="alertmanager" Jun 10 00:40:00.806685 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.806528 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" containerName="config-reloader" Jun 10 00:40:00.811255 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.811192 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:00.813708 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.813669 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 00:40:00.813708 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.813687 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 00:40:00.813879 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.813710 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 00:40:00.813879 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.813748 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 00:40:00.813879 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.813676 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 00:40:00.813879 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.813821 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 00:40:00.814132 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.814098 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 00:40:00.814257 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.814142 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 00:40:00.814257 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.814155 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dqh4h\"" Jun 10 00:40:00.818459 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.818442 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 00:40:00.821893 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.821873 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 00:40:00.933033 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.932991 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2490c83-dec0-49ee-ae68-64d885f902a0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:00.933033 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.933032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2490c83-dec0-49ee-ae68-64d885f902a0-config-out\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:00.933248 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.933054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:00.933248 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.933125 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-web-config\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:00.933248 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.933170 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:00.933248 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.933227 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2490c83-dec0-49ee-ae68-64d885f902a0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:00.933248 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.933245 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:00.933403 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.933264 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2490c83-dec0-49ee-ae68-64d885f902a0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:00.933403 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.933286 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:00.933403 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.933312 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2490c83-dec0-49ee-ae68-64d885f902a0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:00.933403 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.933329 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:00.933518 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.933406 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k729v\" (UniqueName: \"kubernetes.io/projected/c2490c83-dec0-49ee-ae68-64d885f902a0-kube-api-access-k729v\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:00.933518 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:00.933431 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.034779 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.034738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2490c83-dec0-49ee-ae68-64d885f902a0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.034953 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.034783 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.034953 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.034812 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2490c83-dec0-49ee-ae68-64d885f902a0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.034953 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.034840 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.034953 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.034875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2490c83-dec0-49ee-ae68-64d885f902a0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.034953 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.034901 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.034953 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.034950 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k729v\" (UniqueName: \"kubernetes.io/projected/c2490c83-dec0-49ee-ae68-64d885f902a0-kube-api-access-k729v\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.035303 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.034981 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.035303 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.035007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2490c83-dec0-49ee-ae68-64d885f902a0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.035303 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.035034 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2490c83-dec0-49ee-ae68-64d885f902a0-config-out\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.035303 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.035068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.035303 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.035106 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-web-config\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.035303 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.035136 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.035600 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.035422 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2490c83-dec0-49ee-ae68-64d885f902a0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.036150 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.036123 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2490c83-dec0-49ee-ae68-64d885f902a0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.036900 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.036877 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2490c83-dec0-49ee-ae68-64d885f902a0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.037906 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.037878 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2490c83-dec0-49ee-ae68-64d885f902a0-config-out\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.037906 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.037898 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2490c83-dec0-49ee-ae68-64d885f902a0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.038012 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.037982 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.038074 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.038055 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.038134 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.038115 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.038708 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.038690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.038790 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.038750 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.039148 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.039133 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.039858 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.039842 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2490c83-dec0-49ee-ae68-64d885f902a0-web-config\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.045145 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.045127 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k729v\" (UniqueName: \"kubernetes.io/projected/c2490c83-dec0-49ee-ae68-64d885f902a0-kube-api-access-k729v\") pod \"alertmanager-main-0\" (UID: \"c2490c83-dec0-49ee-ae68-64d885f902a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.128599 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.128550 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 00:40:01.261183 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.261159 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 00:40:01.263250 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:40:01.263215 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2490c83_dec0_49ee_ae68_64d885f902a0.slice/crio-a298b513bc2ca22497a5368d6676b569470ac696a543f07ddbb036f88e4be6ec WatchSource:0}: Error finding container a298b513bc2ca22497a5368d6676b569470ac696a543f07ddbb036f88e4be6ec: Status 404 returned error can't find the container with id a298b513bc2ca22497a5368d6676b569470ac696a543f07ddbb036f88e4be6ec Jun 10 00:40:01.599528 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.599451 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cdc537f-4844-4601-a2f5-a0b1e3ff2c23" path="/var/lib/kubelet/pods/3cdc537f-4844-4601-a2f5-a0b1e3ff2c23/volumes" Jun 10 00:40:01.755245 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.755188 2577 generic.go:356] "Generic (PLEG): container finished" podID="c2490c83-dec0-49ee-ae68-64d885f902a0" containerID="3f88a5ba5ed7617c692bc216ba1053b85cae54aba46da9097a9f82ba7e69eab8" exitCode=0 Jun 10 00:40:01.755695 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.755271 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2490c83-dec0-49ee-ae68-64d885f902a0","Type":"ContainerDied","Data":"3f88a5ba5ed7617c692bc216ba1053b85cae54aba46da9097a9f82ba7e69eab8"} Jun 10 00:40:01.755695 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:01.755335 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2490c83-dec0-49ee-ae68-64d885f902a0","Type":"ContainerStarted","Data":"a298b513bc2ca22497a5368d6676b569470ac696a543f07ddbb036f88e4be6ec"} Jun 10 00:40:02.763422 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:02.763390 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2490c83-dec0-49ee-ae68-64d885f902a0","Type":"ContainerStarted","Data":"a3d4c96850a2ccbbd538a3457b558a6ba2901ab29abf735b5f8d5d3fb6467425"} Jun 10 00:40:02.763860 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:02.763455 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2490c83-dec0-49ee-ae68-64d885f902a0","Type":"ContainerStarted","Data":"e8b8897dc0f3c7a9dcc76e1540d29123483ccd743927b9c220743090911712c8"} Jun 10 00:40:02.763860 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:02.763481 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2490c83-dec0-49ee-ae68-64d885f902a0","Type":"ContainerStarted","Data":"ecd488959a1cca7b36fd1dad47568831328c1569e6ce7a1c757ed115af64f441"} Jun 10 00:40:02.763860 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:02.763511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2490c83-dec0-49ee-ae68-64d885f902a0","Type":"ContainerStarted","Data":"9700a73cffbba4eccd938f52210d0c2cb8b5997f3a947b22f639edb5bb6111ac"} Jun 10 00:40:02.763860 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:02.763535 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2490c83-dec0-49ee-ae68-64d885f902a0","Type":"ContainerStarted","Data":"e123f3235e63e0b1d6676e0c68ea202a2f4176aa8f839c0f7b7f5297deabc1fa"} Jun 10 00:40:02.763860 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:02.763558 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2490c83-dec0-49ee-ae68-64d885f902a0","Type":"ContainerStarted","Data":"3ab8dc457116cca6eefb50f5e79cc8af70e1e6ca65daa88c2200d8b8aa2b58ff"} Jun 10 00:40:02.792601 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:02.792529 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.777056921 podStartE2EDuration="2.79250726s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.450339ms" isStatefulPod=false podCreationTimestamp="2026-06-10 00:40:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:40:02.790167181 +0000 UTC m=+289.614073040" watchObservedRunningTime="2026-06-10 00:40:02.79250726 +0000 UTC m=+289.616413119" Jun 10 00:40:10.758322 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:10.758293 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5zhlc" Jun 10 00:40:13.542223 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:13.542173 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 00:40:13.543212 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:13.543172 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 00:40:13.548923 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:13.548904 2577 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 00:40:15.600523 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:15.600502 2577 scope.go:117] "RemoveContainer" containerID="7524f85993a19b29e8c76ee957075aae56f0cffde7306aa9100a18125cfe1452" Jun 10 00:40:15.816722 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:15.816683 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-845b7c5878-czfzd" event={"ID":"4f9d8f87-16d8-4ceb-88f1-209c7ec6ab2f","Type":"ContainerStarted","Data":"d8c67a44f4b6a68e10808a916bd4a86a9341db1c719ffa9c59c976b7b495e8db"} Jun 10 00:40:18.323753 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:18.323718 2577 patch_prober.go:28] interesting pod/image-registry-74978b5b5d-slrwd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 00:40:18.324147 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:18.323783 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" podUID="6a7a514e-dd73-4c2a-8a22-a291c6cd0b17" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 00:40:19.745421 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:19.745390 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:40:22.725741 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:22.725701 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74978b5b5d-slrwd"] Jun 10 00:40:47.746008 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:47.745970 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" podUID="6a7a514e-dd73-4c2a-8a22-a291c6cd0b17" containerName="registry" containerID="cri-o://0623bb206366ba6863bb036de54ee6eff2fb25cbb2190d3daad9c11e739a74bc" gracePeriod=30 Jun 10 00:40:48.942655 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:48.942617 2577 generic.go:356] "Generic (PLEG): container finished" podID="6a7a514e-dd73-4c2a-8a22-a291c6cd0b17" containerID="0623bb206366ba6863bb036de54ee6eff2fb25cbb2190d3daad9c11e739a74bc" exitCode=0 Jun 10 00:40:48.943059 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:48.942687 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" event={"ID":"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17","Type":"ContainerDied","Data":"0623bb206366ba6863bb036de54ee6eff2fb25cbb2190d3daad9c11e739a74bc"} Jun 10 00:40:48.990263 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:48.990239 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:40:49.135567 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.135475 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6fj2\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-kube-api-access-d6fj2\") pod \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " Jun 10 00:40:49.135567 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.135525 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-ca-trust-extracted\") pod \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " Jun 10 00:40:49.135567 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.135555 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls\") pod \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " Jun 10 00:40:49.135827 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.135606 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-trusted-ca\") pod \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " Jun 10 00:40:49.135827 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.135638 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-bound-sa-token\") pod \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " Jun 10 00:40:49.135827 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.135668 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-installation-pull-secrets\") pod \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " Jun 10 00:40:49.135827 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.135691 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-image-registry-private-configuration\") pod \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " Jun 10 00:40:49.135827 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.135738 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-certificates\") pod \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\" (UID: \"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17\") " Jun 10 00:40:49.136085 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.136028 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17" (UID: "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:49.136351 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.136322 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17" (UID: "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 00:40:49.138189 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.138162 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-kube-api-access-d6fj2" (OuterVolumeSpecName: "kube-api-access-d6fj2") pod "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17" (UID: "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17"). InnerVolumeSpecName "kube-api-access-d6fj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:40:49.138437 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.138175 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17" (UID: "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:49.138437 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.138221 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17" (UID: "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:40:49.138437 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.138240 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17" (UID: "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:40:49.138437 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.138430 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17" (UID: "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:40:49.143649 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.143628 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17" (UID: "6a7a514e-dd73-4c2a-8a22-a291c6cd0b17"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:40:49.236906 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.236878 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-trusted-ca\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:49.236906 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.236903 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-bound-sa-token\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:49.236906 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.236912 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-installation-pull-secrets\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:49.237104 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.236922 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-image-registry-private-configuration\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:49.237104 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.236933 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-certificates\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:49.237104 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.236942 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6fj2\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-kube-api-access-d6fj2\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:49.237104 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.236950 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-ca-trust-extracted\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:49.237104 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.236959 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17-registry-tls\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:40:49.947120 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.947096 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" Jun 10 00:40:49.947544 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.947113 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74978b5b5d-slrwd" event={"ID":"6a7a514e-dd73-4c2a-8a22-a291c6cd0b17","Type":"ContainerDied","Data":"8753ed102fd0f8661caa991fe045ebdc313e38d01e6e873240fd5ccd6bb59993"} Jun 10 00:40:49.947544 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.947175 2577 scope.go:117] "RemoveContainer" containerID="0623bb206366ba6863bb036de54ee6eff2fb25cbb2190d3daad9c11e739a74bc" Jun 10 00:40:49.965467 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.965440 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74978b5b5d-slrwd"] Jun 10 00:40:49.968757 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:49.968738 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74978b5b5d-slrwd"] Jun 10 00:40:51.598825 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:40:51.598789 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a7a514e-dd73-4c2a-8a22-a291c6cd0b17" path="/var/lib/kubelet/pods/6a7a514e-dd73-4c2a-8a22-a291c6cd0b17/volumes" Jun 10 00:45:13.566690 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:45:13.566666 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 00:45:13.567893 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:45:13.567858 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 00:46:15.304241 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.304137 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wpqbf"] Jun 10 00:46:15.306624 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.304624 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a7a514e-dd73-4c2a-8a22-a291c6cd0b17" containerName="registry" Jun 10 00:46:15.306624 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.304643 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a7a514e-dd73-4c2a-8a22-a291c6cd0b17" containerName="registry" Jun 10 00:46:15.306624 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.304707 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a7a514e-dd73-4c2a-8a22-a291c6cd0b17" containerName="registry" Jun 10 00:46:15.307449 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.307431 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wpqbf" Jun 10 00:46:15.310388 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.310363 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 00:46:15.310388 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.310382 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 00:46:15.311778 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.311761 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-482hv\"" Jun 10 00:46:15.315220 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.315183 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wpqbf"] Jun 10 00:46:15.379518 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.379476 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqqz5\" (UniqueName: \"kubernetes.io/projected/698ecd6a-897c-4a82-8e21-2a094a55bf98-kube-api-access-vqqz5\") pod \"cert-manager-webhook-7dc76cbb94-wpqbf\" (UID: \"698ecd6a-897c-4a82-8e21-2a094a55bf98\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wpqbf" Jun 10 00:46:15.379705 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.379545 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/698ecd6a-897c-4a82-8e21-2a094a55bf98-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wpqbf\" (UID: \"698ecd6a-897c-4a82-8e21-2a094a55bf98\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wpqbf" Jun 10 00:46:15.480546 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.480503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqqz5\" (UniqueName: \"kubernetes.io/projected/698ecd6a-897c-4a82-8e21-2a094a55bf98-kube-api-access-vqqz5\") pod \"cert-manager-webhook-7dc76cbb94-wpqbf\" (UID: \"698ecd6a-897c-4a82-8e21-2a094a55bf98\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wpqbf" Jun 10 00:46:15.480690 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.480569 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/698ecd6a-897c-4a82-8e21-2a094a55bf98-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wpqbf\" (UID: \"698ecd6a-897c-4a82-8e21-2a094a55bf98\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wpqbf" Jun 10 00:46:15.493137 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.493103 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/698ecd6a-897c-4a82-8e21-2a094a55bf98-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wpqbf\" (UID: \"698ecd6a-897c-4a82-8e21-2a094a55bf98\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wpqbf" Jun 10 00:46:15.493137 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.493121 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqqz5\" (UniqueName: \"kubernetes.io/projected/698ecd6a-897c-4a82-8e21-2a094a55bf98-kube-api-access-vqqz5\") pod \"cert-manager-webhook-7dc76cbb94-wpqbf\" (UID: \"698ecd6a-897c-4a82-8e21-2a094a55bf98\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wpqbf" Jun 10 00:46:15.617559 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.617455 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wpqbf" Jun 10 00:46:15.745825 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.745790 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wpqbf"] Jun 10 00:46:15.750093 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:46:15.750063 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod698ecd6a_897c_4a82_8e21_2a094a55bf98.slice/crio-5949b7af3e01bfd8ac51a520379a1b3c66b2fae1078f4525eb108dea99a57d7e WatchSource:0}: Error finding container 5949b7af3e01bfd8ac51a520379a1b3c66b2fae1078f4525eb108dea99a57d7e: Status 404 returned error can't find the container with id 5949b7af3e01bfd8ac51a520379a1b3c66b2fae1078f4525eb108dea99a57d7e Jun 10 00:46:15.751967 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:15.751948 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 00:46:16.140370 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:16.140328 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wpqbf" event={"ID":"698ecd6a-897c-4a82-8e21-2a094a55bf98","Type":"ContainerStarted","Data":"5949b7af3e01bfd8ac51a520379a1b3c66b2fae1078f4525eb108dea99a57d7e"} Jun 10 00:46:19.154055 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:19.154018 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wpqbf" event={"ID":"698ecd6a-897c-4a82-8e21-2a094a55bf98","Type":"ContainerStarted","Data":"c5c90c9a2b8edb4be28252dc79ea4db8d8e4c6477a69aa17ab1059352050bdfb"} Jun 10 00:46:19.154460 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:19.154074 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wpqbf" Jun 10 00:46:19.173461 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:19.173411 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wpqbf" podStartSLOduration=1.5831175210000001 podStartE2EDuration="4.173396262s" totalImagesPullingTime="2.590278741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:46:19.172023913 +0000 UTC m=+665.995929772" watchObservedRunningTime="2026-06-10 00:46:19.173396262 +0000 UTC m=+665.997302120" Jun 10 00:46:25.159167 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:25.159138 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wpqbf" Jun 10 00:46:25.840639 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:25.840608 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-f2crb"] Jun 10 00:46:25.843916 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:25.843897 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-f2crb" Jun 10 00:46:25.846644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:25.846628 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-k6856\"" Jun 10 00:46:25.854116 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:25.854093 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-f2crb"] Jun 10 00:46:25.962995 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:25.962960 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cac94f6-8715-4cdb-a4fc-6d6bb9de4d76-bound-sa-token\") pod \"cert-manager-59c77684cc-f2crb\" (UID: \"7cac94f6-8715-4cdb-a4fc-6d6bb9de4d76\") " pod="cert-manager/cert-manager-59c77684cc-f2crb" Jun 10 00:46:25.963170 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:25.963021 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp75n\" (UniqueName: \"kubernetes.io/projected/7cac94f6-8715-4cdb-a4fc-6d6bb9de4d76-kube-api-access-fp75n\") pod \"cert-manager-59c77684cc-f2crb\" (UID: \"7cac94f6-8715-4cdb-a4fc-6d6bb9de4d76\") " pod="cert-manager/cert-manager-59c77684cc-f2crb" Jun 10 00:46:26.063402 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:26.063363 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cac94f6-8715-4cdb-a4fc-6d6bb9de4d76-bound-sa-token\") pod \"cert-manager-59c77684cc-f2crb\" (UID: \"7cac94f6-8715-4cdb-a4fc-6d6bb9de4d76\") " pod="cert-manager/cert-manager-59c77684cc-f2crb" Jun 10 00:46:26.063578 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:26.063426 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp75n\" (UniqueName: \"kubernetes.io/projected/7cac94f6-8715-4cdb-a4fc-6d6bb9de4d76-kube-api-access-fp75n\") pod \"cert-manager-59c77684cc-f2crb\" (UID: \"7cac94f6-8715-4cdb-a4fc-6d6bb9de4d76\") " pod="cert-manager/cert-manager-59c77684cc-f2crb" Jun 10 00:46:26.076192 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:26.076165 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cac94f6-8715-4cdb-a4fc-6d6bb9de4d76-bound-sa-token\") pod \"cert-manager-59c77684cc-f2crb\" (UID: \"7cac94f6-8715-4cdb-a4fc-6d6bb9de4d76\") " pod="cert-manager/cert-manager-59c77684cc-f2crb" Jun 10 00:46:26.078642 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:26.078620 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp75n\" (UniqueName: \"kubernetes.io/projected/7cac94f6-8715-4cdb-a4fc-6d6bb9de4d76-kube-api-access-fp75n\") pod \"cert-manager-59c77684cc-f2crb\" (UID: \"7cac94f6-8715-4cdb-a4fc-6d6bb9de4d76\") " pod="cert-manager/cert-manager-59c77684cc-f2crb" Jun 10 00:46:26.152397 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:26.152311 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-f2crb" Jun 10 00:46:26.278236 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:26.278081 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-f2crb"] Jun 10 00:46:26.280762 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:46:26.280737 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7cac94f6_8715_4cdb_a4fc_6d6bb9de4d76.slice/crio-a78e2b01fb25e4d03257e627a0faac90c62a5ec5fb6adb9b143a77b3b08ffa07 WatchSource:0}: Error finding container a78e2b01fb25e4d03257e627a0faac90c62a5ec5fb6adb9b143a77b3b08ffa07: Status 404 returned error can't find the container with id a78e2b01fb25e4d03257e627a0faac90c62a5ec5fb6adb9b143a77b3b08ffa07 Jun 10 00:46:27.183980 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:27.183947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-f2crb" event={"ID":"7cac94f6-8715-4cdb-a4fc-6d6bb9de4d76","Type":"ContainerStarted","Data":"77f17b78fa37325762d0f4db980a76818aee9a9a370bd0b436698c7adde4221e"} Jun 10 00:46:27.183980 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:27.183986 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-f2crb" event={"ID":"7cac94f6-8715-4cdb-a4fc-6d6bb9de4d76","Type":"ContainerStarted","Data":"a78e2b01fb25e4d03257e627a0faac90c62a5ec5fb6adb9b143a77b3b08ffa07"} Jun 10 00:46:27.199258 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:27.199192 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-f2crb" podStartSLOduration=2.199177946 podStartE2EDuration="2.199177946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:46:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:46:27.198266806 +0000 UTC m=+674.022172661" watchObservedRunningTime="2026-06-10 00:46:27.199177946 +0000 UTC m=+674.023083803" Jun 10 00:46:45.967261 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:45.967230 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n"] Jun 10 00:46:45.969580 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:45.969563 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:45.972362 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:45.972341 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 00:46:45.972490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:45.972410 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 00:46:45.972490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:45.972413 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ckhbh\"" Jun 10 00:46:45.972490 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:45.972416 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 00:46:45.972657 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:45.972524 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 00:46:45.983654 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:45.983635 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n"] Jun 10 00:46:46.126730 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:46.126691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba39a6fe-6d6d-4783-843b-ac99cb2bacdc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7746866678-sq86n\" (UID: \"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:46.126916 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:46.126742 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba39a6fe-6d6d-4783-843b-ac99cb2bacdc-tmp\") pod \"opendatahub-operator-controller-manager-7746866678-sq86n\" (UID: \"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:46.126916 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:46.126772 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ba39a6fe-6d6d-4783-843b-ac99cb2bacdc-manifests\") pod \"opendatahub-operator-controller-manager-7746866678-sq86n\" (UID: \"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:46.126916 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:46.126826 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba39a6fe-6d6d-4783-843b-ac99cb2bacdc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7746866678-sq86n\" (UID: \"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:46.126916 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:46.126874 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d922\" (UniqueName: \"kubernetes.io/projected/ba39a6fe-6d6d-4783-843b-ac99cb2bacdc-kube-api-access-4d922\") pod \"opendatahub-operator-controller-manager-7746866678-sq86n\" (UID: \"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:46.227965 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:46.227876 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba39a6fe-6d6d-4783-843b-ac99cb2bacdc-tmp\") pod \"opendatahub-operator-controller-manager-7746866678-sq86n\" (UID: \"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:46.227965 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:46.227915 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ba39a6fe-6d6d-4783-843b-ac99cb2bacdc-manifests\") pod \"opendatahub-operator-controller-manager-7746866678-sq86n\" (UID: \"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:46.227965 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:46.227942 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba39a6fe-6d6d-4783-843b-ac99cb2bacdc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7746866678-sq86n\" (UID: \"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:46.228271 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:46.227980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d922\" (UniqueName: \"kubernetes.io/projected/ba39a6fe-6d6d-4783-843b-ac99cb2bacdc-kube-api-access-4d922\") pod \"opendatahub-operator-controller-manager-7746866678-sq86n\" (UID: \"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:46.228271 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:46.228014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba39a6fe-6d6d-4783-843b-ac99cb2bacdc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7746866678-sq86n\" (UID: \"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:46.228387 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:46.228320 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ba39a6fe-6d6d-4783-843b-ac99cb2bacdc-manifests\") pod \"opendatahub-operator-controller-manager-7746866678-sq86n\" (UID: \"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:46.230372 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:46.230346 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba39a6fe-6d6d-4783-843b-ac99cb2bacdc-tmp\") pod \"opendatahub-operator-controller-manager-7746866678-sq86n\" (UID: \"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:46.230533 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:46.230517 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba39a6fe-6d6d-4783-843b-ac99cb2bacdc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7746866678-sq86n\" (UID: \"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:46.230577 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:46.230535 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba39a6fe-6d6d-4783-843b-ac99cb2bacdc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7746866678-sq86n\" (UID: \"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:46.235541 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:46.235518 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d922\" (UniqueName: \"kubernetes.io/projected/ba39a6fe-6d6d-4783-843b-ac99cb2bacdc-kube-api-access-4d922\") pod \"opendatahub-operator-controller-manager-7746866678-sq86n\" (UID: \"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc\") " pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:46.279613 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:46.279583 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:46.410495 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:46.410423 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n"] Jun 10 00:46:46.413231 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:46:46.413192 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba39a6fe_6d6d_4783_843b_ac99cb2bacdc.slice/crio-d41da4517f21124d3fb30818c9c78c68e2066f8caf476001966ab413a2d9539b WatchSource:0}: Error finding container d41da4517f21124d3fb30818c9c78c68e2066f8caf476001966ab413a2d9539b: Status 404 returned error can't find the container with id d41da4517f21124d3fb30818c9c78c68e2066f8caf476001966ab413a2d9539b Jun 10 00:46:47.265063 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:47.265011 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" event={"ID":"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc","Type":"ContainerStarted","Data":"d41da4517f21124d3fb30818c9c78c68e2066f8caf476001966ab413a2d9539b"} Jun 10 00:46:50.280024 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:50.279981 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" event={"ID":"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc","Type":"ContainerStarted","Data":"811666d61c682612b4a3b83cf60e66dc0fe7099e25b24b22496b92dace765888"} Jun 10 00:46:51.285411 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:51.285372 2577 generic.go:356] "Generic (PLEG): container finished" podID="ba39a6fe-6d6d-4783-843b-ac99cb2bacdc" containerID="811666d61c682612b4a3b83cf60e66dc0fe7099e25b24b22496b92dace765888" exitCode=0 Jun 10 00:46:51.285858 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:51.285459 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" event={"ID":"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc","Type":"ContainerDied","Data":"811666d61c682612b4a3b83cf60e66dc0fe7099e25b24b22496b92dace765888"} Jun 10 00:46:52.291806 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:52.291769 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" event={"ID":"ba39a6fe-6d6d-4783-843b-ac99cb2bacdc","Type":"ContainerStarted","Data":"cb79838b6aee7bf518e3d4b26c6365670f4c000bce17b5a1aa5cbefa0ffbb8a8"} Jun 10 00:46:52.292318 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:52.291907 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:46:52.314631 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:46:52.314580 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" podStartSLOduration=2.8277707579999998 podStartE2EDuration="7.314563427s" totalImagesPullingTime="3.530719053s" totalInitContainerRuntime="956.073616ms" isStatefulPod=false podCreationTimestamp="2026-06-10 00:46:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:46:52.313253146 +0000 UTC m=+699.137159004" watchObservedRunningTime="2026-06-10 00:46:52.314563427 +0000 UTC m=+699.138469284" Jun 10 00:47:03.299499 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:03.299414 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7746866678-sq86n" Jun 10 00:47:05.809348 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.809308 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-vfxnm"] Jun 10 00:47:05.812395 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.812373 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-vfxnm" Jun 10 00:47:05.815155 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.815130 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 10 00:47:05.815282 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.815157 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8mbs4\"" Jun 10 00:47:05.824411 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.824387 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-vfxnm"] Jun 10 00:47:05.893705 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.893675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a-cert\") pod \"odh-model-controller-6dc94f689f-vfxnm\" (UID: \"f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-vfxnm" Jun 10 00:47:05.893871 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.893752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqr9d\" (UniqueName: \"kubernetes.io/projected/f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a-kube-api-access-gqr9d\") pod \"odh-model-controller-6dc94f689f-vfxnm\" (UID: \"f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-vfxnm" Jun 10 00:47:05.947321 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.947278 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5bfbfc59b5-b7gkn"] Jun 10 00:47:05.950776 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.950761 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-b7gkn" Jun 10 00:47:05.953521 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.953498 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 00:47:05.953521 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.953505 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zzhbc\"" Jun 10 00:47:05.953692 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.953525 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 00:47:05.959131 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.958811 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bfbfc59b5-b7gkn"] Jun 10 00:47:05.994285 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.994249 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qtzg\" (UniqueName: \"kubernetes.io/projected/eef3f5f3-479c-4535-b9a1-e4ac63caf164-kube-api-access-8qtzg\") pod \"kube-auth-proxy-5bfbfc59b5-b7gkn\" (UID: \"eef3f5f3-479c-4535-b9a1-e4ac63caf164\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-b7gkn" Jun 10 00:47:05.994439 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.994295 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a-cert\") pod \"odh-model-controller-6dc94f689f-vfxnm\" (UID: \"f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-vfxnm" Jun 10 00:47:05.994439 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.994348 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqr9d\" (UniqueName: \"kubernetes.io/projected/f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a-kube-api-access-gqr9d\") pod \"odh-model-controller-6dc94f689f-vfxnm\" (UID: \"f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-vfxnm" Jun 10 00:47:05.994439 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:47:05.994390 2577 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 10 00:47:05.994439 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.994399 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eef3f5f3-479c-4535-b9a1-e4ac63caf164-tmp\") pod \"kube-auth-proxy-5bfbfc59b5-b7gkn\" (UID: \"eef3f5f3-479c-4535-b9a1-e4ac63caf164\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-b7gkn" Jun 10 00:47:05.994439 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:05.994432 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eef3f5f3-479c-4535-b9a1-e4ac63caf164-tls-certs\") pod \"kube-auth-proxy-5bfbfc59b5-b7gkn\" (UID: \"eef3f5f3-479c-4535-b9a1-e4ac63caf164\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-b7gkn" Jun 10 00:47:05.994680 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:47:05.994447 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a-cert podName:f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a nodeName:}" failed. No retries permitted until 2026-06-10 00:47:06.494427573 +0000 UTC m=+713.318333428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a-cert") pod "odh-model-controller-6dc94f689f-vfxnm" (UID: "f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a") : secret "odh-model-controller-webhook-cert" not found Jun 10 00:47:06.015161 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.015137 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqr9d\" (UniqueName: \"kubernetes.io/projected/f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a-kube-api-access-gqr9d\") pod \"odh-model-controller-6dc94f689f-vfxnm\" (UID: \"f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-vfxnm" Jun 10 00:47:06.095240 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.095138 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eef3f5f3-479c-4535-b9a1-e4ac63caf164-tmp\") pod \"kube-auth-proxy-5bfbfc59b5-b7gkn\" (UID: \"eef3f5f3-479c-4535-b9a1-e4ac63caf164\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-b7gkn" Jun 10 00:47:06.095240 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.095172 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eef3f5f3-479c-4535-b9a1-e4ac63caf164-tls-certs\") pod \"kube-auth-proxy-5bfbfc59b5-b7gkn\" (UID: \"eef3f5f3-479c-4535-b9a1-e4ac63caf164\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-b7gkn" Jun 10 00:47:06.095428 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.095247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qtzg\" (UniqueName: \"kubernetes.io/projected/eef3f5f3-479c-4535-b9a1-e4ac63caf164-kube-api-access-8qtzg\") pod \"kube-auth-proxy-5bfbfc59b5-b7gkn\" (UID: \"eef3f5f3-479c-4535-b9a1-e4ac63caf164\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-b7gkn" Jun 10 00:47:06.097507 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.097478 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eef3f5f3-479c-4535-b9a1-e4ac63caf164-tmp\") pod \"kube-auth-proxy-5bfbfc59b5-b7gkn\" (UID: \"eef3f5f3-479c-4535-b9a1-e4ac63caf164\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-b7gkn" Jun 10 00:47:06.097644 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.097573 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eef3f5f3-479c-4535-b9a1-e4ac63caf164-tls-certs\") pod \"kube-auth-proxy-5bfbfc59b5-b7gkn\" (UID: \"eef3f5f3-479c-4535-b9a1-e4ac63caf164\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-b7gkn" Jun 10 00:47:06.108921 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.108900 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qtzg\" (UniqueName: \"kubernetes.io/projected/eef3f5f3-479c-4535-b9a1-e4ac63caf164-kube-api-access-8qtzg\") pod \"kube-auth-proxy-5bfbfc59b5-b7gkn\" (UID: \"eef3f5f3-479c-4535-b9a1-e4ac63caf164\") " pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-b7gkn" Jun 10 00:47:06.262354 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.262322 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-b7gkn" Jun 10 00:47:06.390725 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.390653 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bfbfc59b5-b7gkn"] Jun 10 00:47:06.393708 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:47:06.393679 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef3f5f3_479c_4535_b9a1_e4ac63caf164.slice/crio-25a78be10cc93e01cd2017ea4d7b397a628d95870c922ed4d06815ba43a53d42 WatchSource:0}: Error finding container 25a78be10cc93e01cd2017ea4d7b397a628d95870c922ed4d06815ba43a53d42: Status 404 returned error can't find the container with id 25a78be10cc93e01cd2017ea4d7b397a628d95870c922ed4d06815ba43a53d42 Jun 10 00:47:06.499596 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.499559 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a-cert\") pod \"odh-model-controller-6dc94f689f-vfxnm\" (UID: \"f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-vfxnm" Jun 10 00:47:06.502104 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.502068 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a-cert\") pod \"odh-model-controller-6dc94f689f-vfxnm\" (UID: \"f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-vfxnm" Jun 10 00:47:06.507184 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.507159 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-bc958"] Jun 10 00:47:06.510852 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.510836 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-bc958" Jun 10 00:47:06.515314 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.513672 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 10 00:47:06.515314 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.514029 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-8rxzz\"" Jun 10 00:47:06.521765 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.521740 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-bc958"] Jun 10 00:47:06.600588 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.600548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc5lt\" (UniqueName: \"kubernetes.io/projected/67612af5-05fb-4eb4-9dd5-8aa98964edbb-kube-api-access-gc5lt\") pod \"model-serving-api-5dd488fc48-bc958\" (UID: \"67612af5-05fb-4eb4-9dd5-8aa98964edbb\") " pod="opendatahub/model-serving-api-5dd488fc48-bc958" Jun 10 00:47:06.600588 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.600593 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67612af5-05fb-4eb4-9dd5-8aa98964edbb-tls-certs\") pod \"model-serving-api-5dd488fc48-bc958\" (UID: \"67612af5-05fb-4eb4-9dd5-8aa98964edbb\") " pod="opendatahub/model-serving-api-5dd488fc48-bc958" Jun 10 00:47:06.702020 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.701984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc5lt\" (UniqueName: \"kubernetes.io/projected/67612af5-05fb-4eb4-9dd5-8aa98964edbb-kube-api-access-gc5lt\") pod \"model-serving-api-5dd488fc48-bc958\" (UID: \"67612af5-05fb-4eb4-9dd5-8aa98964edbb\") " pod="opendatahub/model-serving-api-5dd488fc48-bc958" Jun 10 00:47:06.702240 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.702031 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67612af5-05fb-4eb4-9dd5-8aa98964edbb-tls-certs\") pod \"model-serving-api-5dd488fc48-bc958\" (UID: \"67612af5-05fb-4eb4-9dd5-8aa98964edbb\") " pod="opendatahub/model-serving-api-5dd488fc48-bc958" Jun 10 00:47:06.704434 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.704410 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67612af5-05fb-4eb4-9dd5-8aa98964edbb-tls-certs\") pod \"model-serving-api-5dd488fc48-bc958\" (UID: \"67612af5-05fb-4eb4-9dd5-8aa98964edbb\") " pod="opendatahub/model-serving-api-5dd488fc48-bc958" Jun 10 00:47:06.711370 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.711351 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc5lt\" (UniqueName: \"kubernetes.io/projected/67612af5-05fb-4eb4-9dd5-8aa98964edbb-kube-api-access-gc5lt\") pod \"model-serving-api-5dd488fc48-bc958\" (UID: \"67612af5-05fb-4eb4-9dd5-8aa98964edbb\") " pod="opendatahub/model-serving-api-5dd488fc48-bc958" Jun 10 00:47:06.722128 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.722104 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-vfxnm" Jun 10 00:47:06.825846 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.825803 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-bc958" Jun 10 00:47:06.848340 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.848317 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-vfxnm"] Jun 10 00:47:06.850728 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:47:06.850697 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89c3f9c_0d34_4112_a080_b1e7d4b5dc2a.slice/crio-674c72a034025fd73fa78bcade8b1326e1fafeeb1d97d3cb9dbe43a77ef8e081 WatchSource:0}: Error finding container 674c72a034025fd73fa78bcade8b1326e1fafeeb1d97d3cb9dbe43a77ef8e081: Status 404 returned error can't find the container with id 674c72a034025fd73fa78bcade8b1326e1fafeeb1d97d3cb9dbe43a77ef8e081 Jun 10 00:47:06.955182 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:06.955159 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-bc958"] Jun 10 00:47:06.957499 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:47:06.957473 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67612af5_05fb_4eb4_9dd5_8aa98964edbb.slice/crio-dd0a3684e514727873e441b5b7dcb3cf5cee26e5edc4c21c81b2748f10bd4a3c WatchSource:0}: Error finding container dd0a3684e514727873e441b5b7dcb3cf5cee26e5edc4c21c81b2748f10bd4a3c: Status 404 returned error can't find the container with id dd0a3684e514727873e441b5b7dcb3cf5cee26e5edc4c21c81b2748f10bd4a3c Jun 10 00:47:07.359031 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:07.358946 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-b7gkn" event={"ID":"eef3f5f3-479c-4535-b9a1-e4ac63caf164","Type":"ContainerStarted","Data":"25a78be10cc93e01cd2017ea4d7b397a628d95870c922ed4d06815ba43a53d42"} Jun 10 00:47:07.360405 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:07.360379 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-bc958" event={"ID":"67612af5-05fb-4eb4-9dd5-8aa98964edbb","Type":"ContainerStarted","Data":"dd0a3684e514727873e441b5b7dcb3cf5cee26e5edc4c21c81b2748f10bd4a3c"} Jun 10 00:47:07.361861 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:07.361832 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-vfxnm" event={"ID":"f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a","Type":"ContainerStarted","Data":"674c72a034025fd73fa78bcade8b1326e1fafeeb1d97d3cb9dbe43a77ef8e081"} Jun 10 00:47:12.391937 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:12.391901 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-bc958" event={"ID":"67612af5-05fb-4eb4-9dd5-8aa98964edbb","Type":"ContainerStarted","Data":"de99ce18cd122d535680ac7a1f33804d3d6c142379a4ecd862b6107252194db6"} Jun 10 00:47:12.392419 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:12.392082 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-bc958" Jun 10 00:47:12.393359 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:12.393338 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-vfxnm" event={"ID":"f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a","Type":"ContainerStarted","Data":"7abf1179c275c4f095008102c7c6fce59ffe37e74fe255b6e8ccb860fdc05dff"} Jun 10 00:47:12.393469 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:12.393434 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-vfxnm" Jun 10 00:47:12.394749 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:12.394731 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-b7gkn" event={"ID":"eef3f5f3-479c-4535-b9a1-e4ac63caf164","Type":"ContainerStarted","Data":"018bde600484df92defddbcba0138515830bf0f4b558205515dc83a78d305356"} Jun 10 00:47:12.409269 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:12.409226 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-bc958" podStartSLOduration=1.84739732 podStartE2EDuration="6.409193658s" totalImagesPullingTime="4.561796338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:47:12.407335935 +0000 UTC m=+719.231241794" watchObservedRunningTime="2026-06-10 00:47:12.409193658 +0000 UTC m=+719.233099494" Jun 10 00:47:12.424867 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:12.424812 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-vfxnm" podStartSLOduration=2.748026156 podStartE2EDuration="7.424795201s" totalImagesPullingTime="4.676769045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:47:12.424310522 +0000 UTC m=+719.248216390" watchObservedRunningTime="2026-06-10 00:47:12.424795201 +0000 UTC m=+719.248701060" Jun 10 00:47:15.570269 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.570145 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5bfbfc59b5-b7gkn" podStartSLOduration=5.447875387 podStartE2EDuration="10.570120806s" totalImagesPullingTime="5.122245419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:47:12.439265134 +0000 UTC m=+719.263170993" watchObservedRunningTime="2026-06-10 00:47:15.570120806 +0000 UTC m=+722.394026667" Jun 10 00:47:15.570745 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.570692 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-t6bjf"] Jun 10 00:47:15.575928 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.575901 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-t6bjf" Jun 10 00:47:15.578751 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.578723 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 10 00:47:15.578987 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.578814 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-cbgfm\"" Jun 10 00:47:15.589513 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.589492 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-t6bjf"] Jun 10 00:47:15.590496 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.590467 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-wzwf6"] Jun 10 00:47:15.593900 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.593875 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wzwf6" Jun 10 00:47:15.596486 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.596470 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-28g27\"" Jun 10 00:47:15.596943 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.596925 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 10 00:47:15.603593 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.603292 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-wzwf6"] Jun 10 00:47:15.685044 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.685010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c540febf-880f-4e9c-b65f-02f6eb5e8004-cert\") pod \"kserve-controller-manager-69fc866d76-t6bjf\" (UID: \"c540febf-880f-4e9c-b65f-02f6eb5e8004\") " pod="opendatahub/kserve-controller-manager-69fc866d76-t6bjf" Jun 10 00:47:15.685235 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.685053 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39a5969b-0110-4e0e-ac53-6636135b8a44-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-wzwf6\" (UID: \"39a5969b-0110-4e0e-ac53-6636135b8a44\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wzwf6" Jun 10 00:47:15.685235 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.685087 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk292\" (UniqueName: \"kubernetes.io/projected/39a5969b-0110-4e0e-ac53-6636135b8a44-kube-api-access-mk292\") pod \"llmisvc-controller-manager-864bfd7bc9-wzwf6\" (UID: \"39a5969b-0110-4e0e-ac53-6636135b8a44\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wzwf6" Jun 10 00:47:15.685235 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.685113 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md7k8\" (UniqueName: \"kubernetes.io/projected/c540febf-880f-4e9c-b65f-02f6eb5e8004-kube-api-access-md7k8\") pod \"kserve-controller-manager-69fc866d76-t6bjf\" (UID: \"c540febf-880f-4e9c-b65f-02f6eb5e8004\") " pod="opendatahub/kserve-controller-manager-69fc866d76-t6bjf" Jun 10 00:47:15.786539 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.786505 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39a5969b-0110-4e0e-ac53-6636135b8a44-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-wzwf6\" (UID: \"39a5969b-0110-4e0e-ac53-6636135b8a44\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wzwf6" Jun 10 00:47:15.786711 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.786552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk292\" (UniqueName: \"kubernetes.io/projected/39a5969b-0110-4e0e-ac53-6636135b8a44-kube-api-access-mk292\") pod \"llmisvc-controller-manager-864bfd7bc9-wzwf6\" (UID: \"39a5969b-0110-4e0e-ac53-6636135b8a44\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wzwf6" Jun 10 00:47:15.786711 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.786576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md7k8\" (UniqueName: \"kubernetes.io/projected/c540febf-880f-4e9c-b65f-02f6eb5e8004-kube-api-access-md7k8\") pod \"kserve-controller-manager-69fc866d76-t6bjf\" (UID: \"c540febf-880f-4e9c-b65f-02f6eb5e8004\") " pod="opendatahub/kserve-controller-manager-69fc866d76-t6bjf" Jun 10 00:47:15.786852 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.786760 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c540febf-880f-4e9c-b65f-02f6eb5e8004-cert\") pod \"kserve-controller-manager-69fc866d76-t6bjf\" (UID: \"c540febf-880f-4e9c-b65f-02f6eb5e8004\") " pod="opendatahub/kserve-controller-manager-69fc866d76-t6bjf" Jun 10 00:47:15.789319 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.789290 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c540febf-880f-4e9c-b65f-02f6eb5e8004-cert\") pod \"kserve-controller-manager-69fc866d76-t6bjf\" (UID: \"c540febf-880f-4e9c-b65f-02f6eb5e8004\") " pod="opendatahub/kserve-controller-manager-69fc866d76-t6bjf" Jun 10 00:47:15.789457 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.789364 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39a5969b-0110-4e0e-ac53-6636135b8a44-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-wzwf6\" (UID: \"39a5969b-0110-4e0e-ac53-6636135b8a44\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wzwf6" Jun 10 00:47:15.795227 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.795187 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md7k8\" (UniqueName: \"kubernetes.io/projected/c540febf-880f-4e9c-b65f-02f6eb5e8004-kube-api-access-md7k8\") pod \"kserve-controller-manager-69fc866d76-t6bjf\" (UID: \"c540febf-880f-4e9c-b65f-02f6eb5e8004\") " pod="opendatahub/kserve-controller-manager-69fc866d76-t6bjf" Jun 10 00:47:15.795227 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.795219 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk292\" (UniqueName: \"kubernetes.io/projected/39a5969b-0110-4e0e-ac53-6636135b8a44-kube-api-access-mk292\") pod \"llmisvc-controller-manager-864bfd7bc9-wzwf6\" (UID: \"39a5969b-0110-4e0e-ac53-6636135b8a44\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wzwf6" Jun 10 00:47:15.891128 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.891043 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-t6bjf" Jun 10 00:47:15.908360 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:15.908335 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wzwf6" Jun 10 00:47:16.050950 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:16.050922 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-t6bjf"] Jun 10 00:47:16.053717 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:47:16.053687 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc540febf_880f_4e9c_b65f_02f6eb5e8004.slice/crio-43066189e897332305ab382aa2458e48ba28a0779075be17a2f585aefe0d971b WatchSource:0}: Error finding container 43066189e897332305ab382aa2458e48ba28a0779075be17a2f585aefe0d971b: Status 404 returned error can't find the container with id 43066189e897332305ab382aa2458e48ba28a0779075be17a2f585aefe0d971b Jun 10 00:47:16.068621 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:16.068599 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-wzwf6"] Jun 10 00:47:16.070862 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:47:16.070839 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod39a5969b_0110_4e0e_ac53_6636135b8a44.slice/crio-d1a5f757af79b1851ee8f020f629f216c9dcba196c064be28b0851189c4e0242 WatchSource:0}: Error finding container d1a5f757af79b1851ee8f020f629f216c9dcba196c064be28b0851189c4e0242: Status 404 returned error can't find the container with id d1a5f757af79b1851ee8f020f629f216c9dcba196c064be28b0851189c4e0242 Jun 10 00:47:16.413321 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:16.413289 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-t6bjf" event={"ID":"c540febf-880f-4e9c-b65f-02f6eb5e8004","Type":"ContainerStarted","Data":"43066189e897332305ab382aa2458e48ba28a0779075be17a2f585aefe0d971b"} Jun 10 00:47:16.414528 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:16.414500 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wzwf6" event={"ID":"39a5969b-0110-4e0e-ac53-6636135b8a44","Type":"ContainerStarted","Data":"d1a5f757af79b1851ee8f020f629f216c9dcba196c064be28b0851189c4e0242"} Jun 10 00:47:19.434010 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:19.433971 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-t6bjf" event={"ID":"c540febf-880f-4e9c-b65f-02f6eb5e8004","Type":"ContainerStarted","Data":"75e6d05f66ee90c635001212d499f0a5e3746de1623bf424a5878b27c1b6d84f"} Jun 10 00:47:19.434565 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:19.434113 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-t6bjf" Jun 10 00:47:19.455336 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:19.455244 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-t6bjf" podStartSLOduration=1.6233214660000002 podStartE2EDuration="4.455220866s" totalImagesPullingTime="2.8318994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:47:19.454454453 +0000 UTC m=+726.278360312" watchObservedRunningTime="2026-06-10 00:47:19.455220866 +0000 UTC m=+726.279126722" Jun 10 00:47:19.619017 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:19.618983 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-dbvwz"] Jun 10 00:47:19.623416 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:19.623394 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dbvwz" Jun 10 00:47:19.626385 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:19.626358 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 10 00:47:19.626385 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:19.626367 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-vgpxg\"" Jun 10 00:47:19.626385 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:19.626358 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 10 00:47:19.638445 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:19.638415 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-dbvwz"] Jun 10 00:47:19.730612 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:19.730582 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frf7f\" (UniqueName: \"kubernetes.io/projected/0a26e0c2-d2ec-4994-85f8-b982e93a1d4a-kube-api-access-frf7f\") pod \"servicemesh-operator3-57f65f65fb-dbvwz\" (UID: \"0a26e0c2-d2ec-4994-85f8-b982e93a1d4a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dbvwz" Jun 10 00:47:19.730763 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:19.730627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0a26e0c2-d2ec-4994-85f8-b982e93a1d4a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-dbvwz\" (UID: \"0a26e0c2-d2ec-4994-85f8-b982e93a1d4a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dbvwz" Jun 10 00:47:19.831024 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:19.830987 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frf7f\" (UniqueName: \"kubernetes.io/projected/0a26e0c2-d2ec-4994-85f8-b982e93a1d4a-kube-api-access-frf7f\") pod \"servicemesh-operator3-57f65f65fb-dbvwz\" (UID: \"0a26e0c2-d2ec-4994-85f8-b982e93a1d4a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dbvwz" Jun 10 00:47:19.831217 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:19.831039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0a26e0c2-d2ec-4994-85f8-b982e93a1d4a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-dbvwz\" (UID: \"0a26e0c2-d2ec-4994-85f8-b982e93a1d4a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dbvwz" Jun 10 00:47:19.833624 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:19.833601 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0a26e0c2-d2ec-4994-85f8-b982e93a1d4a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-dbvwz\" (UID: \"0a26e0c2-d2ec-4994-85f8-b982e93a1d4a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dbvwz" Jun 10 00:47:19.844556 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:19.844533 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frf7f\" (UniqueName: \"kubernetes.io/projected/0a26e0c2-d2ec-4994-85f8-b982e93a1d4a-kube-api-access-frf7f\") pod \"servicemesh-operator3-57f65f65fb-dbvwz\" (UID: \"0a26e0c2-d2ec-4994-85f8-b982e93a1d4a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dbvwz" Jun 10 00:47:19.933764 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:19.933728 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dbvwz" Jun 10 00:47:20.092189 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:20.092164 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-dbvwz"] Jun 10 00:47:20.094596 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:47:20.094563 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a26e0c2_d2ec_4994_85f8_b982e93a1d4a.slice/crio-022acddc0385ac14fd06946dc4f92a5cdb7e2f54e2f206b386030039e5ebffa3 WatchSource:0}: Error finding container 022acddc0385ac14fd06946dc4f92a5cdb7e2f54e2f206b386030039e5ebffa3: Status 404 returned error can't find the container with id 022acddc0385ac14fd06946dc4f92a5cdb7e2f54e2f206b386030039e5ebffa3 Jun 10 00:47:20.439540 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:20.439459 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dbvwz" event={"ID":"0a26e0c2-d2ec-4994-85f8-b982e93a1d4a","Type":"ContainerStarted","Data":"022acddc0385ac14fd06946dc4f92a5cdb7e2f54e2f206b386030039e5ebffa3"} Jun 10 00:47:20.440992 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:20.440964 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wzwf6" event={"ID":"39a5969b-0110-4e0e-ac53-6636135b8a44","Type":"ContainerStarted","Data":"2ca7196cf777f3a576bdd22f1837869320fdce214947cadd98b84e9211292b2b"} Jun 10 00:47:20.441109 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:20.441046 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wzwf6" Jun 10 00:47:20.457979 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:20.457935 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wzwf6" podStartSLOduration=2.006809682 podStartE2EDuration="5.457921948s" totalImagesPullingTime="3.451112266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:47:20.457189422 +0000 UTC m=+727.281095270" watchObservedRunningTime="2026-06-10 00:47:20.457921948 +0000 UTC m=+727.281827805" Jun 10 00:47:22.138020 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:22.137987 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-8449d75f-kwpbc"] Jun 10 00:47:22.141241 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:22.141225 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8449d75f-kwpbc" Jun 10 00:47:22.143701 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:22.143679 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-m2pff\"" Jun 10 00:47:22.143831 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:22.143783 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 00:47:22.149056 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:22.149033 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8449d75f-kwpbc"] Jun 10 00:47:22.253264 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:22.253230 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kwdh\" (UniqueName: \"kubernetes.io/projected/fa6efbbf-45b4-46f9-98c0-3cb091597618-kube-api-access-6kwdh\") pod \"dashboard-redirect-8449d75f-kwpbc\" (UID: \"fa6efbbf-45b4-46f9-98c0-3cb091597618\") " pod="opendatahub/dashboard-redirect-8449d75f-kwpbc" Jun 10 00:47:22.253434 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:22.253289 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fa6efbbf-45b4-46f9-98c0-3cb091597618-redirect-config\") pod \"dashboard-redirect-8449d75f-kwpbc\" (UID: \"fa6efbbf-45b4-46f9-98c0-3cb091597618\") " pod="opendatahub/dashboard-redirect-8449d75f-kwpbc" Jun 10 00:47:22.354546 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:22.354506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kwdh\" (UniqueName: \"kubernetes.io/projected/fa6efbbf-45b4-46f9-98c0-3cb091597618-kube-api-access-6kwdh\") pod \"dashboard-redirect-8449d75f-kwpbc\" (UID: \"fa6efbbf-45b4-46f9-98c0-3cb091597618\") " pod="opendatahub/dashboard-redirect-8449d75f-kwpbc" Jun 10 00:47:22.354727 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:22.354565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fa6efbbf-45b4-46f9-98c0-3cb091597618-redirect-config\") pod \"dashboard-redirect-8449d75f-kwpbc\" (UID: \"fa6efbbf-45b4-46f9-98c0-3cb091597618\") " pod="opendatahub/dashboard-redirect-8449d75f-kwpbc" Jun 10 00:47:22.355332 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:22.355308 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/fa6efbbf-45b4-46f9-98c0-3cb091597618-redirect-config\") pod \"dashboard-redirect-8449d75f-kwpbc\" (UID: \"fa6efbbf-45b4-46f9-98c0-3cb091597618\") " pod="opendatahub/dashboard-redirect-8449d75f-kwpbc" Jun 10 00:47:22.366093 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:22.366070 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kwdh\" (UniqueName: \"kubernetes.io/projected/fa6efbbf-45b4-46f9-98c0-3cb091597618-kube-api-access-6kwdh\") pod \"dashboard-redirect-8449d75f-kwpbc\" (UID: \"fa6efbbf-45b4-46f9-98c0-3cb091597618\") " pod="opendatahub/dashboard-redirect-8449d75f-kwpbc" Jun 10 00:47:22.454943 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:22.454916 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8449d75f-kwpbc" Jun 10 00:47:22.589809 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:22.589781 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8449d75f-kwpbc"] Jun 10 00:47:22.592175 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:47:22.592147 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa6efbbf_45b4_46f9_98c0_3cb091597618.slice/crio-b8a9f939bb8e956a00e2494258ad62d0f1a4a9ca248431fd6bab0e054a1e1064 WatchSource:0}: Error finding container b8a9f939bb8e956a00e2494258ad62d0f1a4a9ca248431fd6bab0e054a1e1064: Status 404 returned error can't find the container with id b8a9f939bb8e956a00e2494258ad62d0f1a4a9ca248431fd6bab0e054a1e1064 Jun 10 00:47:23.401377 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:23.401345 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-vfxnm" Jun 10 00:47:23.403792 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:23.403771 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-bc958" Jun 10 00:47:23.457764 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:23.457731 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8449d75f-kwpbc" event={"ID":"fa6efbbf-45b4-46f9-98c0-3cb091597618","Type":"ContainerStarted","Data":"b8a9f939bb8e956a00e2494258ad62d0f1a4a9ca248431fd6bab0e054a1e1064"} Jun 10 00:47:26.475855 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:26.475812 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dbvwz" event={"ID":"0a26e0c2-d2ec-4994-85f8-b982e93a1d4a","Type":"ContainerStarted","Data":"66ca1103227ada0e3e782432da87dd8c0ba3573e69962daf8b1ce5386a9ab5ae"} Jun 10 00:47:26.476319 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:26.475975 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dbvwz" Jun 10 00:47:26.477358 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:26.477332 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8449d75f-kwpbc" event={"ID":"fa6efbbf-45b4-46f9-98c0-3cb091597618","Type":"ContainerStarted","Data":"cd878e182ba81022f2340f19221bbb6b949c3e10295f391fee94e68d2cbbc06e"} Jun 10 00:47:26.498765 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:26.498713 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dbvwz" podStartSLOduration=1.895576561 podStartE2EDuration="7.498698025s" totalImagesPullingTime="5.603121464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:47:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:47:26.4963561 +0000 UTC m=+733.320261971" watchObservedRunningTime="2026-06-10 00:47:26.498698025 +0000 UTC m=+733.322603882" Jun 10 00:47:26.510270 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:26.510226 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-8449d75f-kwpbc" podStartSLOduration=1.350705224 podStartE2EDuration="4.510187118s" totalImagesPullingTime="3.159481894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:47:26.509882196 +0000 UTC m=+733.333788067" watchObservedRunningTime="2026-06-10 00:47:26.510187118 +0000 UTC m=+733.334092976" Jun 10 00:47:28.983368 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:28.983328 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2"] Jun 10 00:47:28.986225 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:28.986189 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:28.988819 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:28.988795 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 10 00:47:28.988937 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:28.988877 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fl7h7\"" Jun 10 00:47:28.989019 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:28.988825 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 00:47:28.989089 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:28.988834 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 10 00:47:28.989157 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:28.988809 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 10 00:47:29.001745 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.001721 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2"] Jun 10 00:47:29.113881 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.113844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f42be914-1e96-43c6-8160-20460edde7de-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.113881 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.113881 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f42be914-1e96-43c6-8160-20460edde7de-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.114117 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.113926 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f42be914-1e96-43c6-8160-20460edde7de-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.114117 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.113954 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f42be914-1e96-43c6-8160-20460edde7de-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.114117 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.113988 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqf74\" (UniqueName: \"kubernetes.io/projected/f42be914-1e96-43c6-8160-20460edde7de-kube-api-access-tqf74\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.114117 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.114034 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f42be914-1e96-43c6-8160-20460edde7de-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.114295 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.114119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f42be914-1e96-43c6-8160-20460edde7de-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.215257 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.215189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f42be914-1e96-43c6-8160-20460edde7de-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.215451 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.215265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f42be914-1e96-43c6-8160-20460edde7de-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.215451 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.215298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqf74\" (UniqueName: \"kubernetes.io/projected/f42be914-1e96-43c6-8160-20460edde7de-kube-api-access-tqf74\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.215451 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.215350 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f42be914-1e96-43c6-8160-20460edde7de-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.215451 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.215420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f42be914-1e96-43c6-8160-20460edde7de-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.215677 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.215470 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f42be914-1e96-43c6-8160-20460edde7de-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.215677 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.215495 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f42be914-1e96-43c6-8160-20460edde7de-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.216051 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.216016 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f42be914-1e96-43c6-8160-20460edde7de-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.218163 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.218140 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f42be914-1e96-43c6-8160-20460edde7de-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.218279 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.218233 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f42be914-1e96-43c6-8160-20460edde7de-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.218279 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.218249 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f42be914-1e96-43c6-8160-20460edde7de-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.218497 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.218481 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f42be914-1e96-43c6-8160-20460edde7de-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.223314 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.223291 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqf74\" (UniqueName: \"kubernetes.io/projected/f42be914-1e96-43c6-8160-20460edde7de-kube-api-access-tqf74\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.223401 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.223298 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f42be914-1e96-43c6-8160-20460edde7de-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-g2hn2\" (UID: \"f42be914-1e96-43c6-8160-20460edde7de\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.296100 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.296016 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:29.438550 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.438524 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2"] Jun 10 00:47:29.440512 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:47:29.440481 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42be914_1e96_43c6_8160_20460edde7de.slice/crio-46648b96290564f7d115af8c88238c07b2aa8146064ae24ea02c4cc07d2f28e5 WatchSource:0}: Error finding container 46648b96290564f7d115af8c88238c07b2aa8146064ae24ea02c4cc07d2f28e5: Status 404 returned error can't find the container with id 46648b96290564f7d115af8c88238c07b2aa8146064ae24ea02c4cc07d2f28e5 Jun 10 00:47:29.491499 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:29.491466 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" event={"ID":"f42be914-1e96-43c6-8160-20460edde7de","Type":"ContainerStarted","Data":"46648b96290564f7d115af8c88238c07b2aa8146064ae24ea02c4cc07d2f28e5"} Jun 10 00:47:34.092456 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:34.092415 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 00:47:34.092747 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:34.092485 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 00:47:34.519266 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:34.519230 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" event={"ID":"f42be914-1e96-43c6-8160-20460edde7de","Type":"ContainerStarted","Data":"5dba2058ba5738d2fa87e766131101cca32283dc6ec9d937be4af99e3655e835"} Jun 10 00:47:34.519445 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:34.519317 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:34.546235 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:34.541638 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" podStartSLOduration=1.8920013679999999 podStartE2EDuration="6.541606272s" totalImagesPullingTime="4.649604904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:47:34.539921932 +0000 UTC m=+741.363827791" watchObservedRunningTime="2026-06-10 00:47:34.541606272 +0000 UTC m=+741.365512131" Jun 10 00:47:35.525835 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:35.525806 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-g2hn2" Jun 10 00:47:37.484457 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:37.484429 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dbvwz" Jun 10 00:47:50.446457 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:50.446428 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-t6bjf" Jun 10 00:47:51.448981 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:47:51.448948 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-wzwf6" Jun 10 00:48:42.085967 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:42.085870 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dg76b"] Jun 10 00:48:42.089594 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:42.089569 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dg76b" Jun 10 00:48:42.095617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:42.095558 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-j4898\"" Jun 10 00:48:42.096773 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:42.096751 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 00:48:42.096938 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:42.096787 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 10 00:48:42.096938 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:42.096798 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 00:48:42.103930 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:42.103905 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dg76b"] Jun 10 00:48:42.158482 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:42.158446 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwb66\" (UniqueName: \"kubernetes.io/projected/2dc4ab2c-aa7e-47b5-9c3e-b191b827140c-kube-api-access-kwb66\") pod \"dns-operator-controller-manager-864dd78c4c-dg76b\" (UID: \"2dc4ab2c-aa7e-47b5-9c3e-b191b827140c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dg76b" Jun 10 00:48:42.259420 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:42.259379 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwb66\" (UniqueName: \"kubernetes.io/projected/2dc4ab2c-aa7e-47b5-9c3e-b191b827140c-kube-api-access-kwb66\") pod \"dns-operator-controller-manager-864dd78c4c-dg76b\" (UID: \"2dc4ab2c-aa7e-47b5-9c3e-b191b827140c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dg76b" Jun 10 00:48:42.272177 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:42.272146 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwb66\" (UniqueName: \"kubernetes.io/projected/2dc4ab2c-aa7e-47b5-9c3e-b191b827140c-kube-api-access-kwb66\") pod \"dns-operator-controller-manager-864dd78c4c-dg76b\" (UID: \"2dc4ab2c-aa7e-47b5-9c3e-b191b827140c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dg76b" Jun 10 00:48:42.400054 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:42.399975 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dg76b" Jun 10 00:48:42.535101 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:42.535073 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dg76b"] Jun 10 00:48:42.537440 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:48:42.537405 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc4ab2c_aa7e_47b5_9c3e_b191b827140c.slice/crio-15efd761a6ccd3a51896eecd5033fe812a395878bf6a56d96b61d95e63b9566a WatchSource:0}: Error finding container 15efd761a6ccd3a51896eecd5033fe812a395878bf6a56d96b61d95e63b9566a: Status 404 returned error can't find the container with id 15efd761a6ccd3a51896eecd5033fe812a395878bf6a56d96b61d95e63b9566a Jun 10 00:48:42.829979 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:42.829943 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dg76b" event={"ID":"2dc4ab2c-aa7e-47b5-9c3e-b191b827140c","Type":"ContainerStarted","Data":"15efd761a6ccd3a51896eecd5033fe812a395878bf6a56d96b61d95e63b9566a"} Jun 10 00:48:44.843047 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:44.843009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dg76b" event={"ID":"2dc4ab2c-aa7e-47b5-9c3e-b191b827140c","Type":"ContainerStarted","Data":"a589bb5a016ab10602d16db6d1b440c7bf867b3f96f37b6c3e59daf79bb10af1"} Jun 10 00:48:44.843457 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:44.843090 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dg76b" Jun 10 00:48:44.860837 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:44.860780 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dg76b" podStartSLOduration=0.665075779 podStartE2EDuration="2.860764552s" totalImagesPullingTime="2.195688773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:48:44.859487765 +0000 UTC m=+811.683393623" watchObservedRunningTime="2026-06-10 00:48:44.860764552 +0000 UTC m=+811.684670410" Jun 10 00:48:47.236519 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:47.236477 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x"] Jun 10 00:48:47.240487 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:47.240463 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" Jun 10 00:48:47.243379 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:47.243355 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x2xlt\"" Jun 10 00:48:47.251580 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:47.251558 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x"] Jun 10 00:48:47.304880 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:47.304840 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8567639a-7b01-4f38-a373-06edf43d8bb5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5nn4x\" (UID: \"8567639a-7b01-4f38-a373-06edf43d8bb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" Jun 10 00:48:47.305040 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:47.304897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnq5r\" (UniqueName: \"kubernetes.io/projected/8567639a-7b01-4f38-a373-06edf43d8bb5-kube-api-access-dnq5r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5nn4x\" (UID: \"8567639a-7b01-4f38-a373-06edf43d8bb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" Jun 10 00:48:47.406384 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:47.406344 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8567639a-7b01-4f38-a373-06edf43d8bb5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5nn4x\" (UID: \"8567639a-7b01-4f38-a373-06edf43d8bb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" Jun 10 00:48:47.406569 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:47.406404 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnq5r\" (UniqueName: \"kubernetes.io/projected/8567639a-7b01-4f38-a373-06edf43d8bb5-kube-api-access-dnq5r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5nn4x\" (UID: \"8567639a-7b01-4f38-a373-06edf43d8bb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" Jun 10 00:48:47.406806 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:47.406783 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8567639a-7b01-4f38-a373-06edf43d8bb5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5nn4x\" (UID: \"8567639a-7b01-4f38-a373-06edf43d8bb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" Jun 10 00:48:47.414438 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:47.414405 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnq5r\" (UniqueName: \"kubernetes.io/projected/8567639a-7b01-4f38-a373-06edf43d8bb5-kube-api-access-dnq5r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5nn4x\" (UID: \"8567639a-7b01-4f38-a373-06edf43d8bb5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" Jun 10 00:48:47.551553 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:47.551463 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" Jun 10 00:48:47.687496 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:47.687462 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x"] Jun 10 00:48:47.690185 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:48:47.690151 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8567639a_7b01_4f38_a373_06edf43d8bb5.slice/crio-2b60507d0bd9fae133be352314bf9e48c2b0eb8820a0d82568f491685e03bd3e WatchSource:0}: Error finding container 2b60507d0bd9fae133be352314bf9e48c2b0eb8820a0d82568f491685e03bd3e: Status 404 returned error can't find the container with id 2b60507d0bd9fae133be352314bf9e48c2b0eb8820a0d82568f491685e03bd3e Jun 10 00:48:47.859109 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:47.859025 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" event={"ID":"8567639a-7b01-4f38-a373-06edf43d8bb5","Type":"ContainerStarted","Data":"2b60507d0bd9fae133be352314bf9e48c2b0eb8820a0d82568f491685e03bd3e"} Jun 10 00:48:55.850787 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:55.850752 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dg76b" Jun 10 00:48:56.907481 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:56.907444 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" event={"ID":"8567639a-7b01-4f38-a373-06edf43d8bb5","Type":"ContainerStarted","Data":"bb55b4f547b7a82c345497dccb0ef263b17bbd7ffe06056e2eb6910ce4d8e52a"} Jun 10 00:48:56.907873 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:56.907526 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" Jun 10 00:48:56.928778 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:48:56.928720 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" podStartSLOduration=1.714238886 podStartE2EDuration="9.928704042s" totalImagesPullingTime="8.214465156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:48:56.926030199 +0000 UTC m=+823.749936059" watchObservedRunningTime="2026-06-10 00:48:56.928704042 +0000 UTC m=+823.752609899" Jun 10 00:49:07.914966 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:07.914933 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" Jun 10 00:49:09.554865 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.554831 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x"] Jun 10 00:49:09.555336 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.555020 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" podUID="8567639a-7b01-4f38-a373-06edf43d8bb5" containerName="manager" containerID="cri-o://bb55b4f547b7a82c345497dccb0ef263b17bbd7ffe06056e2eb6910ce4d8e52a" gracePeriod=2 Jun 10 00:49:09.565673 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.565647 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x"] Jun 10 00:49:09.569971 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:49:09.569934 2577 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8567639a-7b01-4f38-a373-06edf43d8bb5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-5nn4x\": pods \"kuadrant-operator-controller-manager-8684c9ff49-5nn4x\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" Jun 10 00:49:09.579736 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.579710 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5"] Jun 10 00:49:09.580097 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.580084 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8567639a-7b01-4f38-a373-06edf43d8bb5" containerName="manager" Jun 10 00:49:09.580151 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.580099 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8567639a-7b01-4f38-a373-06edf43d8bb5" containerName="manager" Jun 10 00:49:09.580192 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.580165 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8567639a-7b01-4f38-a373-06edf43d8bb5" containerName="manager" Jun 10 00:49:09.583940 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.583924 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" Jun 10 00:49:09.586764 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:49:09.586684 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5nn4x\" is forbidden: User \"system:node:ip-10-0-131-237.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-237.ec2.internal' and this object" podUID="8567639a-7b01-4f38-a373-06edf43d8bb5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" Jun 10 00:49:09.602510 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.602483 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5"] Jun 10 00:49:09.714294 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.714257 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e39c8da-70d7-4ee4-81df-7f7c76e17203-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qq5v5\" (UID: \"8e39c8da-70d7-4ee4-81df-7f7c76e17203\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" Jun 10 00:49:09.714443 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.714305 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72dg4\" (UniqueName: \"kubernetes.io/projected/8e39c8da-70d7-4ee4-81df-7f7c76e17203-kube-api-access-72dg4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qq5v5\" (UID: \"8e39c8da-70d7-4ee4-81df-7f7c76e17203\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" Jun 10 00:49:09.800168 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.800142 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" Jun 10 00:49:09.814887 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.814840 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e39c8da-70d7-4ee4-81df-7f7c76e17203-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qq5v5\" (UID: \"8e39c8da-70d7-4ee4-81df-7f7c76e17203\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" Jun 10 00:49:09.814887 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.814875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72dg4\" (UniqueName: \"kubernetes.io/projected/8e39c8da-70d7-4ee4-81df-7f7c76e17203-kube-api-access-72dg4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qq5v5\" (UID: \"8e39c8da-70d7-4ee4-81df-7f7c76e17203\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" Jun 10 00:49:09.815186 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.815169 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e39c8da-70d7-4ee4-81df-7f7c76e17203-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qq5v5\" (UID: \"8e39c8da-70d7-4ee4-81df-7f7c76e17203\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" Jun 10 00:49:09.828197 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.828169 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72dg4\" (UniqueName: \"kubernetes.io/projected/8e39c8da-70d7-4ee4-81df-7f7c76e17203-kube-api-access-72dg4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qq5v5\" (UID: \"8e39c8da-70d7-4ee4-81df-7f7c76e17203\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" Jun 10 00:49:09.915932 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.915895 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnq5r\" (UniqueName: \"kubernetes.io/projected/8567639a-7b01-4f38-a373-06edf43d8bb5-kube-api-access-dnq5r\") pod \"8567639a-7b01-4f38-a373-06edf43d8bb5\" (UID: \"8567639a-7b01-4f38-a373-06edf43d8bb5\") " Jun 10 00:49:09.916072 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.916001 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8567639a-7b01-4f38-a373-06edf43d8bb5-extensions-socket-volume\") pod \"8567639a-7b01-4f38-a373-06edf43d8bb5\" (UID: \"8567639a-7b01-4f38-a373-06edf43d8bb5\") " Jun 10 00:49:09.916540 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.916511 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8567639a-7b01-4f38-a373-06edf43d8bb5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8567639a-7b01-4f38-a373-06edf43d8bb5" (UID: "8567639a-7b01-4f38-a373-06edf43d8bb5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:49:09.918050 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.918021 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8567639a-7b01-4f38-a373-06edf43d8bb5-kube-api-access-dnq5r" (OuterVolumeSpecName: "kube-api-access-dnq5r") pod "8567639a-7b01-4f38-a373-06edf43d8bb5" (UID: "8567639a-7b01-4f38-a373-06edf43d8bb5"). InnerVolumeSpecName "kube-api-access-dnq5r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:49:09.940211 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.940185 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" Jun 10 00:49:09.971130 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.971096 2577 generic.go:356] "Generic (PLEG): container finished" podID="8567639a-7b01-4f38-a373-06edf43d8bb5" containerID="bb55b4f547b7a82c345497dccb0ef263b17bbd7ffe06056e2eb6910ce4d8e52a" exitCode=0 Jun 10 00:49:09.971275 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.971134 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5nn4x" Jun 10 00:49:09.971275 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.971197 2577 scope.go:117] "RemoveContainer" containerID="bb55b4f547b7a82c345497dccb0ef263b17bbd7ffe06056e2eb6910ce4d8e52a" Jun 10 00:49:09.980081 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.980061 2577 scope.go:117] "RemoveContainer" containerID="bb55b4f547b7a82c345497dccb0ef263b17bbd7ffe06056e2eb6910ce4d8e52a" Jun 10 00:49:09.980401 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:49:09.980380 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb55b4f547b7a82c345497dccb0ef263b17bbd7ffe06056e2eb6910ce4d8e52a\": container with ID starting with bb55b4f547b7a82c345497dccb0ef263b17bbd7ffe06056e2eb6910ce4d8e52a not found: ID does not exist" containerID="bb55b4f547b7a82c345497dccb0ef263b17bbd7ffe06056e2eb6910ce4d8e52a" Jun 10 00:49:09.980464 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:09.980411 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb55b4f547b7a82c345497dccb0ef263b17bbd7ffe06056e2eb6910ce4d8e52a"} err="failed to get container status \"bb55b4f547b7a82c345497dccb0ef263b17bbd7ffe06056e2eb6910ce4d8e52a\": rpc error: code = NotFound desc = could not find container \"bb55b4f547b7a82c345497dccb0ef263b17bbd7ffe06056e2eb6910ce4d8e52a\": container with ID starting with bb55b4f547b7a82c345497dccb0ef263b17bbd7ffe06056e2eb6910ce4d8e52a not found: ID does not exist" Jun 10 00:49:10.017144 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:10.017117 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnq5r\" (UniqueName: \"kubernetes.io/projected/8567639a-7b01-4f38-a373-06edf43d8bb5-kube-api-access-dnq5r\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:49:10.017144 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:10.017142 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8567639a-7b01-4f38-a373-06edf43d8bb5-extensions-socket-volume\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:49:10.089441 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:10.089418 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5"] Jun 10 00:49:10.091631 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:49:10.091602 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e39c8da_70d7_4ee4_81df_7f7c76e17203.slice/crio-b6138da9bb70e3dd4111555533f1cbf56a02e1ea46e671a92166286ab95242ae WatchSource:0}: Error finding container b6138da9bb70e3dd4111555533f1cbf56a02e1ea46e671a92166286ab95242ae: Status 404 returned error can't find the container with id b6138da9bb70e3dd4111555533f1cbf56a02e1ea46e671a92166286ab95242ae Jun 10 00:49:10.982135 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:10.982096 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" event={"ID":"8e39c8da-70d7-4ee4-81df-7f7c76e17203","Type":"ContainerStarted","Data":"c7810cdcaaa1e829e6afbea4787eaef259e2c9e6b325da837d8e795508ac82fa"} Jun 10 00:49:10.982646 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:10.982191 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" event={"ID":"8e39c8da-70d7-4ee4-81df-7f7c76e17203","Type":"ContainerStarted","Data":"b6138da9bb70e3dd4111555533f1cbf56a02e1ea46e671a92166286ab95242ae"} Jun 10 00:49:10.982646 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:10.982239 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" Jun 10 00:49:11.002766 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:11.002719 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" podStartSLOduration=2.002703432 podStartE2EDuration="2.002703432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:49:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:49:11.000367751 +0000 UTC m=+837.824273643" watchObservedRunningTime="2026-06-10 00:49:11.002703432 +0000 UTC m=+837.826609291" Jun 10 00:49:11.599968 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:11.599929 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8567639a-7b01-4f38-a373-06edf43d8bb5" path="/var/lib/kubelet/pods/8567639a-7b01-4f38-a373-06edf43d8bb5/volumes" Jun 10 00:49:21.990069 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:21.990037 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" Jun 10 00:49:27.259109 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:27.259060 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5"] Jun 10 00:49:27.259598 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:27.259361 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" podUID="8e39c8da-70d7-4ee4-81df-7f7c76e17203" containerName="manager" containerID="cri-o://c7810cdcaaa1e829e6afbea4787eaef259e2c9e6b325da837d8e795508ac82fa" gracePeriod=10 Jun 10 00:49:27.531052 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:27.530955 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v"] Jun 10 00:49:27.535710 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:27.535680 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" Jun 10 00:49:27.548827 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:27.548801 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v"] Jun 10 00:49:27.662393 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:27.662355 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/476679de-3817-4faa-aea0-59c94df053cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wdg2v\" (UID: \"476679de-3817-4faa-aea0-59c94df053cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" Jun 10 00:49:27.662582 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:27.662421 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84cv6\" (UniqueName: \"kubernetes.io/projected/476679de-3817-4faa-aea0-59c94df053cc-kube-api-access-84cv6\") pod \"kuadrant-operator-controller-manager-86878c769f-wdg2v\" (UID: \"476679de-3817-4faa-aea0-59c94df053cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" Jun 10 00:49:27.763327 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:27.763289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84cv6\" (UniqueName: \"kubernetes.io/projected/476679de-3817-4faa-aea0-59c94df053cc-kube-api-access-84cv6\") pod \"kuadrant-operator-controller-manager-86878c769f-wdg2v\" (UID: \"476679de-3817-4faa-aea0-59c94df053cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" Jun 10 00:49:27.763484 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:27.763387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/476679de-3817-4faa-aea0-59c94df053cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wdg2v\" (UID: \"476679de-3817-4faa-aea0-59c94df053cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" Jun 10 00:49:27.763697 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:27.763682 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/476679de-3817-4faa-aea0-59c94df053cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wdg2v\" (UID: \"476679de-3817-4faa-aea0-59c94df053cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" Jun 10 00:49:27.771721 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:27.771699 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84cv6\" (UniqueName: \"kubernetes.io/projected/476679de-3817-4faa-aea0-59c94df053cc-kube-api-access-84cv6\") pod \"kuadrant-operator-controller-manager-86878c769f-wdg2v\" (UID: \"476679de-3817-4faa-aea0-59c94df053cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" Jun 10 00:49:27.847326 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:27.847300 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" Jun 10 00:49:28.010510 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.010463 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v"] Jun 10 00:49:28.013983 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:49:28.013953 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod476679de_3817_4faa_aea0_59c94df053cc.slice/crio-bf9da4af8ee84f5aa96000bac4f1ab721a7f16139f34097762421f3ce01e3bc8 WatchSource:0}: Error finding container bf9da4af8ee84f5aa96000bac4f1ab721a7f16139f34097762421f3ce01e3bc8: Status 404 returned error can't find the container with id bf9da4af8ee84f5aa96000bac4f1ab721a7f16139f34097762421f3ce01e3bc8 Jun 10 00:49:28.035085 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.035064 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" Jun 10 00:49:28.064538 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.064498 2577 generic.go:356] "Generic (PLEG): container finished" podID="8e39c8da-70d7-4ee4-81df-7f7c76e17203" containerID="c7810cdcaaa1e829e6afbea4787eaef259e2c9e6b325da837d8e795508ac82fa" exitCode=0 Jun 10 00:49:28.064674 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.064538 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" Jun 10 00:49:28.064674 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.064607 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" event={"ID":"8e39c8da-70d7-4ee4-81df-7f7c76e17203","Type":"ContainerDied","Data":"c7810cdcaaa1e829e6afbea4787eaef259e2c9e6b325da837d8e795508ac82fa"} Jun 10 00:49:28.064674 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.064657 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5" event={"ID":"8e39c8da-70d7-4ee4-81df-7f7c76e17203","Type":"ContainerDied","Data":"b6138da9bb70e3dd4111555533f1cbf56a02e1ea46e671a92166286ab95242ae"} Jun 10 00:49:28.064819 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.064691 2577 scope.go:117] "RemoveContainer" containerID="c7810cdcaaa1e829e6afbea4787eaef259e2c9e6b325da837d8e795508ac82fa" Jun 10 00:49:28.066843 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.066818 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" event={"ID":"476679de-3817-4faa-aea0-59c94df053cc","Type":"ContainerStarted","Data":"bf9da4af8ee84f5aa96000bac4f1ab721a7f16139f34097762421f3ce01e3bc8"} Jun 10 00:49:28.073884 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.073826 2577 scope.go:117] "RemoveContainer" containerID="c7810cdcaaa1e829e6afbea4787eaef259e2c9e6b325da837d8e795508ac82fa" Jun 10 00:49:28.074194 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:49:28.074167 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7810cdcaaa1e829e6afbea4787eaef259e2c9e6b325da837d8e795508ac82fa\": container with ID starting with c7810cdcaaa1e829e6afbea4787eaef259e2c9e6b325da837d8e795508ac82fa not found: ID does not exist" containerID="c7810cdcaaa1e829e6afbea4787eaef259e2c9e6b325da837d8e795508ac82fa" Jun 10 00:49:28.074194 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.074230 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7810cdcaaa1e829e6afbea4787eaef259e2c9e6b325da837d8e795508ac82fa"} err="failed to get container status \"c7810cdcaaa1e829e6afbea4787eaef259e2c9e6b325da837d8e795508ac82fa\": rpc error: code = NotFound desc = could not find container \"c7810cdcaaa1e829e6afbea4787eaef259e2c9e6b325da837d8e795508ac82fa\": container with ID starting with c7810cdcaaa1e829e6afbea4787eaef259e2c9e6b325da837d8e795508ac82fa not found: ID does not exist" Jun 10 00:49:28.167182 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.167091 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e39c8da-70d7-4ee4-81df-7f7c76e17203-extensions-socket-volume\") pod \"8e39c8da-70d7-4ee4-81df-7f7c76e17203\" (UID: \"8e39c8da-70d7-4ee4-81df-7f7c76e17203\") " Jun 10 00:49:28.167182 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.167140 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72dg4\" (UniqueName: \"kubernetes.io/projected/8e39c8da-70d7-4ee4-81df-7f7c76e17203-kube-api-access-72dg4\") pod \"8e39c8da-70d7-4ee4-81df-7f7c76e17203\" (UID: \"8e39c8da-70d7-4ee4-81df-7f7c76e17203\") " Jun 10 00:49:28.167574 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.167546 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e39c8da-70d7-4ee4-81df-7f7c76e17203-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8e39c8da-70d7-4ee4-81df-7f7c76e17203" (UID: "8e39c8da-70d7-4ee4-81df-7f7c76e17203"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 00:49:28.169573 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.169548 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e39c8da-70d7-4ee4-81df-7f7c76e17203-kube-api-access-72dg4" (OuterVolumeSpecName: "kube-api-access-72dg4") pod "8e39c8da-70d7-4ee4-81df-7f7c76e17203" (UID: "8e39c8da-70d7-4ee4-81df-7f7c76e17203"). InnerVolumeSpecName "kube-api-access-72dg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:49:28.267801 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.267761 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e39c8da-70d7-4ee4-81df-7f7c76e17203-extensions-socket-volume\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:49:28.267801 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.267792 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72dg4\" (UniqueName: \"kubernetes.io/projected/8e39c8da-70d7-4ee4-81df-7f7c76e17203-kube-api-access-72dg4\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:49:28.389304 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.389269 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5"] Jun 10 00:49:28.393085 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:28.393058 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qq5v5"] Jun 10 00:49:29.074081 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:29.073988 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" event={"ID":"476679de-3817-4faa-aea0-59c94df053cc","Type":"ContainerStarted","Data":"9a405a9bb65d3a1940cbd94bb2427b0e966b37bf5dc935428b0e631073422b38"} Jun 10 00:49:29.074238 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:29.074096 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" Jun 10 00:49:29.093912 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:29.093864 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" podStartSLOduration=2.093848672 podStartE2EDuration="2.093848672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:49:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:49:29.092123276 +0000 UTC m=+855.916029133" watchObservedRunningTime="2026-06-10 00:49:29.093848672 +0000 UTC m=+855.917754529" Jun 10 00:49:29.600356 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:29.600325 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e39c8da-70d7-4ee4-81df-7f7c76e17203" path="/var/lib/kubelet/pods/8e39c8da-70d7-4ee4-81df-7f7c76e17203/volumes" Jun 10 00:49:40.081994 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:40.081962 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" Jun 10 00:49:48.511860 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:48.511815 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:49:48.512458 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:48.512380 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e39c8da-70d7-4ee4-81df-7f7c76e17203" containerName="manager" Jun 10 00:49:48.512458 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:48.512400 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e39c8da-70d7-4ee4-81df-7f7c76e17203" containerName="manager" Jun 10 00:49:48.512550 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:48.512525 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e39c8da-70d7-4ee4-81df-7f7c76e17203" containerName="manager" Jun 10 00:49:48.515602 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:48.515588 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xs7wn" Jun 10 00:49:48.517982 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:48.517956 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 00:49:48.518174 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:48.518156 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4q82l\"" Jun 10 00:49:48.524270 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:48.524245 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:49:48.550324 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:48.550289 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:49:48.646588 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:48.646552 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dpdq\" (UniqueName: \"kubernetes.io/projected/a164fea2-ffc8-48b2-a445-6d6cb40e9284-kube-api-access-5dpdq\") pod \"limitador-limitador-54d6d988d5-xs7wn\" (UID: \"a164fea2-ffc8-48b2-a445-6d6cb40e9284\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xs7wn" Jun 10 00:49:48.646760 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:48.646609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a164fea2-ffc8-48b2-a445-6d6cb40e9284-config-file\") pod \"limitador-limitador-54d6d988d5-xs7wn\" (UID: \"a164fea2-ffc8-48b2-a445-6d6cb40e9284\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xs7wn" Jun 10 00:49:48.747353 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:48.747323 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a164fea2-ffc8-48b2-a445-6d6cb40e9284-config-file\") pod \"limitador-limitador-54d6d988d5-xs7wn\" (UID: \"a164fea2-ffc8-48b2-a445-6d6cb40e9284\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xs7wn" Jun 10 00:49:48.747752 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:48.747728 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dpdq\" (UniqueName: \"kubernetes.io/projected/a164fea2-ffc8-48b2-a445-6d6cb40e9284-kube-api-access-5dpdq\") pod \"limitador-limitador-54d6d988d5-xs7wn\" (UID: \"a164fea2-ffc8-48b2-a445-6d6cb40e9284\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xs7wn" Jun 10 00:49:48.748068 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:48.748046 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a164fea2-ffc8-48b2-a445-6d6cb40e9284-config-file\") pod \"limitador-limitador-54d6d988d5-xs7wn\" (UID: \"a164fea2-ffc8-48b2-a445-6d6cb40e9284\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xs7wn" Jun 10 00:49:48.756711 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:48.756692 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dpdq\" (UniqueName: \"kubernetes.io/projected/a164fea2-ffc8-48b2-a445-6d6cb40e9284-kube-api-access-5dpdq\") pod \"limitador-limitador-54d6d988d5-xs7wn\" (UID: \"a164fea2-ffc8-48b2-a445-6d6cb40e9284\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xs7wn" Jun 10 00:49:48.826546 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:48.826453 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xs7wn" Jun 10 00:49:48.957919 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:48.957893 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:49:49.171328 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:49.171242 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xs7wn" event={"ID":"a164fea2-ffc8-48b2-a445-6d6cb40e9284","Type":"ContainerStarted","Data":"c2cd1f85886c39fffeefcb0ce53746d16a20cc6e09063b25ef2c0c06c1e703cc"} Jun 10 00:49:52.188404 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:52.188367 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xs7wn" event={"ID":"a164fea2-ffc8-48b2-a445-6d6cb40e9284","Type":"ContainerStarted","Data":"f923338fb621a318b4e99c3c1f905883a3a5a81bc6738fb0fdb145ca17d99b45"} Jun 10 00:49:52.188778 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:52.188447 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xs7wn" Jun 10 00:49:52.203870 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:49:52.203815 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-xs7wn" podStartSLOduration=1.8503886550000002 podStartE2EDuration="4.203801947s" totalImagesPullingTime="2.353413292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:49:52.203315164 +0000 UTC m=+879.027221021" watchObservedRunningTime="2026-06-10 00:49:52.203801947 +0000 UTC m=+879.027707805" Jun 10 00:50:03.194922 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:50:03.194843 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xs7wn" Jun 10 00:50:13.600209 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:50:13.600176 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 00:50:13.600668 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:50:13.600438 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 00:51:37.381351 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.381262 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8c9b466c6-9ljv8"] Jun 10 00:51:37.384804 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.384782 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c9b466c6-9ljv8" Jun 10 00:51:37.388050 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.388027 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 00:51:37.388162 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.388073 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gdk2k\"" Jun 10 00:51:37.388263 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.388187 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 00:51:37.395037 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.395014 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c9b466c6-9ljv8"] Jun 10 00:51:37.502327 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.502289 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmvcz\" (UniqueName: \"kubernetes.io/projected/1785598f-1781-40d6-8df8-c61ceb84c04b-kube-api-access-gmvcz\") pod \"maas-controller-8c9b466c6-9ljv8\" (UID: \"1785598f-1781-40d6-8df8-c61ceb84c04b\") " pod="opendatahub/maas-controller-8c9b466c6-9ljv8" Jun 10 00:51:37.502538 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.502353 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1785598f-1781-40d6-8df8-c61ceb84c04b-webhook-cert\") pod \"maas-controller-8c9b466c6-9ljv8\" (UID: \"1785598f-1781-40d6-8df8-c61ceb84c04b\") " pod="opendatahub/maas-controller-8c9b466c6-9ljv8" Jun 10 00:51:37.588213 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.588176 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69b67d4c4b-4hpqx"] Jun 10 00:51:37.591750 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.591728 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" Jun 10 00:51:37.603014 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.602990 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69b67d4c4b-4hpqx"] Jun 10 00:51:37.603140 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.603073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1785598f-1781-40d6-8df8-c61ceb84c04b-webhook-cert\") pod \"maas-controller-8c9b466c6-9ljv8\" (UID: \"1785598f-1781-40d6-8df8-c61ceb84c04b\") " pod="opendatahub/maas-controller-8c9b466c6-9ljv8" Jun 10 00:51:37.603236 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.603153 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmvcz\" (UniqueName: \"kubernetes.io/projected/1785598f-1781-40d6-8df8-c61ceb84c04b-kube-api-access-gmvcz\") pod \"maas-controller-8c9b466c6-9ljv8\" (UID: \"1785598f-1781-40d6-8df8-c61ceb84c04b\") " pod="opendatahub/maas-controller-8c9b466c6-9ljv8" Jun 10 00:51:37.605582 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.605555 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1785598f-1781-40d6-8df8-c61ceb84c04b-webhook-cert\") pod \"maas-controller-8c9b466c6-9ljv8\" (UID: \"1785598f-1781-40d6-8df8-c61ceb84c04b\") " pod="opendatahub/maas-controller-8c9b466c6-9ljv8" Jun 10 00:51:37.613910 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.613879 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmvcz\" (UniqueName: \"kubernetes.io/projected/1785598f-1781-40d6-8df8-c61ceb84c04b-kube-api-access-gmvcz\") pod \"maas-controller-8c9b466c6-9ljv8\" (UID: \"1785598f-1781-40d6-8df8-c61ceb84c04b\") " pod="opendatahub/maas-controller-8c9b466c6-9ljv8" Jun 10 00:51:37.697151 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.697113 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c9b466c6-9ljv8" Jun 10 00:51:37.704256 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.704234 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbccn\" (UniqueName: \"kubernetes.io/projected/0f6078dd-2df6-4f79-87b3-0df5fc608269-kube-api-access-zbccn\") pod \"maas-controller-69b67d4c4b-4hpqx\" (UID: \"0f6078dd-2df6-4f79-87b3-0df5fc608269\") " pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" Jun 10 00:51:37.704370 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.704272 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f6078dd-2df6-4f79-87b3-0df5fc608269-webhook-cert\") pod \"maas-controller-69b67d4c4b-4hpqx\" (UID: \"0f6078dd-2df6-4f79-87b3-0df5fc608269\") " pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" Jun 10 00:51:37.805819 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.805787 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbccn\" (UniqueName: \"kubernetes.io/projected/0f6078dd-2df6-4f79-87b3-0df5fc608269-kube-api-access-zbccn\") pod \"maas-controller-69b67d4c4b-4hpqx\" (UID: \"0f6078dd-2df6-4f79-87b3-0df5fc608269\") " pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" Jun 10 00:51:37.805974 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.805827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f6078dd-2df6-4f79-87b3-0df5fc608269-webhook-cert\") pod \"maas-controller-69b67d4c4b-4hpqx\" (UID: \"0f6078dd-2df6-4f79-87b3-0df5fc608269\") " pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" Jun 10 00:51:37.808186 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.808160 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f6078dd-2df6-4f79-87b3-0df5fc608269-webhook-cert\") pod \"maas-controller-69b67d4c4b-4hpqx\" (UID: \"0f6078dd-2df6-4f79-87b3-0df5fc608269\") " pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" Jun 10 00:51:37.813631 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.813604 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbccn\" (UniqueName: \"kubernetes.io/projected/0f6078dd-2df6-4f79-87b3-0df5fc608269-kube-api-access-zbccn\") pod \"maas-controller-69b67d4c4b-4hpqx\" (UID: \"0f6078dd-2df6-4f79-87b3-0df5fc608269\") " pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" Jun 10 00:51:37.829151 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.829131 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c9b466c6-9ljv8"] Jun 10 00:51:37.831868 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:51:37.831840 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1785598f_1781_40d6_8df8_c61ceb84c04b.slice/crio-957216d343c435bbfc4ab11301a5cd4adf257bfc44cae0336db3470041a49960 WatchSource:0}: Error finding container 957216d343c435bbfc4ab11301a5cd4adf257bfc44cae0336db3470041a49960: Status 404 returned error can't find the container with id 957216d343c435bbfc4ab11301a5cd4adf257bfc44cae0336db3470041a49960 Jun 10 00:51:37.833133 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.833118 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 00:51:37.903251 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:37.903221 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" Jun 10 00:51:38.032947 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:38.032920 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69b67d4c4b-4hpqx"] Jun 10 00:51:38.035493 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:51:38.035467 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f6078dd_2df6_4f79_87b3_0df5fc608269.slice/crio-28572b85f04a52d7563a8ff62fa873c1e51ac59d5b7d48fe7dabea6e31232100 WatchSource:0}: Error finding container 28572b85f04a52d7563a8ff62fa873c1e51ac59d5b7d48fe7dabea6e31232100: Status 404 returned error can't find the container with id 28572b85f04a52d7563a8ff62fa873c1e51ac59d5b7d48fe7dabea6e31232100 Jun 10 00:51:38.699928 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:38.699873 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" event={"ID":"0f6078dd-2df6-4f79-87b3-0df5fc608269","Type":"ContainerStarted","Data":"28572b85f04a52d7563a8ff62fa873c1e51ac59d5b7d48fe7dabea6e31232100"} Jun 10 00:51:38.702914 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:38.702879 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c9b466c6-9ljv8" event={"ID":"1785598f-1781-40d6-8df8-c61ceb84c04b","Type":"ContainerStarted","Data":"957216d343c435bbfc4ab11301a5cd4adf257bfc44cae0336db3470041a49960"} Jun 10 00:51:40.715789 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:40.715745 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" event={"ID":"0f6078dd-2df6-4f79-87b3-0df5fc608269","Type":"ContainerStarted","Data":"c2c11d273840aab0fcd19fb4cc87b6275887147f97b57c21ea398b2c8aa92442"} Jun 10 00:51:40.716284 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:40.715921 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" Jun 10 00:51:40.717391 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:40.717365 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c9b466c6-9ljv8" event={"ID":"1785598f-1781-40d6-8df8-c61ceb84c04b","Type":"ContainerStarted","Data":"1717c018bb7f796982231cf51894b178aadac166622a0ce2e1c56baa1184b782"} Jun 10 00:51:40.717495 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:40.717407 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8c9b466c6-9ljv8" Jun 10 00:51:40.742523 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:40.742470 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" podStartSLOduration=1.345823867 podStartE2EDuration="3.742456035s" totalImagesPullingTime="2.396632168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:51:40.741493812 +0000 UTC m=+987.565399671" watchObservedRunningTime="2026-06-10 00:51:40.742456035 +0000 UTC m=+987.566361893" Jun 10 00:51:40.761702 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:40.761649 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8c9b466c6-9ljv8" podStartSLOduration=1.173302663 podStartE2EDuration="3.761633385s" totalImagesPullingTime="2.588330722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:51:40.759650127 +0000 UTC m=+987.583555985" watchObservedRunningTime="2026-06-10 00:51:40.761633385 +0000 UTC m=+987.585539265" Jun 10 00:51:51.726462 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:51.726428 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8c9b466c6-9ljv8" Jun 10 00:51:51.726960 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:51.726609 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" Jun 10 00:51:51.783550 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:51.783518 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8c9b466c6-9ljv8"] Jun 10 00:51:51.783744 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:51.783720 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-8c9b466c6-9ljv8" podUID="1785598f-1781-40d6-8df8-c61ceb84c04b" containerName="manager" containerID="cri-o://1717c018bb7f796982231cf51894b178aadac166622a0ce2e1c56baa1184b782" gracePeriod=30 Jun 10 00:51:52.042957 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:52.042929 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c9b466c6-9ljv8" Jun 10 00:51:52.121851 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:52.121818 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1785598f-1781-40d6-8df8-c61ceb84c04b-webhook-cert\") pod \"1785598f-1781-40d6-8df8-c61ceb84c04b\" (UID: \"1785598f-1781-40d6-8df8-c61ceb84c04b\") " Jun 10 00:51:52.121851 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:52.121858 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmvcz\" (UniqueName: \"kubernetes.io/projected/1785598f-1781-40d6-8df8-c61ceb84c04b-kube-api-access-gmvcz\") pod \"1785598f-1781-40d6-8df8-c61ceb84c04b\" (UID: \"1785598f-1781-40d6-8df8-c61ceb84c04b\") " Jun 10 00:51:52.124081 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:52.124052 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1785598f-1781-40d6-8df8-c61ceb84c04b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1785598f-1781-40d6-8df8-c61ceb84c04b" (UID: "1785598f-1781-40d6-8df8-c61ceb84c04b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:51:52.124215 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:52.124101 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1785598f-1781-40d6-8df8-c61ceb84c04b-kube-api-access-gmvcz" (OuterVolumeSpecName: "kube-api-access-gmvcz") pod "1785598f-1781-40d6-8df8-c61ceb84c04b" (UID: "1785598f-1781-40d6-8df8-c61ceb84c04b"). InnerVolumeSpecName "kube-api-access-gmvcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:51:52.222527 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:52.222493 2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1785598f-1781-40d6-8df8-c61ceb84c04b-webhook-cert\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:51:52.222527 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:52.222522 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmvcz\" (UniqueName: \"kubernetes.io/projected/1785598f-1781-40d6-8df8-c61ceb84c04b-kube-api-access-gmvcz\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:51:52.776005 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:52.775967 2577 generic.go:356] "Generic (PLEG): container finished" podID="1785598f-1781-40d6-8df8-c61ceb84c04b" containerID="1717c018bb7f796982231cf51894b178aadac166622a0ce2e1c56baa1184b782" exitCode=0 Jun 10 00:51:52.776437 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:52.776011 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c9b466c6-9ljv8" Jun 10 00:51:52.776437 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:52.776055 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c9b466c6-9ljv8" event={"ID":"1785598f-1781-40d6-8df8-c61ceb84c04b","Type":"ContainerDied","Data":"1717c018bb7f796982231cf51894b178aadac166622a0ce2e1c56baa1184b782"} Jun 10 00:51:52.776437 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:52.776112 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c9b466c6-9ljv8" event={"ID":"1785598f-1781-40d6-8df8-c61ceb84c04b","Type":"ContainerDied","Data":"957216d343c435bbfc4ab11301a5cd4adf257bfc44cae0336db3470041a49960"} Jun 10 00:51:52.776437 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:52.776140 2577 scope.go:117] "RemoveContainer" containerID="1717c018bb7f796982231cf51894b178aadac166622a0ce2e1c56baa1184b782" Jun 10 00:51:52.785521 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:52.785335 2577 scope.go:117] "RemoveContainer" containerID="1717c018bb7f796982231cf51894b178aadac166622a0ce2e1c56baa1184b782" Jun 10 00:51:52.785625 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:51:52.785606 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1717c018bb7f796982231cf51894b178aadac166622a0ce2e1c56baa1184b782\": container with ID starting with 1717c018bb7f796982231cf51894b178aadac166622a0ce2e1c56baa1184b782 not found: ID does not exist" containerID="1717c018bb7f796982231cf51894b178aadac166622a0ce2e1c56baa1184b782" Jun 10 00:51:52.785667 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:52.785633 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1717c018bb7f796982231cf51894b178aadac166622a0ce2e1c56baa1184b782"} err="failed to get container status \"1717c018bb7f796982231cf51894b178aadac166622a0ce2e1c56baa1184b782\": rpc error: code = NotFound desc = could not find container \"1717c018bb7f796982231cf51894b178aadac166622a0ce2e1c56baa1184b782\": container with ID starting with 1717c018bb7f796982231cf51894b178aadac166622a0ce2e1c56baa1184b782 not found: ID does not exist" Jun 10 00:51:52.798727 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:52.798699 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8c9b466c6-9ljv8"] Jun 10 00:51:52.802327 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:52.802306 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8c9b466c6-9ljv8"] Jun 10 00:51:53.600516 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:51:53.600474 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1785598f-1781-40d6-8df8-c61ceb84c04b" path="/var/lib/kubelet/pods/1785598f-1781-40d6-8df8-c61ceb84c04b/volumes" Jun 10 00:52:11.678255 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:11.678215 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5b988d6476-xlfs2"] Jun 10 00:52:11.678658 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:11.678619 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1785598f-1781-40d6-8df8-c61ceb84c04b" containerName="manager" Jun 10 00:52:11.678658 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:11.678633 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1785598f-1781-40d6-8df8-c61ceb84c04b" containerName="manager" Jun 10 00:52:11.678749 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:11.678713 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1785598f-1781-40d6-8df8-c61ceb84c04b" containerName="manager" Jun 10 00:52:11.681813 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:11.681796 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5b988d6476-xlfs2" Jun 10 00:52:11.684598 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:11.684574 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 10 00:52:11.684686 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:11.684584 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ftnqq\"" Jun 10 00:52:11.692691 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:11.692665 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5b988d6476-xlfs2"] Jun 10 00:52:11.787448 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:11.787407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7z2w\" (UniqueName: \"kubernetes.io/projected/35469db7-6c95-44ff-a744-bb2c42090079-kube-api-access-x7z2w\") pod \"maas-api-5b988d6476-xlfs2\" (UID: \"35469db7-6c95-44ff-a744-bb2c42090079\") " pod="opendatahub/maas-api-5b988d6476-xlfs2" Jun 10 00:52:11.787623 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:11.787519 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35469db7-6c95-44ff-a744-bb2c42090079-maas-api-tls\") pod \"maas-api-5b988d6476-xlfs2\" (UID: \"35469db7-6c95-44ff-a744-bb2c42090079\") " pod="opendatahub/maas-api-5b988d6476-xlfs2" Jun 10 00:52:11.888559 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:11.888525 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35469db7-6c95-44ff-a744-bb2c42090079-maas-api-tls\") pod \"maas-api-5b988d6476-xlfs2\" (UID: \"35469db7-6c95-44ff-a744-bb2c42090079\") " pod="opendatahub/maas-api-5b988d6476-xlfs2" Jun 10 00:52:11.888716 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:11.888595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7z2w\" (UniqueName: \"kubernetes.io/projected/35469db7-6c95-44ff-a744-bb2c42090079-kube-api-access-x7z2w\") pod \"maas-api-5b988d6476-xlfs2\" (UID: \"35469db7-6c95-44ff-a744-bb2c42090079\") " pod="opendatahub/maas-api-5b988d6476-xlfs2" Jun 10 00:52:11.891063 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:11.891037 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35469db7-6c95-44ff-a744-bb2c42090079-maas-api-tls\") pod \"maas-api-5b988d6476-xlfs2\" (UID: \"35469db7-6c95-44ff-a744-bb2c42090079\") " pod="opendatahub/maas-api-5b988d6476-xlfs2" Jun 10 00:52:11.896046 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:11.896024 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7z2w\" (UniqueName: \"kubernetes.io/projected/35469db7-6c95-44ff-a744-bb2c42090079-kube-api-access-x7z2w\") pod \"maas-api-5b988d6476-xlfs2\" (UID: \"35469db7-6c95-44ff-a744-bb2c42090079\") " pod="opendatahub/maas-api-5b988d6476-xlfs2" Jun 10 00:52:11.993908 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:11.993868 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5b988d6476-xlfs2" Jun 10 00:52:12.143591 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:12.143557 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5b988d6476-xlfs2"] Jun 10 00:52:12.146859 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:52:12.146831 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35469db7_6c95_44ff_a744_bb2c42090079.slice/crio-fd7cf489546078eba7d17cd0dfb436d66fff9e328a059b10f30b1877caa5a596 WatchSource:0}: Error finding container fd7cf489546078eba7d17cd0dfb436d66fff9e328a059b10f30b1877caa5a596: Status 404 returned error can't find the container with id fd7cf489546078eba7d17cd0dfb436d66fff9e328a059b10f30b1877caa5a596 Jun 10 00:52:12.181225 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:12.181168 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:52:12.886901 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:12.886864 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5b988d6476-xlfs2" event={"ID":"35469db7-6c95-44ff-a744-bb2c42090079","Type":"ContainerStarted","Data":"fd7cf489546078eba7d17cd0dfb436d66fff9e328a059b10f30b1877caa5a596"} Jun 10 00:52:13.894463 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:13.894421 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5b988d6476-xlfs2" event={"ID":"35469db7-6c95-44ff-a744-bb2c42090079","Type":"ContainerStarted","Data":"f5d11b43a06d10a3d28a1113289971fd9606c3b331ad40fd9862110b77c7c904"} Jun 10 00:52:13.894835 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:13.894496 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5b988d6476-xlfs2" Jun 10 00:52:13.911921 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:13.911818 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5b988d6476-xlfs2" podStartSLOduration=1.30477129 podStartE2EDuration="2.911804007s" totalImagesPullingTime="1.607032717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:52:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:52:13.90989408 +0000 UTC m=+1020.733799938" watchObservedRunningTime="2026-06-10 00:52:13.911804007 +0000 UTC m=+1020.735709865" Jun 10 00:52:19.905057 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:52:19.905025 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5b988d6476-xlfs2" Jun 10 00:53:39.579989 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:39.579953 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:53:49.572793 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.572759 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5"] Jun 10 00:53:49.576889 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.576864 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.580350 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.580324 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 10 00:53:49.583067 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.583044 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 00:53:49.583890 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.583301 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t8bd2\"" Jun 10 00:53:49.584000 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.583349 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 00:53:49.585760 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.585739 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5"] Jun 10 00:53:49.651709 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.651671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea092b66-5f5b-4021-8d6e-8124fd21f22a-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.651922 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.651755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea092b66-5f5b-4021-8d6e-8124fd21f22a-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.651922 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.651782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea092b66-5f5b-4021-8d6e-8124fd21f22a-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.651922 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.651814 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zx4t\" (UniqueName: \"kubernetes.io/projected/ea092b66-5f5b-4021-8d6e-8124fd21f22a-kube-api-access-5zx4t\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.651922 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.651897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea092b66-5f5b-4021-8d6e-8124fd21f22a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.651922 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.651921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea092b66-5f5b-4021-8d6e-8124fd21f22a-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.752610 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.752567 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea092b66-5f5b-4021-8d6e-8124fd21f22a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.752800 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.752691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea092b66-5f5b-4021-8d6e-8124fd21f22a-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.752877 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.752813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea092b66-5f5b-4021-8d6e-8124fd21f22a-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.752877 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.752867 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea092b66-5f5b-4021-8d6e-8124fd21f22a-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.752981 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.752891 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea092b66-5f5b-4021-8d6e-8124fd21f22a-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.752981 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.752924 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zx4t\" (UniqueName: \"kubernetes.io/projected/ea092b66-5f5b-4021-8d6e-8124fd21f22a-kube-api-access-5zx4t\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.753076 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.753028 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea092b66-5f5b-4021-8d6e-8124fd21f22a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.753076 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.753041 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea092b66-5f5b-4021-8d6e-8124fd21f22a-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.753253 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.753234 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea092b66-5f5b-4021-8d6e-8124fd21f22a-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.755249 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.755189 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea092b66-5f5b-4021-8d6e-8124fd21f22a-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.755446 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.755430 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea092b66-5f5b-4021-8d6e-8124fd21f22a-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.760808 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.760780 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zx4t\" (UniqueName: \"kubernetes.io/projected/ea092b66-5f5b-4021-8d6e-8124fd21f22a-kube-api-access-5zx4t\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mfll5\" (UID: \"ea092b66-5f5b-4021-8d6e-8124fd21f22a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.892347 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.892254 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:53:49.981220 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:49.981171 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:53:50.036263 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:50.036234 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5"] Jun 10 00:53:50.038464 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:53:50.038434 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea092b66_5f5b_4021_8d6e_8124fd21f22a.slice/crio-b7e22352b4dfb0f2cc1befe9f969d3ef5dd7617a4203a3d7528c2d972318b506 WatchSource:0}: Error finding container b7e22352b4dfb0f2cc1befe9f969d3ef5dd7617a4203a3d7528c2d972318b506: Status 404 returned error can't find the container with id b7e22352b4dfb0f2cc1befe9f969d3ef5dd7617a4203a3d7528c2d972318b506 Jun 10 00:53:50.360568 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:50.360531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" event={"ID":"ea092b66-5f5b-4021-8d6e-8124fd21f22a","Type":"ContainerStarted","Data":"b7e22352b4dfb0f2cc1befe9f969d3ef5dd7617a4203a3d7528c2d972318b506"} Jun 10 00:53:53.381270 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:53:53.381169 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" event={"ID":"ea092b66-5f5b-4021-8d6e-8124fd21f22a","Type":"ContainerStarted","Data":"d16a3ef4fcfd8b9c1dc9c0a53ef8edff69b7e978db66769641ac223313f62eed"} Jun 10 00:54:03.430432 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:03.430343 2577 generic.go:356] "Generic (PLEG): container finished" podID="ea092b66-5f5b-4021-8d6e-8124fd21f22a" containerID="d16a3ef4fcfd8b9c1dc9c0a53ef8edff69b7e978db66769641ac223313f62eed" exitCode=0 Jun 10 00:54:03.430432 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:03.430420 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" event={"ID":"ea092b66-5f5b-4021-8d6e-8124fd21f22a","Type":"ContainerDied","Data":"d16a3ef4fcfd8b9c1dc9c0a53ef8edff69b7e978db66769641ac223313f62eed"} Jun 10 00:54:05.446164 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:05.446120 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" event={"ID":"ea092b66-5f5b-4021-8d6e-8124fd21f22a","Type":"ContainerStarted","Data":"e44ba47570babe4c30483709da09a90f58451a4eb9a005ba1ffa728f8ccf1e0e"} Jun 10 00:54:05.463477 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:05.463423 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" podStartSLOduration=2.30107582 podStartE2EDuration="16.463406028s" totalImagesPullingTime="4.068657573s" totalInitContainerRuntime="10.093672635s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:53:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:54:05.46266798 +0000 UTC m=+1132.286573866" watchObservedRunningTime="2026-06-10 00:54:05.463406028 +0000 UTC m=+1132.287311867" Jun 10 00:54:05.675665 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:05.675627 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:54:09.892719 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:09.892676 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:54:09.893155 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:09.892743 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:54:09.911515 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:09.911482 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:54:10.482365 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:10.482337 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mfll5" Jun 10 00:54:16.081620 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:16.081577 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:54:28.186171 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.185979 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc"] Jun 10 00:54:28.190236 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.190190 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.192879 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.192851 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 10 00:54:28.199579 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.199547 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc"] Jun 10 00:54:28.307462 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.307422 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1b25a1e6-7524-46e9-b0bd-be511f934331-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.307650 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.307555 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b25a1e6-7524-46e9-b0bd-be511f934331-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.307650 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.307587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b25a1e6-7524-46e9-b0bd-be511f934331-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.307650 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.307613 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlpnr\" (UniqueName: \"kubernetes.io/projected/1b25a1e6-7524-46e9-b0bd-be511f934331-kube-api-access-wlpnr\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.307650 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.307638 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b25a1e6-7524-46e9-b0bd-be511f934331-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.307815 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.307658 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b25a1e6-7524-46e9-b0bd-be511f934331-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.409065 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.409029 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b25a1e6-7524-46e9-b0bd-be511f934331-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.409065 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.409068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b25a1e6-7524-46e9-b0bd-be511f934331-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.409334 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.409086 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlpnr\" (UniqueName: \"kubernetes.io/projected/1b25a1e6-7524-46e9-b0bd-be511f934331-kube-api-access-wlpnr\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.409334 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.409108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b25a1e6-7524-46e9-b0bd-be511f934331-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.409334 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.409129 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b25a1e6-7524-46e9-b0bd-be511f934331-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.409334 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.409227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1b25a1e6-7524-46e9-b0bd-be511f934331-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.409538 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.409512 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b25a1e6-7524-46e9-b0bd-be511f934331-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.409538 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.409533 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b25a1e6-7524-46e9-b0bd-be511f934331-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.409645 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.409627 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1b25a1e6-7524-46e9-b0bd-be511f934331-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.411575 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.411545 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b25a1e6-7524-46e9-b0bd-be511f934331-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.411737 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.411719 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b25a1e6-7524-46e9-b0bd-be511f934331-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.416938 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.416915 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlpnr\" (UniqueName: \"kubernetes.io/projected/1b25a1e6-7524-46e9-b0bd-be511f934331-kube-api-access-wlpnr\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc\" (UID: \"1b25a1e6-7524-46e9-b0bd-be511f934331\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.503291 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.503253 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:28.646969 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.646930 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc"] Jun 10 00:54:28.649343 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:54:28.649308 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b25a1e6_7524_46e9_b0bd_be511f934331.slice/crio-94da86f2ec2a2d8966792af432c78d1ae8b96e4dfecfb3c8a0a025f37f7772ce WatchSource:0}: Error finding container 94da86f2ec2a2d8966792af432c78d1ae8b96e4dfecfb3c8a0a025f37f7772ce: Status 404 returned error can't find the container with id 94da86f2ec2a2d8966792af432c78d1ae8b96e4dfecfb3c8a0a025f37f7772ce Jun 10 00:54:28.887272 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:28.887172 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:54:29.569785 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:29.569748 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" event={"ID":"1b25a1e6-7524-46e9-b0bd-be511f934331","Type":"ContainerStarted","Data":"e02ab6a5b7cb8fe13e8d6a004f299b46a97c736fec172dac65cd1ca0e7e2427a"} Jun 10 00:54:29.570312 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:29.569811 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" event={"ID":"1b25a1e6-7524-46e9-b0bd-be511f934331","Type":"ContainerStarted","Data":"94da86f2ec2a2d8966792af432c78d1ae8b96e4dfecfb3c8a0a025f37f7772ce"} Jun 10 00:54:30.577384 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:30.577348 2577 generic.go:356] "Generic (PLEG): container finished" podID="1b25a1e6-7524-46e9-b0bd-be511f934331" containerID="e02ab6a5b7cb8fe13e8d6a004f299b46a97c736fec172dac65cd1ca0e7e2427a" exitCode=0 Jun 10 00:54:30.577778 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:30.577398 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" event={"ID":"1b25a1e6-7524-46e9-b0bd-be511f934331","Type":"ContainerDied","Data":"e02ab6a5b7cb8fe13e8d6a004f299b46a97c736fec172dac65cd1ca0e7e2427a"} Jun 10 00:54:31.585035 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:31.584997 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" event={"ID":"1b25a1e6-7524-46e9-b0bd-be511f934331","Type":"ContainerStarted","Data":"5f6b2cd023e98d8c9c766b62e2803f6e8e2f22e3ed9b1ac8bd747e84a10010a3"} Jun 10 00:54:31.604312 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:31.604257 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" podStartSLOduration=1.615404713 podStartE2EDuration="3.604240784s" totalImagesPullingTime="167.927508ms" totalInitContainerRuntime="1.820908563s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:54:31.602321661 +0000 UTC m=+1158.426227523" watchObservedRunningTime="2026-06-10 00:54:31.604240784 +0000 UTC m=+1158.428146641" Jun 10 00:54:38.503926 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:38.503881 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:38.504337 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:38.503952 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:38.516309 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:38.516282 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:38.633607 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:38.633578 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc" Jun 10 00:54:50.591437 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.591398 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs"] Jun 10 00:54:50.596038 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.596015 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.598669 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.598646 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 10 00:54:50.602772 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.602748 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs"] Jun 10 00:54:50.705806 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.705769 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/992b0a90-f14b-4a59-8dcd-dddfe1572696-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.705976 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.705817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/992b0a90-f14b-4a59-8dcd-dddfe1572696-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.705976 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.705836 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/992b0a90-f14b-4a59-8dcd-dddfe1572696-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.705976 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.705854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsrtf\" (UniqueName: \"kubernetes.io/projected/992b0a90-f14b-4a59-8dcd-dddfe1572696-kube-api-access-nsrtf\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.705976 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.705919 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/992b0a90-f14b-4a59-8dcd-dddfe1572696-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.705976 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.705959 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/992b0a90-f14b-4a59-8dcd-dddfe1572696-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.806591 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.806552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/992b0a90-f14b-4a59-8dcd-dddfe1572696-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.806591 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.806595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/992b0a90-f14b-4a59-8dcd-dddfe1572696-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.806824 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.806615 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsrtf\" (UniqueName: \"kubernetes.io/projected/992b0a90-f14b-4a59-8dcd-dddfe1572696-kube-api-access-nsrtf\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.806824 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.806731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/992b0a90-f14b-4a59-8dcd-dddfe1572696-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.806824 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.806791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/992b0a90-f14b-4a59-8dcd-dddfe1572696-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.806980 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.806930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/992b0a90-f14b-4a59-8dcd-dddfe1572696-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.807032 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.806991 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/992b0a90-f14b-4a59-8dcd-dddfe1572696-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.807097 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.807077 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/992b0a90-f14b-4a59-8dcd-dddfe1572696-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.807242 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.807226 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/992b0a90-f14b-4a59-8dcd-dddfe1572696-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.808906 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.808883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/992b0a90-f14b-4a59-8dcd-dddfe1572696-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.809167 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.809149 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/992b0a90-f14b-4a59-8dcd-dddfe1572696-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.814014 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.813989 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsrtf\" (UniqueName: \"kubernetes.io/projected/992b0a90-f14b-4a59-8dcd-dddfe1572696-kube-api-access-nsrtf\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-dq6hs\" (UID: \"992b0a90-f14b-4a59-8dcd-dddfe1572696\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:50.907149 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:50.907072 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:54:51.046738 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:51.046712 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs"] Jun 10 00:54:51.049325 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:54:51.049294 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992b0a90_f14b_4a59_8dcd_dddfe1572696.slice/crio-e26dfa0d110d1ffa1dc48cd1a80f2fec4addf2a30c03d1e770a58e53014a72c8 WatchSource:0}: Error finding container e26dfa0d110d1ffa1dc48cd1a80f2fec4addf2a30c03d1e770a58e53014a72c8: Status 404 returned error can't find the container with id e26dfa0d110d1ffa1dc48cd1a80f2fec4addf2a30c03d1e770a58e53014a72c8 Jun 10 00:54:51.477433 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:51.477394 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:54:51.689557 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:51.689520 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" event={"ID":"992b0a90-f14b-4a59-8dcd-dddfe1572696","Type":"ContainerStarted","Data":"11e030675d34fe17edabf8743eea1f8dad7194eec0da9987b99abfb67779a88c"} Jun 10 00:54:51.690010 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:51.689570 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" event={"ID":"992b0a90-f14b-4a59-8dcd-dddfe1572696","Type":"ContainerStarted","Data":"e26dfa0d110d1ffa1dc48cd1a80f2fec4addf2a30c03d1e770a58e53014a72c8"} Jun 10 00:54:53.701564 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:53.701527 2577 generic.go:356] "Generic (PLEG): container finished" podID="992b0a90-f14b-4a59-8dcd-dddfe1572696" containerID="11e030675d34fe17edabf8743eea1f8dad7194eec0da9987b99abfb67779a88c" exitCode=0 Jun 10 00:54:53.701954 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:53.701588 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" event={"ID":"992b0a90-f14b-4a59-8dcd-dddfe1572696","Type":"ContainerDied","Data":"11e030675d34fe17edabf8743eea1f8dad7194eec0da9987b99abfb67779a88c"} Jun 10 00:54:54.708111 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:54:54.708080 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" event={"ID":"992b0a90-f14b-4a59-8dcd-dddfe1572696","Type":"ContainerStarted","Data":"f414374aa8f5238202d2f1b4eeeb9633899e63d93e0326b34a410dde564006ac"} Jun 10 00:55:00.908228 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:55:00.908164 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:55:00.908759 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:55:00.908243 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:55:00.920914 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:55:00.920887 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:55:00.940620 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:55:00.940560 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" podStartSLOduration=8.983122748 podStartE2EDuration="10.940544207s" totalImagesPullingTime="174.82162ms" totalInitContainerRuntime="1.782599839s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:54:54.741244967 +0000 UTC m=+1181.565150827" watchObservedRunningTime="2026-06-10 00:55:00.940544207 +0000 UTC m=+1187.764450065" Jun 10 00:55:01.755040 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:55:01.755013 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-dq6hs" Jun 10 00:55:13.631582 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:55:13.631547 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 00:55:13.634052 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:55:13.634026 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 00:56:41.482724 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:56:41.482687 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:56:51.173556 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:56:51.173519 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:57:00.673617 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:00.673578 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:57:10.672988 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:10.672951 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:57:20.174353 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:20.174319 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:57:29.775912 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:29.775875 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:57:37.758140 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:37.757936 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69b67d4c4b-4hpqx"] Jun 10 00:57:37.758566 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:37.758246 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" podUID="0f6078dd-2df6-4f79-87b3-0df5fc608269" containerName="manager" containerID="cri-o://c2c11d273840aab0fcd19fb4cc87b6275887147f97b57c21ea398b2c8aa92442" gracePeriod=30 Jun 10 00:57:38.005542 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:38.005518 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" Jun 10 00:57:38.138610 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:38.138537 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f6078dd-2df6-4f79-87b3-0df5fc608269-webhook-cert\") pod \"0f6078dd-2df6-4f79-87b3-0df5fc608269\" (UID: \"0f6078dd-2df6-4f79-87b3-0df5fc608269\") " Jun 10 00:57:38.138751 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:38.138630 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbccn\" (UniqueName: \"kubernetes.io/projected/0f6078dd-2df6-4f79-87b3-0df5fc608269-kube-api-access-zbccn\") pod \"0f6078dd-2df6-4f79-87b3-0df5fc608269\" (UID: \"0f6078dd-2df6-4f79-87b3-0df5fc608269\") " Jun 10 00:57:38.140622 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:38.140590 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f6078dd-2df6-4f79-87b3-0df5fc608269-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0f6078dd-2df6-4f79-87b3-0df5fc608269" (UID: "0f6078dd-2df6-4f79-87b3-0df5fc608269"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 00:57:38.140699 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:38.140678 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f6078dd-2df6-4f79-87b3-0df5fc608269-kube-api-access-zbccn" (OuterVolumeSpecName: "kube-api-access-zbccn") pod "0f6078dd-2df6-4f79-87b3-0df5fc608269" (UID: "0f6078dd-2df6-4f79-87b3-0df5fc608269"). InnerVolumeSpecName "kube-api-access-zbccn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 00:57:38.240009 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:38.239968 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbccn\" (UniqueName: \"kubernetes.io/projected/0f6078dd-2df6-4f79-87b3-0df5fc608269-kube-api-access-zbccn\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:57:38.240009 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:38.240001 2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f6078dd-2df6-4f79-87b3-0df5fc608269-webhook-cert\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 00:57:38.556699 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:38.556664 2577 generic.go:356] "Generic (PLEG): container finished" podID="0f6078dd-2df6-4f79-87b3-0df5fc608269" containerID="c2c11d273840aab0fcd19fb4cc87b6275887147f97b57c21ea398b2c8aa92442" exitCode=0 Jun 10 00:57:38.556876 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:38.556717 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" Jun 10 00:57:38.556876 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:38.556727 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" event={"ID":"0f6078dd-2df6-4f79-87b3-0df5fc608269","Type":"ContainerDied","Data":"c2c11d273840aab0fcd19fb4cc87b6275887147f97b57c21ea398b2c8aa92442"} Jun 10 00:57:38.556876 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:38.556767 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b67d4c4b-4hpqx" event={"ID":"0f6078dd-2df6-4f79-87b3-0df5fc608269","Type":"ContainerDied","Data":"28572b85f04a52d7563a8ff62fa873c1e51ac59d5b7d48fe7dabea6e31232100"} Jun 10 00:57:38.556876 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:38.556790 2577 scope.go:117] "RemoveContainer" containerID="c2c11d273840aab0fcd19fb4cc87b6275887147f97b57c21ea398b2c8aa92442" Jun 10 00:57:38.566431 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:38.566416 2577 scope.go:117] "RemoveContainer" containerID="c2c11d273840aab0fcd19fb4cc87b6275887147f97b57c21ea398b2c8aa92442" Jun 10 00:57:38.566678 ip-10-0-131-237 kubenswrapper[2577]: E0610 00:57:38.566656 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2c11d273840aab0fcd19fb4cc87b6275887147f97b57c21ea398b2c8aa92442\": container with ID starting with c2c11d273840aab0fcd19fb4cc87b6275887147f97b57c21ea398b2c8aa92442 not found: ID does not exist" containerID="c2c11d273840aab0fcd19fb4cc87b6275887147f97b57c21ea398b2c8aa92442" Jun 10 00:57:38.566774 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:38.566686 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2c11d273840aab0fcd19fb4cc87b6275887147f97b57c21ea398b2c8aa92442"} err="failed to get container status \"c2c11d273840aab0fcd19fb4cc87b6275887147f97b57c21ea398b2c8aa92442\": rpc error: code = NotFound desc = could not find container \"c2c11d273840aab0fcd19fb4cc87b6275887147f97b57c21ea398b2c8aa92442\": container with ID starting with c2c11d273840aab0fcd19fb4cc87b6275887147f97b57c21ea398b2c8aa92442 not found: ID does not exist" Jun 10 00:57:38.578270 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:38.578234 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69b67d4c4b-4hpqx"] Jun 10 00:57:38.581483 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:38.581463 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69b67d4c4b-4hpqx"] Jun 10 00:57:39.313629 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.313588 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69b67d4c4b-68v4k"] Jun 10 00:57:39.314174 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.314154 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f6078dd-2df6-4f79-87b3-0df5fc608269" containerName="manager" Jun 10 00:57:39.314307 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.314177 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f6078dd-2df6-4f79-87b3-0df5fc608269" containerName="manager" Jun 10 00:57:39.314366 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.314308 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f6078dd-2df6-4f79-87b3-0df5fc608269" containerName="manager" Jun 10 00:57:39.318893 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.318871 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b67d4c4b-68v4k" Jun 10 00:57:39.321625 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.321585 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 00:57:39.322986 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.322964 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gdk2k\"" Jun 10 00:57:39.323296 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.323273 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 00:57:39.325503 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.325478 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69b67d4c4b-68v4k"] Jun 10 00:57:39.451963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.451926 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq8qs\" (UniqueName: \"kubernetes.io/projected/53013f75-5a4b-4044-8132-af1b48992fbe-kube-api-access-zq8qs\") pod \"maas-controller-69b67d4c4b-68v4k\" (UID: \"53013f75-5a4b-4044-8132-af1b48992fbe\") " pod="opendatahub/maas-controller-69b67d4c4b-68v4k" Jun 10 00:57:39.451963 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.451968 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/53013f75-5a4b-4044-8132-af1b48992fbe-webhook-cert\") pod \"maas-controller-69b67d4c4b-68v4k\" (UID: \"53013f75-5a4b-4044-8132-af1b48992fbe\") " pod="opendatahub/maas-controller-69b67d4c4b-68v4k" Jun 10 00:57:39.552828 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.552787 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/53013f75-5a4b-4044-8132-af1b48992fbe-webhook-cert\") pod \"maas-controller-69b67d4c4b-68v4k\" (UID: \"53013f75-5a4b-4044-8132-af1b48992fbe\") " pod="opendatahub/maas-controller-69b67d4c4b-68v4k" Jun 10 00:57:39.553025 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.552935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq8qs\" (UniqueName: \"kubernetes.io/projected/53013f75-5a4b-4044-8132-af1b48992fbe-kube-api-access-zq8qs\") pod \"maas-controller-69b67d4c4b-68v4k\" (UID: \"53013f75-5a4b-4044-8132-af1b48992fbe\") " pod="opendatahub/maas-controller-69b67d4c4b-68v4k" Jun 10 00:57:39.555189 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.555165 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/53013f75-5a4b-4044-8132-af1b48992fbe-webhook-cert\") pod \"maas-controller-69b67d4c4b-68v4k\" (UID: \"53013f75-5a4b-4044-8132-af1b48992fbe\") " pod="opendatahub/maas-controller-69b67d4c4b-68v4k" Jun 10 00:57:39.563048 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.563022 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq8qs\" (UniqueName: \"kubernetes.io/projected/53013f75-5a4b-4044-8132-af1b48992fbe-kube-api-access-zq8qs\") pod \"maas-controller-69b67d4c4b-68v4k\" (UID: \"53013f75-5a4b-4044-8132-af1b48992fbe\") " pod="opendatahub/maas-controller-69b67d4c4b-68v4k" Jun 10 00:57:39.600426 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.600352 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f6078dd-2df6-4f79-87b3-0df5fc608269" path="/var/lib/kubelet/pods/0f6078dd-2df6-4f79-87b3-0df5fc608269/volumes" Jun 10 00:57:39.631498 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.631467 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b67d4c4b-68v4k" Jun 10 00:57:39.766112 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.766081 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69b67d4c4b-68v4k"] Jun 10 00:57:39.769275 ip-10-0-131-237 kubenswrapper[2577]: W0610 00:57:39.769245 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53013f75_5a4b_4044_8132_af1b48992fbe.slice/crio-4ea190e0244430cca94f7dc904009efd7e95c90db83820dc30f0e857bd3e558a WatchSource:0}: Error finding container 4ea190e0244430cca94f7dc904009efd7e95c90db83820dc30f0e857bd3e558a: Status 404 returned error can't find the container with id 4ea190e0244430cca94f7dc904009efd7e95c90db83820dc30f0e857bd3e558a Jun 10 00:57:39.770789 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:39.770772 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 00:57:40.572227 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:40.572112 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b67d4c4b-68v4k" event={"ID":"53013f75-5a4b-4044-8132-af1b48992fbe","Type":"ContainerStarted","Data":"0f137c4383ba67f23e9f78140e7e5e5fb2075ca25c04a7164e953e654794d1d6"} Jun 10 00:57:40.572227 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:40.572171 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b67d4c4b-68v4k" event={"ID":"53013f75-5a4b-4044-8132-af1b48992fbe","Type":"ContainerStarted","Data":"4ea190e0244430cca94f7dc904009efd7e95c90db83820dc30f0e857bd3e558a"} Jun 10 00:57:40.572227 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:40.572194 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69b67d4c4b-68v4k" Jun 10 00:57:40.588811 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:40.588764 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69b67d4c4b-68v4k" podStartSLOduration=1.117053441 podStartE2EDuration="1.588748167s" totalImagesPullingTime="471.694726ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:57:40.588043166 +0000 UTC m=+1347.411949027" watchObservedRunningTime="2026-06-10 00:57:40.588748167 +0000 UTC m=+1347.412654025" Jun 10 00:57:51.582169 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:57:51.582126 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69b67d4c4b-68v4k" Jun 10 00:58:02.376479 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:58:02.376436 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:58:05.476086 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:58:05.476054 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:58:42.080115 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:58:42.080077 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:58:58.782528 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:58:58.779917 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:59:36.579762 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:59:36.579721 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 00:59:53.884845 ip-10-0-131-237 kubenswrapper[2577]: I0610 00:59:53.884808 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:00:08.191992 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:00:08.191953 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:00:13.663388 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:00:13.663356 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 01:00:13.667170 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:00:13.667147 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 01:00:24.377796 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:00:24.377750 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:00:49.673345 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:00:49.673262 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:00:52.677519 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:00:52.677481 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:01:04.685947 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:01:04.685908 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:01:07.777940 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:01:07.777904 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:01:30.079517 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:01:30.079477 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:01:39.189052 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:01:39.189007 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:01:55.980652 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:01:55.980617 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:02:05.080961 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:02:05.080876 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:02:21.887786 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:02:21.887752 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:02:31.081385 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:02:31.081349 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:03:02.976240 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:03:02.976188 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:03:10.986144 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:03:10.986106 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:03:13.682412 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:03:13.682376 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:03:20.776522 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:03:20.776482 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:03:28.179034 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:03:28.178998 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:03:36.575354 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:03:36.575270 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:03:44.984469 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:03:44.984434 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:03:47.782768 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:03:47.782729 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:03:53.686904 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:03:53.686865 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:04:05.091091 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:04:05.091048 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:04:42.577481 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:04:42.577440 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:04:44.884536 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:04:44.884492 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:04:52.982549 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:04:52.982510 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:04:56.880643 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:04:56.880608 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:05:04.387285 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:05:04.387179 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:05:12.076564 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:05:12.076527 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:05:13.695581 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:05:13.695552 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 01:05:13.700713 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:05:13.700689 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 01:05:21.889881 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:05:21.889845 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:05:29.789297 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:05:29.789257 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:05:38.378906 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:05:38.378864 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:05:41.288129 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:05:41.288085 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:05:47.588220 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:05:47.588151 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:05:57.280315 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:05:57.280275 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:06:05.583967 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:06:05.583931 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:06:15.281378 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:06:15.281338 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:06:22.980771 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:06:22.980738 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:06:32.284130 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:06:32.284038 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:06:40.574502 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:06:40.574456 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:06:49.677602 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:06:49.677562 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:06:57.182805 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:06:57.182768 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:07:06.883448 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:07:06.883409 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:07:15.183469 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:07:15.183427 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:08:07.124973 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.124881 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v"] Jun 10 01:08:07.125565 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.125181 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" podUID="476679de-3817-4faa-aea0-59c94df053cc" containerName="manager" containerID="cri-o://9a405a9bb65d3a1940cbd94bb2427b0e966b37bf5dc935428b0e631073422b38" gracePeriod=10 Jun 10 01:08:07.387741 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.387672 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" Jun 10 01:08:07.473920 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.473886 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/476679de-3817-4faa-aea0-59c94df053cc-extensions-socket-volume\") pod \"476679de-3817-4faa-aea0-59c94df053cc\" (UID: \"476679de-3817-4faa-aea0-59c94df053cc\") " Jun 10 01:08:07.474100 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.473930 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84cv6\" (UniqueName: \"kubernetes.io/projected/476679de-3817-4faa-aea0-59c94df053cc-kube-api-access-84cv6\") pod \"476679de-3817-4faa-aea0-59c94df053cc\" (UID: \"476679de-3817-4faa-aea0-59c94df053cc\") " Jun 10 01:08:07.474307 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.474281 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/476679de-3817-4faa-aea0-59c94df053cc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "476679de-3817-4faa-aea0-59c94df053cc" (UID: "476679de-3817-4faa-aea0-59c94df053cc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:08:07.476058 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.476035 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/476679de-3817-4faa-aea0-59c94df053cc-kube-api-access-84cv6" (OuterVolumeSpecName: "kube-api-access-84cv6") pod "476679de-3817-4faa-aea0-59c94df053cc" (UID: "476679de-3817-4faa-aea0-59c94df053cc"). InnerVolumeSpecName "kube-api-access-84cv6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:08:07.575506 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.575451 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84cv6\" (UniqueName: \"kubernetes.io/projected/476679de-3817-4faa-aea0-59c94df053cc-kube-api-access-84cv6\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:08:07.575506 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.575500 2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/476679de-3817-4faa-aea0-59c94df053cc-extensions-socket-volume\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:08:07.837351 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.837315 2577 generic.go:356] "Generic (PLEG): container finished" podID="476679de-3817-4faa-aea0-59c94df053cc" containerID="9a405a9bb65d3a1940cbd94bb2427b0e966b37bf5dc935428b0e631073422b38" exitCode=0 Jun 10 01:08:07.837548 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.837363 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" Jun 10 01:08:07.837548 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.837395 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" event={"ID":"476679de-3817-4faa-aea0-59c94df053cc","Type":"ContainerDied","Data":"9a405a9bb65d3a1940cbd94bb2427b0e966b37bf5dc935428b0e631073422b38"} Jun 10 01:08:07.837548 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.837447 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v" event={"ID":"476679de-3817-4faa-aea0-59c94df053cc","Type":"ContainerDied","Data":"bf9da4af8ee84f5aa96000bac4f1ab721a7f16139f34097762421f3ce01e3bc8"} Jun 10 01:08:07.837548 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.837469 2577 scope.go:117] "RemoveContainer" containerID="9a405a9bb65d3a1940cbd94bb2427b0e966b37bf5dc935428b0e631073422b38" Jun 10 01:08:07.846605 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.846583 2577 scope.go:117] "RemoveContainer" containerID="9a405a9bb65d3a1940cbd94bb2427b0e966b37bf5dc935428b0e631073422b38" Jun 10 01:08:07.846873 ip-10-0-131-237 kubenswrapper[2577]: E0610 01:08:07.846853 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a405a9bb65d3a1940cbd94bb2427b0e966b37bf5dc935428b0e631073422b38\": container with ID starting with 9a405a9bb65d3a1940cbd94bb2427b0e966b37bf5dc935428b0e631073422b38 not found: ID does not exist" containerID="9a405a9bb65d3a1940cbd94bb2427b0e966b37bf5dc935428b0e631073422b38" Jun 10 01:08:07.846934 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.846880 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a405a9bb65d3a1940cbd94bb2427b0e966b37bf5dc935428b0e631073422b38"} err="failed to get container status \"9a405a9bb65d3a1940cbd94bb2427b0e966b37bf5dc935428b0e631073422b38\": rpc error: code = NotFound desc = could not find container \"9a405a9bb65d3a1940cbd94bb2427b0e966b37bf5dc935428b0e631073422b38\": container with ID starting with 9a405a9bb65d3a1940cbd94bb2427b0e966b37bf5dc935428b0e631073422b38 not found: ID does not exist" Jun 10 01:08:07.857548 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.857514 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v"] Jun 10 01:08:07.859304 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:07.859287 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wdg2v"] Jun 10 01:08:09.600277 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:08:09.600239 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="476679de-3817-4faa-aea0-59c94df053cc" path="/var/lib/kubelet/pods/476679de-3817-4faa-aea0-59c94df053cc/volumes" Jun 10 01:09:34.300844 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:09:34.300762 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:09:38.124018 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:09:38.123980 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:10:03.810419 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:10:03.810380 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:10:08.505445 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:10:08.505409 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:10:13.726075 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:10:13.726043 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 01:10:13.732088 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:10:13.732066 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 01:10:18.108581 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:10:18.108540 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:10:28.307629 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:10:28.307588 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:10:37.305126 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:10:37.305089 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:10:47.499829 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:10:47.499789 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:10:56.701004 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:10:56.700967 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:11:07.104779 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:11:07.104694 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:11:16.009169 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:11:16.009129 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:11:26.210780 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:11:26.210731 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:11:35.212080 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:11:35.206575 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:11:39.102784 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:11:39.102746 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:12:07.898107 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:12:07.898064 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:12:51.508813 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:12:51.508716 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:12:59.997709 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:12:59.997669 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:13:08.807817 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:13:08.807778 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:13:17.604535 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:13:17.604502 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:13:26.296476 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:13:26.296429 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:13:35.901012 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:13:35.900978 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:13:45.999061 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:13:45.999023 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:13:49.997895 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:13:49.997858 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:13:59.912272 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:13:59.912237 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:14:07.007055 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:14:07.006956 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:14:15.801470 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:14:15.801439 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:14:26.207398 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:14:26.207365 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:14:44.705571 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:14:44.705529 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:14:53.108987 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:14:53.108949 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:15:02.197829 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:15:02.197794 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:15:10.103381 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:15:10.103345 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:15:13.759521 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:15:13.759494 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 01:15:13.766599 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:15:13.766578 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wq7wh_812904bb-3cde-4d32-bca3-1f3c6efbf99d/ovn-acl-logging/0.log" Jun 10 01:15:27.300835 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:15:27.300793 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:15:35.501249 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:15:35.501156 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:15:44.784422 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:15:44.784387 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:15:53.104029 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:15:53.103983 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:16:01.905116 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:16:01.905081 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:16:10.001773 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:16:10.001734 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:16:20.207540 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:16:20.202044 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:16:32.202444 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:16:32.202410 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:16:42.610051 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:16:42.609983 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:16:53.909623 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:16:53.909585 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:16:56.901325 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:16:56.901291 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:17:04.800605 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:17:04.800520 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:17:08.908045 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:17:08.908002 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:17:19.305847 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:17:19.305813 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:17:23.405182 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:17:23.405149 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:17:40.206286 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:17:40.206249 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:17:49.096042 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:17:49.096004 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:17:58.098970 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:17:58.098930 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:18:03.803252 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:03.803183 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:18:27.405708 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:27.405670 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:18:40.802928 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:40.802839 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xs7wn"] Jun 10 01:18:41.121935 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.121838 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh"] Jun 10 01:18:41.122502 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.122476 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="476679de-3817-4faa-aea0-59c94df053cc" containerName="manager" Jun 10 01:18:41.122675 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.122661 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="476679de-3817-4faa-aea0-59c94df053cc" containerName="manager" Jun 10 01:18:41.122897 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.122875 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="476679de-3817-4faa-aea0-59c94df053cc" containerName="manager" Jun 10 01:18:41.126984 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.126957 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.129810 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.129785 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0442f60e-openshift-default-dockercfg-7jd2w\"" Jun 10 01:18:41.146397 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.146369 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh"] Jun 10 01:18:41.295408 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.295368 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-istio-data\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.295583 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.295454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e67fc2cc-103a-4008-8c70-87540e124e51-istio-podinfo\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.295583 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.295496 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-workload-certs\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.295583 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.295523 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e67fc2cc-103a-4008-8c70-87540e124e51-istio-token\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.295583 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.295567 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e67fc2cc-103a-4008-8c70-87540e124e51-istiod-ca-cert\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.295742 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.295592 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk2p4\" (UniqueName: \"kubernetes.io/projected/e67fc2cc-103a-4008-8c70-87540e124e51-kube-api-access-pk2p4\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.295742 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.295639 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-workload-socket\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.295742 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.295667 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-credential-socket\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.295742 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.295722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-istio-envoy\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.397035 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.396935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-workload-certs\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.397035 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.396975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e67fc2cc-103a-4008-8c70-87540e124e51-istio-token\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.397035 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.397001 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e67fc2cc-103a-4008-8c70-87540e124e51-istiod-ca-cert\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.397385 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.397138 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk2p4\" (UniqueName: \"kubernetes.io/projected/e67fc2cc-103a-4008-8c70-87540e124e51-kube-api-access-pk2p4\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.397385 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.397193 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-workload-socket\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.397385 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.397235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-credential-socket\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.397385 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.397303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-istio-envoy\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.397607 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.397403 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-istio-data\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.397607 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.397454 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-workload-certs\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.397607 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.397464 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e67fc2cc-103a-4008-8c70-87540e124e51-istio-podinfo\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.397607 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.397498 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-workload-socket\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.397821 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.397627 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-credential-socket\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.397821 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.397759 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e67fc2cc-103a-4008-8c70-87540e124e51-istiod-ca-cert\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.397821 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.397794 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-istio-data\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.399778 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.399740 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-istio-envoy\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.399990 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.399968 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e67fc2cc-103a-4008-8c70-87540e124e51-istio-podinfo\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.407306 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.407283 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e67fc2cc-103a-4008-8c70-87540e124e51-istio-token\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.407478 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.407458 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk2p4\" (UniqueName: \"kubernetes.io/projected/e67fc2cc-103a-4008-8c70-87540e124e51-kube-api-access-pk2p4\") pod \"e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.441428 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.441398 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:41.594096 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.594061 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh"] Jun 10 01:18:41.597559 ip-10-0-131-237 kubenswrapper[2577]: W0610 01:18:41.597523 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode67fc2cc_103a_4008_8c70_87540e124e51.slice/crio-4c10f04626632d1e8d7493cb2dc768ea7d8cb35ec6d0ee5e03e83fad33a7ab53 WatchSource:0}: Error finding container 4c10f04626632d1e8d7493cb2dc768ea7d8cb35ec6d0ee5e03e83fad33a7ab53: Status 404 returned error can't find the container with id 4c10f04626632d1e8d7493cb2dc768ea7d8cb35ec6d0ee5e03e83fad33a7ab53 Jun 10 01:18:41.608192 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:41.608173 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:18:42.036499 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:42.036449 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" event={"ID":"e67fc2cc-103a-4008-8c70-87540e124e51","Type":"ContainerStarted","Data":"4c10f04626632d1e8d7493cb2dc768ea7d8cb35ec6d0ee5e03e83fad33a7ab53"} Jun 10 01:18:44.856959 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:44.856920 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 01:18:44.857246 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:44.856998 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 01:18:44.857246 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:44.857030 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 01:18:45.052592 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:45.052493 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" event={"ID":"e67fc2cc-103a-4008-8c70-87540e124e51","Type":"ContainerStarted","Data":"7f17ff4e19e98a08189b5b5841c4005e7f9a97debff6bc447b9b0523a69ca6d3"} Jun 10 01:18:45.073606 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:45.073549 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" podStartSLOduration=0.825458792 podStartE2EDuration="4.073535675s" totalImagesPullingTime="3.248076883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:18:45.072081459 +0000 UTC m=+2611.895987319" watchObservedRunningTime="2026-06-10 01:18:45.073535675 +0000 UTC m=+2611.897441533" Jun 10 01:18:45.442174 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:45.442137 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:45.447366 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:45.447338 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:46.063648 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:46.063614 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:46.064693 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:46.064670 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:47.575799 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:47.575753 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh"] Jun 10 01:18:48.074637 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:48.074596 2577 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" secret="" err="secret \"e2e-ait-0442f60e-openshift-default-dockercfg-7jd2w\" not found" Jun 10 01:18:49.081706 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:49.081663 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" podUID="e67fc2cc-103a-4008-8c70-87540e124e51" containerName="istio-proxy" containerID="cri-o://7f17ff4e19e98a08189b5b5841c4005e7f9a97debff6bc447b9b0523a69ca6d3" gracePeriod=30 Jun 10 01:18:53.780233 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.780184 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5"] Jun 10 01:18:53.784579 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.784550 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.787452 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.787427 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f28e0a62-openshift-default-dockercfg-nkwxc\"" Jun 10 01:18:53.795645 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.795619 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5"] Jun 10 01:18:53.814228 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.814165 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-credential-socket\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.814228 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.814221 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-podinfo\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.814473 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.814246 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istiod-ca-cert\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.814473 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.814326 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxc7t\" (UniqueName: \"kubernetes.io/projected/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-kube-api-access-nxc7t\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.814473 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.814381 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-workload-socket\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.814473 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.814407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-data\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.814473 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.814446 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-envoy\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.814473 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.814467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-workload-certs\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.814663 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.814543 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-token\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.915374 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.915331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-envoy\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.915374 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.915388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-workload-certs\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.915645 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.915482 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-token\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.915645 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.915553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-credential-socket\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.915645 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.915586 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-podinfo\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.915645 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.915610 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istiod-ca-cert\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.915859 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.915654 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxc7t\" (UniqueName: \"kubernetes.io/projected/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-kube-api-access-nxc7t\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.915859 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.915686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-workload-socket\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.915859 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.915710 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-data\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.916033 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.915968 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-credential-socket\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.916135 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.916107 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-data\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.916290 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.916266 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-workload-certs\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.916498 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.916276 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-workload-socket\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.916615 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.916522 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istiod-ca-cert\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.918581 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.918557 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-envoy\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.918796 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.918772 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-podinfo\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.923486 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.923453 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxc7t\" (UniqueName: \"kubernetes.io/projected/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-kube-api-access-nxc7t\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:53.923589 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:53.923506 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-token\") pod \"e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:54.098091 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.098057 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:54.251311 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.251276 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5"] Jun 10 01:18:54.252820 ip-10-0-131-237 kubenswrapper[2577]: W0610 01:18:54.252791 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1fb81bb_874a_4c6f_880d_bf41fbf6af5c.slice/crio-4df8adf45603528de478f8a945e111c797bc99c8fe09ab78e2e74ebb06edc0da WatchSource:0}: Error finding container 4df8adf45603528de478f8a945e111c797bc99c8fe09ab78e2e74ebb06edc0da: Status 404 returned error can't find the container with id 4df8adf45603528de478f8a945e111c797bc99c8fe09ab78e2e74ebb06edc0da Jun 10 01:18:54.254976 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.254936 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 01:18:54.255076 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.255040 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 01:18:54.255132 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.255111 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 01:18:54.357615 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.357591 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:54.420388 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.420356 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-workload-certs\") pod \"e67fc2cc-103a-4008-8c70-87540e124e51\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " Jun 10 01:18:54.420562 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.420401 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e67fc2cc-103a-4008-8c70-87540e124e51-istio-podinfo\") pod \"e67fc2cc-103a-4008-8c70-87540e124e51\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " Jun 10 01:18:54.420562 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.420424 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e67fc2cc-103a-4008-8c70-87540e124e51-istio-token\") pod \"e67fc2cc-103a-4008-8c70-87540e124e51\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " Jun 10 01:18:54.420562 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.420478 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-istio-envoy\") pod \"e67fc2cc-103a-4008-8c70-87540e124e51\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " Jun 10 01:18:54.420562 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.420519 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e67fc2cc-103a-4008-8c70-87540e124e51-istiod-ca-cert\") pod \"e67fc2cc-103a-4008-8c70-87540e124e51\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " Jun 10 01:18:54.420562 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.420558 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk2p4\" (UniqueName: \"kubernetes.io/projected/e67fc2cc-103a-4008-8c70-87540e124e51-kube-api-access-pk2p4\") pod \"e67fc2cc-103a-4008-8c70-87540e124e51\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " Jun 10 01:18:54.420726 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.420601 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-istio-data\") pod \"e67fc2cc-103a-4008-8c70-87540e124e51\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " Jun 10 01:18:54.420726 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.420627 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-workload-socket\") pod \"e67fc2cc-103a-4008-8c70-87540e124e51\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " Jun 10 01:18:54.420726 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.420658 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e67fc2cc-103a-4008-8c70-87540e124e51" (UID: "e67fc2cc-103a-4008-8c70-87540e124e51"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:18:54.420726 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.420695 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-credential-socket\") pod \"e67fc2cc-103a-4008-8c70-87540e124e51\" (UID: \"e67fc2cc-103a-4008-8c70-87540e124e51\") " Jun 10 01:18:54.421086 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.420915 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e67fc2cc-103a-4008-8c70-87540e124e51-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e67fc2cc-103a-4008-8c70-87540e124e51" (UID: "e67fc2cc-103a-4008-8c70-87540e124e51"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:18:54.421086 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.421031 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-workload-certs\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:18:54.421086 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.421047 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e67fc2cc-103a-4008-8c70-87540e124e51-istiod-ca-cert\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:18:54.421086 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.421066 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e67fc2cc-103a-4008-8c70-87540e124e51" (UID: "e67fc2cc-103a-4008-8c70-87540e124e51"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:18:54.421518 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.421475 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e67fc2cc-103a-4008-8c70-87540e124e51" (UID: "e67fc2cc-103a-4008-8c70-87540e124e51"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:18:54.422040 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.422022 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-istio-data" (OuterVolumeSpecName: "istio-data") pod "e67fc2cc-103a-4008-8c70-87540e124e51" (UID: "e67fc2cc-103a-4008-8c70-87540e124e51"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:18:54.427220 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.423308 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e67fc2cc-103a-4008-8c70-87540e124e51-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e67fc2cc-103a-4008-8c70-87540e124e51" (UID: "e67fc2cc-103a-4008-8c70-87540e124e51"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 01:18:54.427474 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.427454 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e67fc2cc-103a-4008-8c70-87540e124e51" (UID: "e67fc2cc-103a-4008-8c70-87540e124e51"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:18:54.427598 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.427461 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e67fc2cc-103a-4008-8c70-87540e124e51-kube-api-access-pk2p4" (OuterVolumeSpecName: "kube-api-access-pk2p4") pod "e67fc2cc-103a-4008-8c70-87540e124e51" (UID: "e67fc2cc-103a-4008-8c70-87540e124e51"). InnerVolumeSpecName "kube-api-access-pk2p4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:18:54.427598 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.427493 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e67fc2cc-103a-4008-8c70-87540e124e51-istio-token" (OuterVolumeSpecName: "istio-token") pod "e67fc2cc-103a-4008-8c70-87540e124e51" (UID: "e67fc2cc-103a-4008-8c70-87540e124e51"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:18:54.522506 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.522471 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-credential-socket\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:18:54.522506 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.522504 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e67fc2cc-103a-4008-8c70-87540e124e51-istio-podinfo\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:18:54.522728 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.522518 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e67fc2cc-103a-4008-8c70-87540e124e51-istio-token\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:18:54.522728 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.522532 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-istio-envoy\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:18:54.522728 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.522545 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk2p4\" (UniqueName: \"kubernetes.io/projected/e67fc2cc-103a-4008-8c70-87540e124e51-kube-api-access-pk2p4\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:18:54.522728 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.522556 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-istio-data\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:18:54.522728 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:54.522567 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e67fc2cc-103a-4008-8c70-87540e124e51-workload-socket\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:18:55.116007 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:55.115966 2577 generic.go:356] "Generic (PLEG): container finished" podID="e67fc2cc-103a-4008-8c70-87540e124e51" containerID="7f17ff4e19e98a08189b5b5841c4005e7f9a97debff6bc447b9b0523a69ca6d3" exitCode=0 Jun 10 01:18:55.116481 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:55.116016 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" Jun 10 01:18:55.116481 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:55.116045 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" event={"ID":"e67fc2cc-103a-4008-8c70-87540e124e51","Type":"ContainerDied","Data":"7f17ff4e19e98a08189b5b5841c4005e7f9a97debff6bc447b9b0523a69ca6d3"} Jun 10 01:18:55.116481 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:55.116103 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh" event={"ID":"e67fc2cc-103a-4008-8c70-87540e124e51","Type":"ContainerDied","Data":"4c10f04626632d1e8d7493cb2dc768ea7d8cb35ec6d0ee5e03e83fad33a7ab53"} Jun 10 01:18:55.116481 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:55.116131 2577 scope.go:117] "RemoveContainer" containerID="7f17ff4e19e98a08189b5b5841c4005e7f9a97debff6bc447b9b0523a69ca6d3" Jun 10 01:18:55.117895 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:55.117864 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" event={"ID":"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c","Type":"ContainerStarted","Data":"03eb65df35850767bf513a714e6ee1dca6ee0c84e97e5e411d23e627ce1617b8"} Jun 10 01:18:55.117983 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:55.117919 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" event={"ID":"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c","Type":"ContainerStarted","Data":"4df8adf45603528de478f8a945e111c797bc99c8fe09ab78e2e74ebb06edc0da"} Jun 10 01:18:55.125586 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:55.125568 2577 scope.go:117] "RemoveContainer" containerID="7f17ff4e19e98a08189b5b5841c4005e7f9a97debff6bc447b9b0523a69ca6d3" Jun 10 01:18:55.125893 ip-10-0-131-237 kubenswrapper[2577]: E0610 01:18:55.125869 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f17ff4e19e98a08189b5b5841c4005e7f9a97debff6bc447b9b0523a69ca6d3\": container with ID starting with 7f17ff4e19e98a08189b5b5841c4005e7f9a97debff6bc447b9b0523a69ca6d3 not found: ID does not exist" containerID="7f17ff4e19e98a08189b5b5841c4005e7f9a97debff6bc447b9b0523a69ca6d3" Jun 10 01:18:55.125995 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:55.125904 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f17ff4e19e98a08189b5b5841c4005e7f9a97debff6bc447b9b0523a69ca6d3"} err="failed to get container status \"7f17ff4e19e98a08189b5b5841c4005e7f9a97debff6bc447b9b0523a69ca6d3\": rpc error: code = NotFound desc = could not find container \"7f17ff4e19e98a08189b5b5841c4005e7f9a97debff6bc447b9b0523a69ca6d3\": container with ID starting with 7f17ff4e19e98a08189b5b5841c4005e7f9a97debff6bc447b9b0523a69ca6d3 not found: ID does not exist" Jun 10 01:18:55.141974 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:55.141922 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" podStartSLOduration=2.141905852 podStartE2EDuration="2.141905852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:18:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:18:55.140227083 +0000 UTC m=+2621.964132943" watchObservedRunningTime="2026-06-10 01:18:55.141905852 +0000 UTC m=+2621.965811710" Jun 10 01:18:55.154574 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:55.154543 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh"] Jun 10 01:18:55.161298 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:55.161269 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0442f60e-openshift-default-5766775ccb-rqwwh"] Jun 10 01:18:55.600670 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:55.600636 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e67fc2cc-103a-4008-8c70-87540e124e51" path="/var/lib/kubelet/pods/e67fc2cc-103a-4008-8c70-87540e124e51/volumes" Jun 10 01:18:56.099238 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:56.099182 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:56.104331 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:56.104305 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:56.124155 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:56.124124 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:18:56.125187 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:18:56.125164 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:19:01.274161 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:01.274118 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5"] Jun 10 01:19:01.274648 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:01.274362 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" podUID="b1fb81bb-874a-4c6f-880d-bf41fbf6af5c" containerName="istio-proxy" containerID="cri-o://03eb65df35850767bf513a714e6ee1dca6ee0c84e97e5e411d23e627ce1617b8" gracePeriod=30 Jun 10 01:19:06.546301 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.546226 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:19:06.642133 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642037 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istiod-ca-cert\") pod \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " Jun 10 01:19:06.642133 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642088 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-workload-socket\") pod \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " Jun 10 01:19:06.642133 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642131 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-podinfo\") pod \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " Jun 10 01:19:06.642484 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642166 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-data\") pod \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " Jun 10 01:19:06.642484 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642238 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-envoy\") pod \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " Jun 10 01:19:06.642484 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642332 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-workload-certs\") pod \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " Jun 10 01:19:06.642484 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642361 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-credential-socket\") pod \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " Jun 10 01:19:06.642484 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642392 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxc7t\" (UniqueName: \"kubernetes.io/projected/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-kube-api-access-nxc7t\") pod \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " Jun 10 01:19:06.642484 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642421 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-token\") pod \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\" (UID: \"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c\") " Jun 10 01:19:06.642484 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642418 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c" (UID: "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:19:06.642844 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642525 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c" (UID: "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:19:06.642844 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642587 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c" (UID: "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:19:06.642844 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642708 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c" (UID: "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:19:06.643001 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642894 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-workload-certs\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:19:06.643001 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642914 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-credential-socket\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:19:06.643001 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642930 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istiod-ca-cert\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:19:06.643001 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642976 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-workload-socket\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:19:06.643001 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.642980 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-data" (OuterVolumeSpecName: "istio-data") pod "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c" (UID: "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:19:06.644940 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.644915 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c" (UID: "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:19:06.645046 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.645000 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c" (UID: "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 01:19:06.645105 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.645056 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-kube-api-access-nxc7t" (OuterVolumeSpecName: "kube-api-access-nxc7t") pod "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c" (UID: "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c"). InnerVolumeSpecName "kube-api-access-nxc7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:19:06.645105 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.645085 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-token" (OuterVolumeSpecName: "istio-token") pod "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c" (UID: "b1fb81bb-874a-4c6f-880d-bf41fbf6af5c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:19:06.743940 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.743900 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-token\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:19:06.743940 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.743931 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-podinfo\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:19:06.743940 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.743943 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-data\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:19:06.744185 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.743956 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-istio-envoy\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:19:06.744185 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:06.743969 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxc7t\" (UniqueName: \"kubernetes.io/projected/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c-kube-api-access-nxc7t\") on node \"ip-10-0-131-237.ec2.internal\" DevicePath \"\"" Jun 10 01:19:07.183650 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:07.183610 2577 generic.go:356] "Generic (PLEG): container finished" podID="b1fb81bb-874a-4c6f-880d-bf41fbf6af5c" containerID="03eb65df35850767bf513a714e6ee1dca6ee0c84e97e5e411d23e627ce1617b8" exitCode=0 Jun 10 01:19:07.183858 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:07.183669 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" Jun 10 01:19:07.183858 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:07.183706 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" event={"ID":"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c","Type":"ContainerDied","Data":"03eb65df35850767bf513a714e6ee1dca6ee0c84e97e5e411d23e627ce1617b8"} Jun 10 01:19:07.183858 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:07.183757 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5" event={"ID":"b1fb81bb-874a-4c6f-880d-bf41fbf6af5c","Type":"ContainerDied","Data":"4df8adf45603528de478f8a945e111c797bc99c8fe09ab78e2e74ebb06edc0da"} Jun 10 01:19:07.183858 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:07.183779 2577 scope.go:117] "RemoveContainer" containerID="03eb65df35850767bf513a714e6ee1dca6ee0c84e97e5e411d23e627ce1617b8" Jun 10 01:19:07.196700 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:07.196627 2577 scope.go:117] "RemoveContainer" containerID="03eb65df35850767bf513a714e6ee1dca6ee0c84e97e5e411d23e627ce1617b8" Jun 10 01:19:07.197290 ip-10-0-131-237 kubenswrapper[2577]: E0610 01:19:07.197265 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03eb65df35850767bf513a714e6ee1dca6ee0c84e97e5e411d23e627ce1617b8\": container with ID starting with 03eb65df35850767bf513a714e6ee1dca6ee0c84e97e5e411d23e627ce1617b8 not found: ID does not exist" containerID="03eb65df35850767bf513a714e6ee1dca6ee0c84e97e5e411d23e627ce1617b8" Jun 10 01:19:07.197387 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:07.197297 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03eb65df35850767bf513a714e6ee1dca6ee0c84e97e5e411d23e627ce1617b8"} err="failed to get container status \"03eb65df35850767bf513a714e6ee1dca6ee0c84e97e5e411d23e627ce1617b8\": rpc error: code = NotFound desc = could not find container \"03eb65df35850767bf513a714e6ee1dca6ee0c84e97e5e411d23e627ce1617b8\": container with ID starting with 03eb65df35850767bf513a714e6ee1dca6ee0c84e97e5e411d23e627ce1617b8 not found: ID does not exist" Jun 10 01:19:07.208848 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:07.208823 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5"] Jun 10 01:19:07.212361 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:07.212338 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f28e0a62-openshift-default-7698bf75f4-s7xb5"] Jun 10 01:19:07.600402 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:07.600368 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1fb81bb-874a-4c6f-880d-bf41fbf6af5c" path="/var/lib/kubelet/pods/b1fb81bb-874a-4c6f-880d-bf41fbf6af5c/volumes" Jun 10 01:19:18.037234 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:18.037153 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8449d75f-kwpbc_fa6efbbf-45b4-46f9-98c0-3cb091597618/nginx/0.log" Jun 10 01:19:18.155403 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:18.155370 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-t6bjf_c540febf-880f-4e9c-b65f-02f6eb5e8004/manager/0.log" Jun 10 01:19:18.278784 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:18.278745 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-wzwf6_39a5969b-0110-4e0e-ac53-6636135b8a44/manager/0.log" Jun 10 01:19:18.401471 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:18.401394 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5b988d6476-xlfs2_35469db7-6c95-44ff-a744-bb2c42090079/maas-api/0.log" Jun 10 01:19:18.748117 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:18.748060 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69b67d4c4b-68v4k_53013f75-5a4b-4044-8132-af1b48992fbe/manager/0.log" Jun 10 01:19:18.859480 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:18.859450 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-bc958_67612af5-05fb-4eb4-9dd5-8aa98964edbb/server/0.log" Jun 10 01:19:18.980771 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:18.980706 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-vfxnm_f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a/manager/0.log" Jun 10 01:19:19.351164 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:19.351137 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7746866678-sq86n_ba39a6fe-6d6d-4783-843b-ac99cb2bacdc/copy-manifests/0.log" Jun 10 01:19:19.357630 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:19.357585 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7746866678-sq86n_ba39a6fe-6d6d-4783-843b-ac99cb2bacdc/manager/0.log" Jun 10 01:19:20.973055 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:20.973015 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dg76b_2dc4ab2c-aa7e-47b5-9c3e-b191b827140c/manager/0.log" Jun 10 01:19:21.440653 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:21.440568 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xs7wn_a164fea2-ffc8-48b2-a445-6d6cb40e9284/limitador/0.log" Jun 10 01:19:22.034225 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:22.034178 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-g2hn2_f42be914-1e96-43c6-8160-20460edde7de/discovery/0.log" Jun 10 01:19:22.270446 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:22.270412 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfbfc59b5-b7gkn_eef3f5f3-479c-4535-b9a1-e4ac63caf164/kube-auth-proxy/0.log" Jun 10 01:19:22.754857 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:22.754827 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f4d5c5585-pngc5_8a6490e7-05a3-45a3-a080-4e2306c47840/router/0.log" Jun 10 01:19:23.213023 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:23.212985 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-mfll5_ea092b66-5f5b-4021-8d6e-8124fd21f22a/storage-initializer/0.log" Jun 10 01:19:23.220440 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:23.220417 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-mfll5_ea092b66-5f5b-4021-8d6e-8124fd21f22a/main/0.log" Jun 10 01:19:23.580449 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:23.580328 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc_1b25a1e6-7524-46e9-b0bd-be511f934331/main/0.log" Jun 10 01:19:23.586301 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:23.586269 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-5nxkc_1b25a1e6-7524-46e9-b0bd-be511f934331/storage-initializer/0.log" Jun 10 01:19:23.705422 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:23.705373 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-dq6hs_992b0a90-f14b-4a59-8dcd-dddfe1572696/storage-initializer/0.log" Jun 10 01:19:23.713525 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:23.713499 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-dq6hs_992b0a90-f14b-4a59-8dcd-dddfe1572696/main/0.log" Jun 10 01:19:31.432694 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:31.432661 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5mx5g_1380799b-1285-43c3-8c5d-d7f2b94278b8/global-pull-secret-syncer/0.log" Jun 10 01:19:31.649464 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:31.649426 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wxcx7_bde5b60b-554b-4465-952a-663fd38656bb/konnectivity-agent/0.log" Jun 10 01:19:31.671110 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:31.671080 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-237.ec2.internal_7a071ffa0cc2d42bd342637b19e0cdf8/haproxy/0.log" Jun 10 01:19:35.616326 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:35.616296 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-dbvwz_0a26e0c2-d2ec-4994-85f8-b982e93a1d4a/sail-operator/0.log" Jun 10 01:19:36.991480 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:36.991446 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dg76b_2dc4ab2c-aa7e-47b5-9c3e-b191b827140c/manager/0.log" Jun 10 01:19:37.196130 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:37.196095 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xs7wn_a164fea2-ffc8-48b2-a445-6d6cb40e9284/limitador/0.log" Jun 10 01:19:38.828862 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:38.828817 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2490c83-dec0-49ee-ae68-64d885f902a0/alertmanager/0.log" Jun 10 01:19:38.849477 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:38.849443 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2490c83-dec0-49ee-ae68-64d885f902a0/config-reloader/0.log" Jun 10 01:19:38.867374 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:38.867347 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2490c83-dec0-49ee-ae68-64d885f902a0/kube-rbac-proxy-web/0.log" Jun 10 01:19:38.885875 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:38.885847 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2490c83-dec0-49ee-ae68-64d885f902a0/kube-rbac-proxy/0.log" Jun 10 01:19:38.909085 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:38.909051 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2490c83-dec0-49ee-ae68-64d885f902a0/kube-rbac-proxy-metric/0.log" Jun 10 01:19:38.929346 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:38.929319 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2490c83-dec0-49ee-ae68-64d885f902a0/prom-label-proxy/0.log" Jun 10 01:19:38.951002 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:38.950975 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2490c83-dec0-49ee-ae68-64d885f902a0/init-config-reloader/0.log" Jun 10 01:19:39.027644 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:39.027608 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-znpgv_e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f/kube-state-metrics/0.log" Jun 10 01:19:39.042278 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:39.042175 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-znpgv_e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f/kube-rbac-proxy-main/0.log" Jun 10 01:19:39.059798 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:39.059764 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-znpgv_e9ebb2ff-f2c5-4bef-b311-ccd6f0d23f0f/kube-rbac-proxy-self/0.log" Jun 10 01:19:39.218352 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:39.218316 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x9pb4_3cd74bd0-98f9-4ae1-98a4-f6f8b063266b/node-exporter/0.log" Jun 10 01:19:39.235073 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:39.235045 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x9pb4_3cd74bd0-98f9-4ae1-98a4-f6f8b063266b/kube-rbac-proxy/0.log" Jun 10 01:19:39.255330 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:39.255308 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x9pb4_3cd74bd0-98f9-4ae1-98a4-f6f8b063266b/init-textfile/0.log" Jun 10 01:19:39.719899 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:39.719868 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-9tb62_f93ea029-e1fd-4677-b3bf-18c79a013822/prometheus-operator/0.log" Jun 10 01:19:39.733785 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:39.733754 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-9tb62_f93ea029-e1fd-4677-b3bf-18c79a013822/kube-rbac-proxy/0.log" Jun 10 01:19:39.754361 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:39.754329 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-jc74d_553b8ef6-88de-4d3f-86f5-3bbe1f726d51/prometheus-operator-admission-webhook/0.log" Jun 10 01:19:42.627222 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:42.627137 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-gdlrx_3d133a50-44da-4220-a81d-94f7790b6da8/download-server/0.log" Jun 10 01:19:43.715153 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.715116 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4"] Jun 10 01:19:43.716143 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.715866 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1fb81bb-874a-4c6f-880d-bf41fbf6af5c" containerName="istio-proxy" Jun 10 01:19:43.716143 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.715887 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1fb81bb-874a-4c6f-880d-bf41fbf6af5c" containerName="istio-proxy" Jun 10 01:19:43.716143 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.715923 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67fc2cc-103a-4008-8c70-87540e124e51" containerName="istio-proxy" Jun 10 01:19:43.716143 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.715935 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67fc2cc-103a-4008-8c70-87540e124e51" containerName="istio-proxy" Jun 10 01:19:43.716143 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.716053 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1fb81bb-874a-4c6f-880d-bf41fbf6af5c" containerName="istio-proxy" Jun 10 01:19:43.716143 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.716068 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e67fc2cc-103a-4008-8c70-87540e124e51" containerName="istio-proxy" Jun 10 01:19:43.723304 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.723277 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:43.727268 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.727107 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f5p9k\"/\"kube-root-ca.crt\"" Jun 10 01:19:43.727424 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.727106 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f5p9k\"/\"openshift-service-ca.crt\"" Jun 10 01:19:43.728323 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.728301 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f5p9k\"/\"default-dockercfg-98wnl\"" Jun 10 01:19:43.731077 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.731055 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4"] Jun 10 01:19:43.792123 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.792088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/905bf857-2269-4df8-8f71-ae803c434d97-podres\") pod \"perf-node-gather-daemonset-rnqw4\" (UID: \"905bf857-2269-4df8-8f71-ae803c434d97\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:43.792330 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.792137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vbvl\" (UniqueName: \"kubernetes.io/projected/905bf857-2269-4df8-8f71-ae803c434d97-kube-api-access-2vbvl\") pod \"perf-node-gather-daemonset-rnqw4\" (UID: \"905bf857-2269-4df8-8f71-ae803c434d97\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:43.792330 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.792160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/905bf857-2269-4df8-8f71-ae803c434d97-lib-modules\") pod \"perf-node-gather-daemonset-rnqw4\" (UID: \"905bf857-2269-4df8-8f71-ae803c434d97\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:43.792330 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.792255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/905bf857-2269-4df8-8f71-ae803c434d97-proc\") pod \"perf-node-gather-daemonset-rnqw4\" (UID: \"905bf857-2269-4df8-8f71-ae803c434d97\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:43.792441 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.792331 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/905bf857-2269-4df8-8f71-ae803c434d97-sys\") pod \"perf-node-gather-daemonset-rnqw4\" (UID: \"905bf857-2269-4df8-8f71-ae803c434d97\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:43.893288 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.893243 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/905bf857-2269-4df8-8f71-ae803c434d97-podres\") pod \"perf-node-gather-daemonset-rnqw4\" (UID: \"905bf857-2269-4df8-8f71-ae803c434d97\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:43.893485 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.893307 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vbvl\" (UniqueName: \"kubernetes.io/projected/905bf857-2269-4df8-8f71-ae803c434d97-kube-api-access-2vbvl\") pod \"perf-node-gather-daemonset-rnqw4\" (UID: \"905bf857-2269-4df8-8f71-ae803c434d97\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:43.893485 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.893326 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/905bf857-2269-4df8-8f71-ae803c434d97-lib-modules\") pod \"perf-node-gather-daemonset-rnqw4\" (UID: \"905bf857-2269-4df8-8f71-ae803c434d97\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:43.893485 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.893359 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/905bf857-2269-4df8-8f71-ae803c434d97-proc\") pod \"perf-node-gather-daemonset-rnqw4\" (UID: \"905bf857-2269-4df8-8f71-ae803c434d97\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:43.893485 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.893387 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/905bf857-2269-4df8-8f71-ae803c434d97-podres\") pod \"perf-node-gather-daemonset-rnqw4\" (UID: \"905bf857-2269-4df8-8f71-ae803c434d97\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:43.893485 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.893418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/905bf857-2269-4df8-8f71-ae803c434d97-sys\") pod \"perf-node-gather-daemonset-rnqw4\" (UID: \"905bf857-2269-4df8-8f71-ae803c434d97\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:43.893485 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.893459 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/905bf857-2269-4df8-8f71-ae803c434d97-proc\") pod \"perf-node-gather-daemonset-rnqw4\" (UID: \"905bf857-2269-4df8-8f71-ae803c434d97\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:43.893715 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.893504 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/905bf857-2269-4df8-8f71-ae803c434d97-sys\") pod \"perf-node-gather-daemonset-rnqw4\" (UID: \"905bf857-2269-4df8-8f71-ae803c434d97\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:43.893715 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.893509 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/905bf857-2269-4df8-8f71-ae803c434d97-lib-modules\") pod \"perf-node-gather-daemonset-rnqw4\" (UID: \"905bf857-2269-4df8-8f71-ae803c434d97\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:43.901218 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:43.901176 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vbvl\" (UniqueName: \"kubernetes.io/projected/905bf857-2269-4df8-8f71-ae803c434d97-kube-api-access-2vbvl\") pod \"perf-node-gather-daemonset-rnqw4\" (UID: \"905bf857-2269-4df8-8f71-ae803c434d97\") " pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:44.039062 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:44.038971 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:44.177719 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:44.177694 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4"] Jun 10 01:19:44.180068 ip-10-0-131-237 kubenswrapper[2577]: W0610 01:19:44.180033 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod905bf857_2269_4df8_8f71_ae803c434d97.slice/crio-148188b1940c42879cda0f2d4856f1e49f3c2356fed68886a1eb9ef4bbb7b184 WatchSource:0}: Error finding container 148188b1940c42879cda0f2d4856f1e49f3c2356fed68886a1eb9ef4bbb7b184: Status 404 returned error can't find the container with id 148188b1940c42879cda0f2d4856f1e49f3c2356fed68886a1eb9ef4bbb7b184 Jun 10 01:19:44.371785 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:44.371746 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" event={"ID":"905bf857-2269-4df8-8f71-ae803c434d97","Type":"ContainerStarted","Data":"eb84492f627e0e4dcc54bbd2ace645765351b3ed952681f5c67c05fbf238c188"} Jun 10 01:19:44.371937 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:44.371889 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:44.371937 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:44.371909 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" event={"ID":"905bf857-2269-4df8-8f71-ae803c434d97","Type":"ContainerStarted","Data":"148188b1940c42879cda0f2d4856f1e49f3c2356fed68886a1eb9ef4bbb7b184"} Jun 10 01:19:44.390749 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:44.390693 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" podStartSLOduration=1.3906776779999999 podStartE2EDuration="1.390677678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:19:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:19:44.388754656 +0000 UTC m=+2671.212660518" watchObservedRunningTime="2026-06-10 01:19:44.390677678 +0000 UTC m=+2671.214583536" Jun 10 01:19:44.579819 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:44.579775 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5zhlc_ad7c9a9b-90a0-4731-9879-86b04dabe8d4/dns/0.log" Jun 10 01:19:44.597354 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:44.597276 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5zhlc_ad7c9a9b-90a0-4731-9879-86b04dabe8d4/kube-rbac-proxy/0.log" Jun 10 01:19:44.706056 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:44.706030 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4s4hx_89d37dfe-78b5-4500-acd0-6cca4e681d0e/dns-node-resolver/0.log" Jun 10 01:19:45.349504 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:45.349463 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vs4nb_ed5d0b4d-14e2-4195-80bd-b21fa955dc69/node-ca/0.log" Jun 10 01:19:46.472214 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:46.472175 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-g2hn2_f42be914-1e96-43c6-8160-20460edde7de/discovery/0.log" Jun 10 01:19:46.512392 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:46.512364 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfbfc59b5-b7gkn_eef3f5f3-479c-4535-b9a1-e4ac63caf164/kube-auth-proxy/0.log" Jun 10 01:19:46.778955 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:46.778876 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f4d5c5585-pngc5_8a6490e7-05a3-45a3-a080-4e2306c47840/router/0.log" Jun 10 01:19:47.408835 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:47.408804 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2zvxw_f1e34cf6-3e84-46d9-9255-e1adae9cb707/serve-healthcheck-canary/0.log" Jun 10 01:19:47.978574 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:47.978541 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-f78lj_1c8ea57d-a827-45d8-9418-b3cee86b69b5/insights-operator/0.log" Jun 10 01:19:47.983445 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:47.983416 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-f78lj_1c8ea57d-a827-45d8-9418-b3cee86b69b5/insights-operator/1.log" Jun 10 01:19:48.071473 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:48.071442 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rqr7x_d482d069-9bae-4693-845b-dee273c9eb18/kube-rbac-proxy/0.log" Jun 10 01:19:48.090636 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:48.090598 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rqr7x_d482d069-9bae-4693-845b-dee273c9eb18/exporter/0.log" Jun 10 01:19:48.109327 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:48.109298 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rqr7x_d482d069-9bae-4693-845b-dee273c9eb18/extractor/0.log" Jun 10 01:19:50.388463 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:50.388437 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f5p9k/perf-node-gather-daemonset-rnqw4" Jun 10 01:19:50.389680 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:50.389661 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8449d75f-kwpbc_fa6efbbf-45b4-46f9-98c0-3cb091597618/nginx/0.log" Jun 10 01:19:50.426324 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:50.426289 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-t6bjf_c540febf-880f-4e9c-b65f-02f6eb5e8004/manager/0.log" Jun 10 01:19:50.593349 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:50.593315 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-wzwf6_39a5969b-0110-4e0e-ac53-6636135b8a44/manager/0.log" Jun 10 01:19:50.643133 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:50.643043 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5b988d6476-xlfs2_35469db7-6c95-44ff-a744-bb2c42090079/maas-api/0.log" Jun 10 01:19:50.817867 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:50.817823 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69b67d4c4b-68v4k_53013f75-5a4b-4044-8132-af1b48992fbe/manager/0.log" Jun 10 01:19:50.835525 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:50.835500 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-bc958_67612af5-05fb-4eb4-9dd5-8aa98964edbb/server/0.log" Jun 10 01:19:50.906877 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:50.906780 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-vfxnm_f89c3f9c-0d34-4112-a080-b1e7d4b5dc2a/manager/0.log" Jun 10 01:19:51.123280 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:51.123256 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7746866678-sq86n_ba39a6fe-6d6d-4783-843b-ac99cb2bacdc/manager/0.log" Jun 10 01:19:51.139363 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:51.139336 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7746866678-sq86n_ba39a6fe-6d6d-4783-843b-ac99cb2bacdc/copy-manifests/0.log" Jun 10 01:19:57.169975 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:57.169935 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-g2hn2_f42be914-1e96-43c6-8160-20460edde7de/discovery/0.log" Jun 10 01:19:57.197031 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:57.196996 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfbfc59b5-b7gkn_eef3f5f3-479c-4535-b9a1-e4ac63caf164/kube-auth-proxy/0.log" Jun 10 01:19:57.438520 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:57.438434 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f4d5c5585-pngc5_8a6490e7-05a3-45a3-a080-4e2306c47840/router/0.log" Jun 10 01:19:58.717807 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:58.717769 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-g2hn2_f42be914-1e96-43c6-8160-20460edde7de/discovery/0.log" Jun 10 01:19:58.744818 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:58.744783 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfbfc59b5-b7gkn_eef3f5f3-479c-4535-b9a1-e4ac63caf164/kube-auth-proxy/0.log" Jun 10 01:19:58.994377 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:58.994270 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f4d5c5585-pngc5_8a6490e7-05a3-45a3-a080-4e2306c47840/router/0.log" Jun 10 01:19:59.721253 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:59.721220 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-69jtz_6f45e7ea-500d-43be-bf54-c8e375d90bdd/kube-multus/0.log" Jun 10 01:19:59.893805 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:59.893780 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9vb8_900bf028-67cb-4c4a-92e6-40a73c642ec3/kube-multus-additional-cni-plugins/0.log" Jun 10 01:19:59.911810 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:59.911774 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9vb8_900bf028-67cb-4c4a-92e6-40a73c642ec3/egress-router-binary-copy/0.log" Jun 10 01:19:59.928675 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:59.928646 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9vb8_900bf028-67cb-4c4a-92e6-40a73c642ec3/cni-plugins/0.log" Jun 10 01:19:59.948507 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:59.948480 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9vb8_900bf028-67cb-4c4a-92e6-40a73c642ec3/bond-cni-plugin/0.log" Jun 10 01:19:59.968393 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:59.968303 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9vb8_900bf028-67cb-4c4a-92e6-40a73c642ec3/routeoverride-cni/0.log" Jun 10 01:19:59.985309 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:19:59.985281 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9vb8_900bf028-67cb-4c4a-92e6-40a73c642ec3/whereabouts-cni-bincopy/0.log" Jun 10 01:20:00.003139 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:20:00.003105 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9vb8_900bf028-67cb-4c4a-92e6-40a73c642ec3/whereabouts-cni/0.log" Jun 10 01:20:00.212837 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:20:00.212806 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-957rh_ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2/network-metrics-daemon/0.log" Jun 10 01:20:00.227177 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:20:00.227105 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-957rh_ecb6a6ce-ee5b-4489-925d-a3b2a32da8b2/kube-rbac-proxy/0.log" Jun 10 01:20:00.688391 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:20:00.688275 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-g2hn2_f42be914-1e96-43c6-8160-20460edde7de/discovery/0.log" Jun 10 01:20:00.717073 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:20:00.717047 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfbfc59b5-b7gkn_eef3f5f3-479c-4535-b9a1-e4ac63caf164/kube-auth-proxy/0.log" Jun 10 01:20:00.975166 ip-10-0-131-237 kubenswrapper[2577]: I0610 01:20:00.975127 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f4d5c5585-pngc5_8a6490e7-05a3-45a3-a080-4e2306c47840/router/0.log"