Jul 22 02:14:33.411318 ip-10-0-132-37 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 22 02:14:33.411330 ip-10-0-132-37 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 22 02:14:33.411337 ip-10-0-132-37 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 22 02:14:33.411632 ip-10-0-132-37 systemd[1]: Failed to start Kubernetes Kubelet. Jul 22 02:14:43.561551 ip-10-0-132-37 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 22 02:14:43.561566 ip-10-0-132-37 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3abc454f074f4a778fd189af00bbd181 -- Jul 22 02:16:43.615026 ip-10-0-132-37 systemd[1]: Starting Kubernetes Kubelet... Jul 22 02:16:44.065035 ip-10-0-132-37 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 02:16:44.065035 ip-10-0-132-37 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 02:16:44.065035 ip-10-0-132-37 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 02:16:44.065035 ip-10-0-132-37 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 02:16:44.065035 ip-10-0-132-37 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 02:16:44.065762 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.065099 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 02:16:44.072057 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072029 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:44.072057 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072051 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:44.072057 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072056 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:44.072057 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072060 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:44.072057 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072064 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072068 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072072 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072076 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072079 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072083 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072087 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072091 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072093 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072096 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072099 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072102 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072105 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072108 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072111 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072113 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072116 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072119 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072122 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072126 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:44.072272 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072129 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072139 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072142 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072145 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072148 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072150 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072153 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072156 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072162 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072166 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072169 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072171 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072174 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072178 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072181 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072184 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072187 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072190 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072193 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072196 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:44.072796 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072199 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072202 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072204 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072207 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072210 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072212 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072215 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072218 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072221 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072224 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072227 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072229 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072232 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072235 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072238 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072241 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072243 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072246 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072249 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:44.073331 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072252 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072255 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072258 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072261 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072265 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072268 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072271 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072274 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072277 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072280 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072283 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072286 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072289 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072292 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072295 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072298 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072301 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072304 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072306 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:44.073915 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072311 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072317 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072320 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072323 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072327 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072329 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072332 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072335 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072338 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072340 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072343 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072346 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072348 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072351 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072354 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072357 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.072361 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073195 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073203 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073207 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:44.074423 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073210 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073213 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073216 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073220 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073223 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073226 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073229 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073232 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073235 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073237 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073240 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073243 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073246 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073249 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073252 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073257 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073262 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073265 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073268 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073272 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:44.074955 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073276 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073279 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073282 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073285 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073288 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073290 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073293 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073296 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073299 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073302 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073305 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073308 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073311 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073314 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073317 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073319 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073322 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073325 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073328 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073330 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:44.075475 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073333 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073336 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073339 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073342 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073345 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073347 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073350 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073353 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073356 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073359 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073361 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073365 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073368 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073372 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073375 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073379 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073383 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073386 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073389 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:44.076021 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073392 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073395 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073398 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073401 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073404 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073406 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073410 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073414 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073417 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073420 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073422 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073425 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073428 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073432 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073434 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073437 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073440 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073443 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073445 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:44.076533 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073448 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073451 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073455 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073459 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073461 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073464 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073467 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073469 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073472 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073475 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073478 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073480 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073483 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073486 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073489 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073491 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073494 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073497 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073938 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073945 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:44.077043 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073948 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073951 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073954 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073957 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073959 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073962 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073965 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073968 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073970 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073974 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073976 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073979 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073982 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073985 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073989 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073992 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073995 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.073998 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074000 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074003 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:44.077594 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074006 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074009 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074011 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074014 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074019 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074024 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074027 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074030 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074033 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074036 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074039 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074042 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074045 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074048 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074050 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074053 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074056 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074058 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074061 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:44.078125 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074063 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074066 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074069 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074071 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074074 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074076 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074079 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074082 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074086 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074089 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074091 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074094 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074097 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074100 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074102 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074105 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074111 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074114 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074116 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074119 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:44.078660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074122 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074125 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074128 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074133 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074137 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074140 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074143 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074146 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074149 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074152 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074155 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074158 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074161 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074164 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074167 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074170 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074173 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074176 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074180 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:44.079189 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074183 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074186 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074190 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074193 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074196 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074199 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074202 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074204 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074207 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074212 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074215 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074218 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074220 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074223 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074226 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074229 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074233 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074235 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.074238 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074315 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 02:16:44.079679 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074323 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074331 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074337 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074344 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074349 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074356 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074361 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074364 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074368 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074375 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074378 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074382 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074385 2579 flags.go:64] FLAG: --cgroup-root="" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074388 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074391 2579 flags.go:64] FLAG: --client-ca-file="" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074395 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074398 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074404 2579 flags.go:64] FLAG: --cluster-domain="" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074406 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074410 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074413 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074418 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074421 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 02:16:44.080259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074425 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074428 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074432 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074435 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074439 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074442 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074445 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074449 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074453 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074456 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074459 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074463 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074466 2579 flags.go:64] FLAG: --enable-server="true" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074469 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074473 2579 flags.go:64] FLAG: --event-burst="100" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074476 2579 flags.go:64] FLAG: --event-qps="50" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074479 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074482 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074487 2579 flags.go:64] FLAG: --eviction-hard="" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074491 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074494 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074497 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074500 2579 flags.go:64] FLAG: --eviction-soft="" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074503 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074506 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 02:16:44.080851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074510 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074513 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074516 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074519 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074522 2579 flags.go:64] FLAG: --feature-gates="" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074527 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074530 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074533 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074537 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074540 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074543 2579 flags.go:64] FLAG: --help="false" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074546 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074549 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074552 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074555 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074559 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074563 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074566 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074569 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074572 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074575 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074578 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074582 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074584 2579 flags.go:64] FLAG: --kube-reserved="" Jul 22 02:16:44.081536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074587 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074591 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074595 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074597 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074600 2579 flags.go:64] FLAG: --lock-file="" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074603 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074606 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074610 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074615 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074622 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074626 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074629 2579 flags.go:64] FLAG: --logging-format="text" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074632 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074638 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074641 2579 flags.go:64] FLAG: --manifest-url="" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074644 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074648 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074651 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074656 2579 flags.go:64] FLAG: --max-pods="110" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074659 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074662 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074665 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074668 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074671 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074674 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 02:16:44.082219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074678 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074685 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074689 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074692 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074695 2579 flags.go:64] FLAG: --pod-cidr="" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074698 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074704 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074707 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074710 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074715 2579 flags.go:64] FLAG: --port="10250" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074718 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074721 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0807f48a196fd2665" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074725 2579 flags.go:64] FLAG: --qos-reserved="" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074728 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074731 2579 flags.go:64] FLAG: --register-node="true" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074734 2579 flags.go:64] FLAG: --register-with-taints="" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074743 2579 flags.go:64] FLAG: --registry-burst="10" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074747 2579 flags.go:64] FLAG: --registry-qps="5" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074750 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074753 2579 flags.go:64] FLAG: --reserved-memory="" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074758 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074762 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074765 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074768 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074771 2579 flags.go:64] FLAG: --runonce="false" Jul 22 02:16:44.082877 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074774 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074777 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074780 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074783 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074786 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074789 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074792 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074796 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074799 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074802 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074805 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074808 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074811 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074814 2579 flags.go:64] FLAG: --system-cgroups="" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074817 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074822 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074845 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074848 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074853 2579 flags.go:64] FLAG: --tls-min-version="" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074856 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074859 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074862 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074865 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074868 2579 flags.go:64] FLAG: --v="2" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074873 2579 flags.go:64] FLAG: --version="false" Jul 22 02:16:44.083525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074877 2579 flags.go:64] FLAG: --vmodule="" Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074881 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.074886 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075012 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075017 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075020 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075023 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075026 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075029 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075032 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075035 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075038 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075041 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075043 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075046 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075049 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075051 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075054 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075057 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075059 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:44.084242 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075063 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075065 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075068 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075071 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075074 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075077 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075081 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075085 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075088 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075091 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075094 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075097 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075100 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075103 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075107 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075110 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075112 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075115 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075118 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:44.084765 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075121 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075123 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075126 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075129 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075132 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075134 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075137 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075140 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075143 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075145 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075148 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075151 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075153 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075156 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075159 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075162 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075164 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075167 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075169 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:44.085275 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075172 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075175 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075177 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075180 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075183 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075186 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075188 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075191 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075196 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075249 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075254 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075257 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075262 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075266 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075269 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075273 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075276 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075279 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075281 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:44.085788 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075284 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075287 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075290 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075292 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075295 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075298 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075301 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075304 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075306 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075309 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075312 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075315 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075318 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075321 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075323 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075326 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075329 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075332 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075334 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075337 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:44.086304 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075340 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:44.086816 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075344 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:44.086816 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075347 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:44.086816 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075351 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:44.086816 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.075355 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:44.086816 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.076142 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 02:16:44.086816 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.083717 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 02:16:44.086816 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.083733 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 02:16:44.086816 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.083749 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 02:16:44.086816 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.083755 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 02:16:44.086816 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083818 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:44.086816 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083842 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:44.086816 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083848 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:44.086816 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083851 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:44.086816 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083854 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:44.086816 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083858 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083861 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083864 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083867 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083870 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083874 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083877 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083879 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083883 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083886 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083889 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083891 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083894 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083897 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083899 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083902 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083905 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083909 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083912 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083916 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:44.087286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083919 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083921 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083924 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083927 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083930 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083933 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083936 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083939 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083942 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083945 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083947 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083950 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083953 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083957 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083961 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083964 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083968 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083971 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083974 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:44.087808 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083977 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083980 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083984 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083987 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083990 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083993 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083995 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.083999 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084002 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084005 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084008 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084011 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084014 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084025 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084028 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084031 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084034 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084037 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084040 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084043 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:44.088437 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084046 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084049 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084052 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084055 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084058 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084061 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084063 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084066 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084069 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084072 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084075 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084078 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084080 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084083 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084086 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084088 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084091 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084094 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084112 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084117 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:44.088985 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084121 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:44.089506 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084125 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:44.089506 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084129 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:44.089506 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084132 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:44.089506 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084135 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:44.089506 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084139 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:44.089506 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084148 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:44.089506 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084151 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:44.089506 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084154 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:44.089506 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084157 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:44.089506 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084160 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:44.089506 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084162 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:44.089506 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084166 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:44.089506 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084169 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:44.089506 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084172 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:44.089506 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.084178 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084336 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084341 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084345 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084348 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084351 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084354 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084357 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084361 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084364 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084367 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084370 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084373 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084376 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084379 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084382 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084385 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084388 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084391 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084394 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:44.089928 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084397 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084399 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084402 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084405 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084408 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084411 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084413 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084417 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084420 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084422 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084425 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084428 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084430 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084433 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084436 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084438 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084441 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084443 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084446 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:44.090443 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084450 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084454 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084459 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084462 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084465 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084468 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084471 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084474 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084476 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084479 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084482 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084485 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084487 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084491 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084494 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084497 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084499 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084502 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084511 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084514 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:44.090951 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084517 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084519 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084522 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084525 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084528 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084531 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084534 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084536 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084539 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084542 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084545 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084547 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084551 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084555 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084558 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084561 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084565 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084568 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084571 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:44.091471 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084574 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084577 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084580 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084583 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084586 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084589 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084591 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084594 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084597 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084599 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084602 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084605 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084613 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084617 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084620 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084623 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084625 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084628 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084631 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084633 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:44.092029 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084636 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:44.092578 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:44.084639 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:44.092578 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.084644 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 02:16:44.092578 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.084749 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 02:16:44.092578 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.086940 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 02:16:44.092578 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.088423 2579 server.go:1019] "Starting client certificate rotation" Jul 22 02:16:44.092578 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.088522 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 02:16:44.092578 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.089319 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 02:16:44.092578 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.092175 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 02:16:44.094005 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.093988 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 02:16:44.106224 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.106189 2579 log.go:25] "Validated CRI v1 runtime API" Jul 22 02:16:44.108538 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.108520 2579 log.go:25] "Validated CRI v1 image API" Jul 22 02:16:44.109459 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.109435 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 02:16:44.113197 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.113176 2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 92ce88f4-103a-4a2f-808c-270ed3066449:/dev/nvme0n1p4 eaec48f2-bc78-4b59-a77a-ae9ea0fab75e:/dev/nvme0n1p3] Jul 22 02:16:44.113277 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.113195 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 02:16:44.119501 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.119382 2579 manager.go:216] Machine: {Timestamp:2026-07-22 02:16:44.118023175 +0000 UTC m=+0.369584660 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3185208 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d051af827d5ae378d126d98a3f01e SystemUUID:ec2d051a-f827-d5ae-378d-126d98a3f01e BootID:3abc454f-074f-4a77-8fd1-89af00bbd181 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:50:ab:7a:6b:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:50:ab:7a:6b:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:41:15:63:cb:eb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 02:16:44.119501 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.119493 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 02:16:44.119633 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.119574 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 02:16:44.122416 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.122396 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 02:16:44.122920 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.122896 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 02:16:44.123058 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.122925 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-37.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 02:16:44.123708 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.123695 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 02:16:44.123749 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.123710 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 02:16:44.123749 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.123718 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 02:16:44.124496 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.124483 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 02:16:44.125881 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.125870 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 02:16:44.129084 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.129072 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 22 02:16:44.129217 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.129207 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 02:16:44.129252 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.129243 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 22 02:16:44.129285 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.129262 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 02:16:44.129285 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.129277 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 02:16:44.129340 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.129288 2579 kubelet.go:398] "Adding apiserver pod source" Jul 22 02:16:44.129340 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.129298 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 02:16:44.129683 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.129670 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 02:16:44.129721 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.129692 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 02:16:44.132081 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.132066 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 02:16:44.133967 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.133948 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 02:16:44.134047 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.133991 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 02:16:44.135317 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.135303 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 02:16:44.135387 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.135323 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 02:16:44.135387 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.135333 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 02:16:44.135387 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.135342 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 02:16:44.135387 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.135356 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 02:16:44.135387 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.135365 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 02:16:44.135387 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.135377 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 02:16:44.135608 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.135392 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 02:16:44.135608 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.135405 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 02:16:44.135608 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.135414 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 02:16:44.135608 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.135428 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 02:16:44.135608 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.135444 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 02:16:44.136889 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.136876 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 02:16:44.136955 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.136892 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 02:16:44.140309 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.140285 2579 server.go:1268] "Started kubelet" Jul 22 02:16:44.140413 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.140387 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 02:16:44.140465 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.140408 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 02:16:44.140465 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.140459 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-37.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 02:16:44.140564 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.140442 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 02:16:44.140564 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.140502 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 02:16:44.140729 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.140513 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 02:16:44.141229 ip-10-0-132-37 systemd[1]: Started Kubernetes Kubelet. Jul 22 02:16:44.142703 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.142675 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 02:16:44.143953 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.143923 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 22 02:16:44.146235 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.146217 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 02:16:44.149694 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.149672 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 02:16:44.153179 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.149705 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 02:16:44.153521 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.153492 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2lmwr" Jul 22 02:16:44.153855 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.153799 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-37.ec2.internal\" not found" Jul 22 02:16:44.154786 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.154766 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 02:16:44.154888 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.154789 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 02:16:44.154888 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.154851 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 02:16:44.154986 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.154953 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 22 02:16:44.154986 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.154962 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 22 02:16:44.155097 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.149218 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-37.ec2.internal.18c47b02c32db9f0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-37.ec2.internal,UID:ip-10-0-132-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-37.ec2.internal,},FirstTimestamp:2026-07-22 02:16:44.14026392 +0000 UTC m=+0.391825405,LastTimestamp:2026-07-22 02:16:44.14026392 +0000 UTC m=+0.391825405,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-37.ec2.internal,}" Jul 22 02:16:44.155383 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.155367 2579 factory.go:55] Registering systemd factory Jul 22 02:16:44.155477 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.155467 2579 factory.go:223] Registration of the systemd container factory successfully Jul 22 02:16:44.155968 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.155951 2579 factory.go:153] Registering CRI-O factory Jul 22 02:16:44.155968 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.155969 2579 factory.go:223] Registration of the crio container factory successfully Jul 22 02:16:44.156095 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.156021 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 02:16:44.156095 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.156076 2579 factory.go:103] Registering Raw factory Jul 22 02:16:44.156095 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.156094 2579 manager.go:1196] Started watching for new ooms in manager Jul 22 02:16:44.156966 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.156950 2579 manager.go:349] Starting recovery of all containers Jul 22 02:16:44.157068 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.157027 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2lmwr" Jul 22 02:16:44.162083 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.162052 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 22 02:16:44.162232 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.162206 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 22 02:16:44.167766 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.167751 2579 manager.go:354] Recovery completed Jul 22 02:16:44.172268 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.172255 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 02:16:44.174221 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.174205 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasSufficientMemory" Jul 22 02:16:44.174283 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.174233 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 02:16:44.174283 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.174245 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasSufficientPID" Jul 22 02:16:44.174777 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.174762 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 02:16:44.174844 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.174767 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 02:16:44.174911 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.174845 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 02:16:44.174911 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.174868 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 22 02:16:44.175551 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.175533 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasSufficientMemory" Jul 22 02:16:44.175607 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.175570 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 02:16:44.175607 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.175587 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasSufficientPID" Jul 22 02:16:44.176617 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.176605 2579 policy_none.go:49] "None policy: Start" Jul 22 02:16:44.176667 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.176621 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 02:16:44.176667 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.176632 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 02:16:44.177875 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.177864 2579 policy_none.go:47] "Start" Jul 22 02:16:44.216525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.216380 2579 manager.go:337] "Starting Device Plugin manager" Jul 22 02:16:44.216621 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.216543 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 02:16:44.216621 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.216556 2579 server.go:87] "Starting device plugin registration server" Jul 22 02:16:44.216835 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.216818 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 02:16:44.216902 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.216849 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 02:16:44.216962 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.216950 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 02:16:44.217069 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.217054 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 02:16:44.217069 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.217069 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 02:16:44.217561 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.217543 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 02:16:44.217642 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.217601 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-37.ec2.internal\" not found" Jul 22 02:16:44.317643 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.317564 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 02:16:44.319217 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.319201 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasSufficientMemory" Jul 22 02:16:44.319288 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.319232 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 02:16:44.319288 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.319243 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasSufficientPID" Jul 22 02:16:44.319288 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.319275 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.328867 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.328847 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.328953 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.328870 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-37.ec2.internal\": node \"ip-10-0-132-37.ec2.internal\" not found" Jul 22 02:16:44.339151 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.339128 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 02:16:44.340398 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.340380 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 02:16:44.340506 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.340429 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 02:16:44.340506 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.340459 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 02:16:44.340506 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.340499 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 02:16:44.342788 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.342767 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:44.343995 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.343978 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-37.ec2.internal\" not found" Jul 22 02:16:44.444478 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.444424 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-37.ec2.internal\" not found" Jul 22 02:16:44.445196 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.444444 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-37.ec2.internal"] Jul 22 02:16:44.445256 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.445246 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 02:16:44.446235 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.446220 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasSufficientMemory" Jul 22 02:16:44.446307 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.446251 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 02:16:44.446307 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.446262 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasSufficientPID" Jul 22 02:16:44.447802 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.447788 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 02:16:44.447901 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.447885 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.447955 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.447922 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 02:16:44.448516 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.448498 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasSufficientMemory" Jul 22 02:16:44.448594 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.448523 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 02:16:44.448594 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.448533 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasSufficientPID" Jul 22 02:16:44.448594 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.448497 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasSufficientMemory" Jul 22 02:16:44.448688 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.448599 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 02:16:44.448688 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.448609 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasSufficientPID" Jul 22 02:16:44.449848 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.449829 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.449962 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.449860 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 02:16:44.450524 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.450503 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasSufficientMemory" Jul 22 02:16:44.450625 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.450532 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 02:16:44.450625 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.450542 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeHasSufficientPID" Jul 22 02:16:44.456254 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.456226 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7acaaf55abe01c6e7ca4d2a284040336-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal\" (UID: \"7acaaf55abe01c6e7ca4d2a284040336\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.456254 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.456253 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7acaaf55abe01c6e7ca4d2a284040336-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal\" (UID: \"7acaaf55abe01c6e7ca4d2a284040336\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.456367 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.456271 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cb3cb116ed8a362c1b5ea2fe16379342-config\") pod \"kube-apiserver-proxy-ip-10-0-132-37.ec2.internal\" (UID: \"cb3cb116ed8a362c1b5ea2fe16379342\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.480556 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.480529 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-37.ec2.internal\" not found" node="ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.485236 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.485218 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-37.ec2.internal\" not found" node="ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.545078 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.545034 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-37.ec2.internal\" not found" Jul 22 02:16:44.557357 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.557339 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7acaaf55abe01c6e7ca4d2a284040336-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal\" (UID: \"7acaaf55abe01c6e7ca4d2a284040336\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.557432 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.557366 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7acaaf55abe01c6e7ca4d2a284040336-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal\" (UID: \"7acaaf55abe01c6e7ca4d2a284040336\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.557432 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.557385 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cb3cb116ed8a362c1b5ea2fe16379342-config\") pod \"kube-apiserver-proxy-ip-10-0-132-37.ec2.internal\" (UID: \"cb3cb116ed8a362c1b5ea2fe16379342\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.557510 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.557460 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7acaaf55abe01c6e7ca4d2a284040336-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal\" (UID: \"7acaaf55abe01c6e7ca4d2a284040336\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.557510 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.557476 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cb3cb116ed8a362c1b5ea2fe16379342-config\") pod \"kube-apiserver-proxy-ip-10-0-132-37.ec2.internal\" (UID: \"cb3cb116ed8a362c1b5ea2fe16379342\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.557510 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.557476 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7acaaf55abe01c6e7ca4d2a284040336-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal\" (UID: \"7acaaf55abe01c6e7ca4d2a284040336\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.646027 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.645946 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-37.ec2.internal\" not found" Jul 22 02:16:44.753331 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.753291 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-37.ec2.internal\" not found" Jul 22 02:16:44.785115 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.785085 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.788132 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:44.788099 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-37.ec2.internal" Jul 22 02:16:44.854434 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.854392 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-37.ec2.internal\" not found" Jul 22 02:16:44.960932 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:44.960857 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-37.ec2.internal\" not found" Jul 22 02:16:45.022909 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.022884 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:45.056131 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.056111 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal" Jul 22 02:16:45.067498 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.067477 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 02:16:45.069834 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.069811 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-37.ec2.internal" Jul 22 02:16:45.076730 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.076718 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 02:16:45.087646 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.087625 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 02:16:45.087794 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.087760 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 02:16:45.087833 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.087779 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 02:16:45.132311 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.132292 2579 apiserver.go:52] "Watching apiserver" Jul 22 02:16:45.147427 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.147403 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 02:16:45.148683 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.148660 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-kfkc8","openshift-network-diagnostics/network-check-target-dkjcx","openshift-network-operator/iptables-alerter-rwn4x","kube-system/konnectivity-agent-hnk2n","kube-system/kube-apiserver-proxy-ip-10-0-132-37.ec2.internal","openshift-cluster-node-tuning-operator/tuned-bwsh4","openshift-image-registry/node-ca-qmrkw","openshift-multus/multus-additional-cni-plugins-h9hdr","openshift-ovn-kubernetes/ovnkube-node-nhgq8","kube-system/global-pull-secret-syncer-5x227","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp","openshift-dns/node-resolver-wm4hz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal","openshift-multus/multus-22g6m"] Jul 22 02:16:45.150057 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.150041 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qmrkw" Jul 22 02:16:45.151139 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.151124 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.152209 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.152189 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rwn4x" Jul 22 02:16:45.152582 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.152565 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mgp4t\"" Jul 22 02:16:45.152922 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.152907 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 02:16:45.152977 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.152908 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 02:16:45.153271 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.153247 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 02:16:45.153271 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.153253 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hnk2n" Jul 22 02:16:45.153533 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.153518 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 02:16:45.153999 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.153982 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 02:16:45.154102 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.154003 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 02:16:45.154102 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.153983 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 02:16:45.154271 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.154220 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 02:16:45.154328 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.154286 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vr886\"" Jul 22 02:16:45.154328 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.154297 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 02:16:45.154615 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.154602 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:16:45.154677 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.154658 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:16:45.154929 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.154887 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 02:16:45.155024 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.154889 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 02:16:45.155105 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.154948 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 02:16:45.155105 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.155072 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h2cjg\"" Jul 22 02:16:45.155708 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.155693 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 02:16:45.155818 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.155804 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.156002 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.155980 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 02:16:45.156712 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.156693 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l4fjd\"" Jul 22 02:16:45.157277 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.157264 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.159318 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.159029 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4rmgv\"" Jul 22 02:16:45.159318 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.159117 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 02:16:45.159318 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.159257 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 02:16:45.160230 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.159949 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 02:16:45.160327 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.160291 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.160742 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.160721 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 02:16:45.161596 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161579 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6cx6\" (UniqueName: \"kubernetes.io/projected/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-kube-api-access-k6cx6\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.161666 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161603 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs\") pod \"network-metrics-daemon-kfkc8\" (UID: \"9d672470-60f6-4b81-b905-187af05f5b29\") " pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:16:45.161666 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161619 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-kubernetes\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.161733 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161637 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-system-cni-dir\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.161733 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161692 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.161733 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161712 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d702e61a-96f1-4db2-bdcc-8301df7cb325-agent-certs\") pod \"konnectivity-agent-hnk2n\" (UID: \"d702e61a-96f1-4db2-bdcc-8301df7cb325\") " pod="kube-system/konnectivity-agent-hnk2n" Jul 22 02:16:45.161733 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161727 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rccm9\" (UniqueName: \"kubernetes.io/projected/9d672470-60f6-4b81-b905-187af05f5b29-kube-api-access-rccm9\") pod \"network-metrics-daemon-kfkc8\" (UID: \"9d672470-60f6-4b81-b905-187af05f5b29\") " pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:16:45.161919 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161744 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-cnibin\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.161919 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161768 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-os-release\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.161919 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161805 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.161919 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161822 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-modprobe-d\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.161919 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161837 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-sysctl-conf\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.161919 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161852 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntkrc\" (UniqueName: \"kubernetes.io/projected/13620db1-75d1-4148-a52a-bcef93df1676-kube-api-access-ntkrc\") pod \"node-ca-qmrkw\" (UID: \"13620db1-75d1-4148-a52a-bcef93df1676\") " pod="openshift-image-registry/node-ca-qmrkw" Jul 22 02:16:45.161919 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161867 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d702e61a-96f1-4db2-bdcc-8301df7cb325-konnectivity-ca\") pod \"konnectivity-agent-hnk2n\" (UID: \"d702e61a-96f1-4db2-bdcc-8301df7cb325\") " pod="kube-system/konnectivity-agent-hnk2n" Jul 22 02:16:45.161919 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161882 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f640819-bb86-4cac-bc28-45d32be254da-etc-tuned\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.161919 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.162257 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.162257 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.161970 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/239e8e5b-5922-4d4c-a37b-100c6f0078c4-host-slash\") pod \"iptables-alerter-rwn4x\" (UID: \"239e8e5b-5922-4d4c-a37b-100c6f0078c4\") " pod="openshift-network-operator/iptables-alerter-rwn4x" Jul 22 02:16:45.162257 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162006 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-lib-modules\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.162257 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162032 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-var-lib-kubelet\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.162257 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162046 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-host\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.162257 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162061 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-systemd\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.162257 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162095 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13620db1-75d1-4148-a52a-bcef93df1676-host\") pod \"node-ca-qmrkw\" (UID: \"13620db1-75d1-4148-a52a-bcef93df1676\") " pod="openshift-image-registry/node-ca-qmrkw" Jul 22 02:16:45.162257 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162126 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:16:45.162257 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162174 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 02:11:44 +0000 UTC" deadline="2028-01-04 04:02:43.116969536 +0000 UTC" Jul 22 02:16:45.162257 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162135 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/239e8e5b-5922-4d4c-a37b-100c6f0078c4-iptables-alerter-script\") pod \"iptables-alerter-rwn4x\" (UID: \"239e8e5b-5922-4d4c-a37b-100c6f0078c4\") " pod="openshift-network-operator/iptables-alerter-rwn4x" Jul 22 02:16:45.162257 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162234 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12745h45m57.954739174s" Jul 22 02:16:45.162257 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162255 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-run\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.162745 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162282 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mcp5\" (UniqueName: \"kubernetes.io/projected/239e8e5b-5922-4d4c-a37b-100c6f0078c4-kube-api-access-8mcp5\") pod \"iptables-alerter-rwn4x\" (UID: \"239e8e5b-5922-4d4c-a37b-100c6f0078c4\") " pod="openshift-network-operator/iptables-alerter-rwn4x" Jul 22 02:16:45.162745 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.162292 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:16:45.162745 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162305 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-sysctl-d\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.162745 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162327 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-sys\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.162745 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162359 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f640819-bb86-4cac-bc28-45d32be254da-tmp\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.162745 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13620db1-75d1-4148-a52a-bcef93df1676-serviceca\") pod \"node-ca-qmrkw\" (UID: \"13620db1-75d1-4148-a52a-bcef93df1676\") " pod="openshift-image-registry/node-ca-qmrkw" Jul 22 02:16:45.162745 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162437 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-sysconfig\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.162745 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162470 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r2wh\" (UniqueName: \"kubernetes.io/projected/8f640819-bb86-4cac-bc28-45d32be254da-kube-api-access-8r2wh\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.162745 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162538 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 02:16:45.162745 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162553 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 02:16:45.162745 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162558 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 02:16:45.162745 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162567 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x7whw\"" Jul 22 02:16:45.162745 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.162542 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 02:16:45.163390 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.163374 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8rmtw\"" Jul 22 02:16:45.163463 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.163377 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 02:16:45.163519 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.163504 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:45.163597 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.163573 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:16:45.165434 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.165004 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.166366 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.166350 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wm4hz" Jul 22 02:16:45.167460 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.167443 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 02:16:45.167517 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.167458 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 02:16:45.167649 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.167637 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8sfsg\"" Jul 22 02:16:45.167696 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.167656 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 02:16:45.168885 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.168870 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 02:16:45.169022 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.169003 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 02:16:45.169094 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.169080 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6l9d4\"" Jul 22 02:16:45.171121 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.171104 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 02:16:45.194987 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.194969 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8j4dp" Jul 22 02:16:45.202505 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.202488 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8j4dp" Jul 22 02:16:45.209074 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.209052 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:45.255670 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.255654 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 02:16:45.262732 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.262713 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mcp5\" (UniqueName: \"kubernetes.io/projected/239e8e5b-5922-4d4c-a37b-100c6f0078c4-kube-api-access-8mcp5\") pod \"iptables-alerter-rwn4x\" (UID: \"239e8e5b-5922-4d4c-a37b-100c6f0078c4\") " pod="openshift-network-operator/iptables-alerter-rwn4x" Jul 22 02:16:45.262808 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.262737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-sys\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.262808 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.262776 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f640819-bb86-4cac-bc28-45d32be254da-tmp\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.262808 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.262795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-run-multus-certs\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.262943 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.262818 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00c60860-7a47-4782-9bc3-35d8a634cd22-dbus\") pod \"global-pull-secret-syncer-5x227\" (UID: \"00c60860-7a47-4782-9bc3-35d8a634cd22\") " pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:45.262943 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.262838 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-etc-selinux\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.262943 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.262859 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9l26\" (UniqueName: \"kubernetes.io/projected/6b6addb2-a454-42ff-a2f5-38df9185e169-kube-api-access-l9l26\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.262943 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.262906 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13620db1-75d1-4148-a52a-bcef93df1676-serviceca\") pod \"node-ca-qmrkw\" (UID: \"13620db1-75d1-4148-a52a-bcef93df1676\") " pod="openshift-image-registry/node-ca-qmrkw" Jul 22 02:16:45.262943 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.262931 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-sysconfig\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.263173 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.262952 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-sys\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.263173 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r2wh\" (UniqueName: \"kubernetes.io/projected/8f640819-bb86-4cac-bc28-45d32be254da-kube-api-access-8r2wh\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.263173 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263027 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-sysconfig\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.263173 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c42e8544-729e-4248-a570-b30816bd8b23-cni-binary-copy\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.263173 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-run-netns\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.263173 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263108 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-slash\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.263173 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263135 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-run-systemd\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.263173 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263145 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 02:16:45.263173 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263165 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.263588 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263197 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-kubernetes\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.263588 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263228 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/056fdfa0-f529-40da-95cc-cb54877585ea-ovn-node-metrics-cert\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.263588 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-system-cni-dir\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.263588 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263293 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.263588 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263322 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d702e61a-96f1-4db2-bdcc-8301df7cb325-agent-certs\") pod \"konnectivity-agent-hnk2n\" (UID: \"d702e61a-96f1-4db2-bdcc-8301df7cb325\") " pod="kube-system/konnectivity-agent-hnk2n" Jul 22 02:16:45.263588 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263370 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rccm9\" (UniqueName: \"kubernetes.io/projected/9d672470-60f6-4b81-b905-187af05f5b29-kube-api-access-rccm9\") pod \"network-metrics-daemon-kfkc8\" (UID: \"9d672470-60f6-4b81-b905-187af05f5b29\") " pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:16:45.263588 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263396 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-sys-fs\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.263588 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263423 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-run-openvswitch\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.263588 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-cnibin\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.263588 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263472 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-kubernetes\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.263588 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263567 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-sysctl-conf\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.264166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263598 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzj5q\" (UniqueName: \"kubernetes.io/projected/c42e8544-729e-4248-a570-b30816bd8b23-kube-api-access-vzj5q\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.264166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d702e61a-96f1-4db2-bdcc-8301df7cb325-konnectivity-ca\") pod \"konnectivity-agent-hnk2n\" (UID: \"d702e61a-96f1-4db2-bdcc-8301df7cb325\") " pod="kube-system/konnectivity-agent-hnk2n" Jul 22 02:16:45.264166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263641 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-cnibin\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.264166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263652 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-etc-openvswitch\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.264166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263679 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/056fdfa0-f529-40da-95cc-cb54877585ea-env-overrides\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.264166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263641 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-system-cni-dir\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.264166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263731 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret\") pod \"global-pull-secret-syncer-5x227\" (UID: \"00c60860-7a47-4782-9bc3-35d8a634cd22\") " pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:45.264166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263764 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.264166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263816 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.264166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263845 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/239e8e5b-5922-4d4c-a37b-100c6f0078c4-host-slash\") pod \"iptables-alerter-rwn4x\" (UID: \"239e8e5b-5922-4d4c-a37b-100c6f0078c4\") " pod="openshift-network-operator/iptables-alerter-rwn4x" Jul 22 02:16:45.264166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263871 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-var-lib-kubelet\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.264166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-var-lib-cni-bin\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.264166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263932 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-var-lib-cni-multus\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.264166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.263983 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c42e8544-729e-4248-a570-b30816bd8b23-multus-daemon-config\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.264166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.264011 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-systemd\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.264166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.264042 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-run-k8s-cni-cncf-io\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.264166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.264064 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-etc-kubernetes\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.265114 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.264133 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-socket-dir\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.265114 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.264147 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-sysctl-conf\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.265114 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.264158 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-var-lib-openvswitch\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.265114 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.264337 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-node-log\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.265114 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.264363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/056fdfa0-f529-40da-95cc-cb54877585ea-ovnkube-script-lib\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.265114 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.264381 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.265114 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.264463 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-run\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.265114 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.264386 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-run\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.265114 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.264498 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-systemd\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.265114 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.264526 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.265114 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.264527 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-sysctl-d\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.265114 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.264703 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-run-ovn\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.265653 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.264747 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6cx6\" (UniqueName: \"kubernetes.io/projected/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-kube-api-access-k6cx6\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.266027 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.266004 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d702e61a-96f1-4db2-bdcc-8301df7cb325-konnectivity-ca\") pod \"konnectivity-agent-hnk2n\" (UID: \"d702e61a-96f1-4db2-bdcc-8301df7cb325\") " pod="kube-system/konnectivity-agent-hnk2n" Jul 22 02:16:45.266577 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.266253 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13620db1-75d1-4148-a52a-bcef93df1676-serviceca\") pod \"node-ca-qmrkw\" (UID: \"13620db1-75d1-4148-a52a-bcef93df1676\") " pod="openshift-image-registry/node-ca-qmrkw" Jul 22 02:16:45.266944 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.266920 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f640819-bb86-4cac-bc28-45d32be254da-tmp\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.267376 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.267334 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/239e8e5b-5922-4d4c-a37b-100c6f0078c4-host-slash\") pod \"iptables-alerter-rwn4x\" (UID: \"239e8e5b-5922-4d4c-a37b-100c6f0078c4\") " pod="openshift-network-operator/iptables-alerter-rwn4x" Jul 22 02:16:45.267558 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.267532 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.267610 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.267537 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-var-lib-kubelet\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.267914 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.267894 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-sysctl-d\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.269460 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.268235 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs\") pod \"network-metrics-daemon-kfkc8\" (UID: \"9d672470-60f6-4b81-b905-187af05f5b29\") " pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:16:45.269460 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.268293 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-os-release\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.269460 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.268353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-multus-conf-dir\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.269460 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.268387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-device-dir\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.269460 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.268421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fb28c76-bbb2-4d94-ae75-98525afea6dc-hosts-file\") pod \"node-resolver-wm4hz\" (UID: \"0fb28c76-bbb2-4d94-ae75-98525afea6dc\") " pod="openshift-dns/node-resolver-wm4hz" Jul 22 02:16:45.269460 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.268542 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-cni-bin\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.269460 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.268585 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2xgs\" (UniqueName: \"kubernetes.io/projected/056fdfa0-f529-40da-95cc-cb54877585ea-kube-api-access-v2xgs\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.269460 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.268612 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-hostroot\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.269460 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.268645 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-systemd-units\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.269460 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.268667 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d702e61a-96f1-4db2-bdcc-8301df7cb325-agent-certs\") pod \"konnectivity-agent-hnk2n\" (UID: \"d702e61a-96f1-4db2-bdcc-8301df7cb325\") " pod="kube-system/konnectivity-agent-hnk2n" Jul 22 02:16:45.269460 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.268689 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-log-socket\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.269460 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.268733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/056fdfa0-f529-40da-95cc-cb54877585ea-ovnkube-config\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.269460 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.268808 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2vnq\" (UniqueName: \"kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq\") pod \"network-check-target-dkjcx\" (UID: \"dbc1cdb0-18c6-4606-8e83-27396ad3388e\") " pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:16:45.269460 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.268882 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-os-release\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.269460 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.268903 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:45.269460 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.268953 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.269460 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.269006 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-modprobe-d\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.270410 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.269045 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-multus-cni-dir\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.270410 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.269082 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs podName:9d672470-60f6-4b81-b905-187af05f5b29 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:45.769045571 +0000 UTC m=+2.020607066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs") pod "network-metrics-daemon-kfkc8" (UID: "9d672470-60f6-4b81-b905-187af05f5b29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:45.270410 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.269181 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-os-release\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.270410 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.269328 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-etc-modprobe-d\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.270410 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.269418 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-multus-socket-dir-parent\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.270410 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.269464 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwfcd\" (UniqueName: \"kubernetes.io/projected/0fb28c76-bbb2-4d94-ae75-98525afea6dc-kube-api-access-xwfcd\") pod \"node-resolver-wm4hz\" (UID: \"0fb28c76-bbb2-4d94-ae75-98525afea6dc\") " pod="openshift-dns/node-resolver-wm4hz" Jul 22 02:16:45.270410 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.269525 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-kubelet\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.270410 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.269597 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-cni-netd\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.270410 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.269628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntkrc\" (UniqueName: \"kubernetes.io/projected/13620db1-75d1-4148-a52a-bcef93df1676-kube-api-access-ntkrc\") pod \"node-ca-qmrkw\" (UID: \"13620db1-75d1-4148-a52a-bcef93df1676\") " pod="openshift-image-registry/node-ca-qmrkw" Jul 22 02:16:45.270410 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.269680 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f640819-bb86-4cac-bc28-45d32be254da-etc-tuned\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.270410 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.269799 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.270410 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.269969 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-cnibin\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.270410 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.270073 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00c60860-7a47-4782-9bc3-35d8a634cd22-kubelet-config\") pod \"global-pull-secret-syncer-5x227\" (UID: \"00c60860-7a47-4782-9bc3-35d8a634cd22\") " pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:45.270410 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.270133 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-registration-dir\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.270410 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.270256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fb28c76-bbb2-4d94-ae75-98525afea6dc-tmp-dir\") pod \"node-resolver-wm4hz\" (UID: \"0fb28c76-bbb2-4d94-ae75-98525afea6dc\") " pod="openshift-dns/node-resolver-wm4hz" Jul 22 02:16:45.270410 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.270287 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.271170 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.270356 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-lib-modules\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.271170 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.270393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-host\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.271170 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.270511 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-lib-modules\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.271170 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.270554 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-system-cni-dir\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.271170 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.270750 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-var-lib-kubelet\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.271170 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.270824 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-kubelet-dir\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.271170 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.270863 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13620db1-75d1-4148-a52a-bcef93df1676-host\") pod \"node-ca-qmrkw\" (UID: \"13620db1-75d1-4148-a52a-bcef93df1676\") " pod="openshift-image-registry/node-ca-qmrkw" Jul 22 02:16:45.271170 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.270962 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/239e8e5b-5922-4d4c-a37b-100c6f0078c4-iptables-alerter-script\") pod \"iptables-alerter-rwn4x\" (UID: \"239e8e5b-5922-4d4c-a37b-100c6f0078c4\") " pod="openshift-network-operator/iptables-alerter-rwn4x" Jul 22 02:16:45.271170 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.271043 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-run-netns\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.271593 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.271427 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13620db1-75d1-4148-a52a-bcef93df1676-host\") pod \"node-ca-qmrkw\" (UID: \"13620db1-75d1-4148-a52a-bcef93df1676\") " pod="openshift-image-registry/node-ca-qmrkw" Jul 22 02:16:45.271593 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.271558 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/239e8e5b-5922-4d4c-a37b-100c6f0078c4-iptables-alerter-script\") pod \"iptables-alerter-rwn4x\" (UID: \"239e8e5b-5922-4d4c-a37b-100c6f0078c4\") " pod="openshift-network-operator/iptables-alerter-rwn4x" Jul 22 02:16:45.271664 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.271639 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f640819-bb86-4cac-bc28-45d32be254da-host\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.272416 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.272394 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f640819-bb86-4cac-bc28-45d32be254da-etc-tuned\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.272621 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.272587 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rccm9\" (UniqueName: \"kubernetes.io/projected/9d672470-60f6-4b81-b905-187af05f5b29-kube-api-access-rccm9\") pod \"network-metrics-daemon-kfkc8\" (UID: \"9d672470-60f6-4b81-b905-187af05f5b29\") " pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:16:45.272680 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.272626 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r2wh\" (UniqueName: \"kubernetes.io/projected/8f640819-bb86-4cac-bc28-45d32be254da-kube-api-access-8r2wh\") pod \"tuned-bwsh4\" (UID: \"8f640819-bb86-4cac-bc28-45d32be254da\") " pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.273530 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.273512 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mcp5\" (UniqueName: \"kubernetes.io/projected/239e8e5b-5922-4d4c-a37b-100c6f0078c4-kube-api-access-8mcp5\") pod \"iptables-alerter-rwn4x\" (UID: \"239e8e5b-5922-4d4c-a37b-100c6f0078c4\") " pod="openshift-network-operator/iptables-alerter-rwn4x" Jul 22 02:16:45.275919 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.275897 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6cx6\" (UniqueName: \"kubernetes.io/projected/88c4dd7c-e350-4b18-b811-580ceb2f0e3a-kube-api-access-k6cx6\") pod \"multus-additional-cni-plugins-h9hdr\" (UID: \"88c4dd7c-e350-4b18-b811-580ceb2f0e3a\") " pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.278309 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.278291 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntkrc\" (UniqueName: \"kubernetes.io/projected/13620db1-75d1-4148-a52a-bcef93df1676-kube-api-access-ntkrc\") pod \"node-ca-qmrkw\" (UID: \"13620db1-75d1-4148-a52a-bcef93df1676\") " pod="openshift-image-registry/node-ca-qmrkw" Jul 22 02:16:45.372610 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.372566 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzj5q\" (UniqueName: \"kubernetes.io/projected/c42e8544-729e-4248-a570-b30816bd8b23-kube-api-access-vzj5q\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.372610 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.372612 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-etc-openvswitch\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.372610 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.372630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/056fdfa0-f529-40da-95cc-cb54877585ea-env-overrides\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.372942 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.372654 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret\") pod \"global-pull-secret-syncer-5x227\" (UID: \"00c60860-7a47-4782-9bc3-35d8a634cd22\") " pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:45.372942 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.372693 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-etc-openvswitch\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.372942 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.372682 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-var-lib-cni-bin\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.372942 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.372740 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-var-lib-cni-bin\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.372942 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.372755 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-var-lib-cni-multus\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.372942 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.372802 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c42e8544-729e-4248-a570-b30816bd8b23-multus-daemon-config\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.372942 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.372830 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-run-k8s-cni-cncf-io\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.372942 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.372845 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:45.372942 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.372872 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-run-k8s-cni-cncf-io\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.372942 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.372878 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-etc-kubernetes\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.372942 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.372911 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret podName:00c60860-7a47-4782-9bc3-35d8a634cd22 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:45.872892876 +0000 UTC m=+2.124454356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret") pod "global-pull-secret-syncer-5x227" (UID: "00c60860-7a47-4782-9bc3-35d8a634cd22") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:45.372942 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.372921 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-var-lib-cni-multus\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.372942 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.372934 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-etc-kubernetes\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.372942 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.372932 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-socket-dir\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.372981 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-var-lib-openvswitch\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373008 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-node-log\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373033 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/056fdfa0-f529-40da-95cc-cb54877585ea-ovnkube-script-lib\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373064 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-socket-dir\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373074 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-var-lib-openvswitch\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373079 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-node-log\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373100 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-run-ovn\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-os-release\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373155 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-multus-conf-dir\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373178 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-device-dir\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fb28c76-bbb2-4d94-ae75-98525afea6dc-hosts-file\") pod \"node-resolver-wm4hz\" (UID: \"0fb28c76-bbb2-4d94-ae75-98525afea6dc\") " pod="openshift-dns/node-resolver-wm4hz" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373165 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-run-ovn\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373213 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-multus-conf-dir\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-cni-bin\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373275 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-cni-bin\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373225 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-os-release\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373283 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/056fdfa0-f529-40da-95cc-cb54877585ea-env-overrides\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.373572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373275 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-device-dir\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373276 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fb28c76-bbb2-4d94-ae75-98525afea6dc-hosts-file\") pod \"node-resolver-wm4hz\" (UID: \"0fb28c76-bbb2-4d94-ae75-98525afea6dc\") " pod="openshift-dns/node-resolver-wm4hz" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373277 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2xgs\" (UniqueName: \"kubernetes.io/projected/056fdfa0-f529-40da-95cc-cb54877585ea-kube-api-access-v2xgs\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373341 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-hostroot\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-systemd-units\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373389 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-log-socket\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373403 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-hostroot\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373413 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/056fdfa0-f529-40da-95cc-cb54877585ea-ovnkube-config\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373422 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-log-socket\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2vnq\" (UniqueName: \"kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq\") pod \"network-check-target-dkjcx\" (UID: \"dbc1cdb0-18c6-4606-8e83-27396ad3388e\") " pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373462 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c42e8544-729e-4248-a570-b30816bd8b23-multus-daemon-config\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373388 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-systemd-units\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-multus-cni-dir\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-multus-socket-dir-parent\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373546 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/056fdfa0-f529-40da-95cc-cb54877585ea-ovnkube-script-lib\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373591 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-multus-socket-dir-parent\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373603 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-multus-cni-dir\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373622 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwfcd\" (UniqueName: \"kubernetes.io/projected/0fb28c76-bbb2-4d94-ae75-98525afea6dc-kube-api-access-xwfcd\") pod \"node-resolver-wm4hz\" (UID: \"0fb28c76-bbb2-4d94-ae75-98525afea6dc\") " pod="openshift-dns/node-resolver-wm4hz" Jul 22 02:16:45.374430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-kubelet\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.375021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373674 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-cni-netd\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.375021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373697 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-cnibin\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.375021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373720 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-kubelet\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.375021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373730 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-cni-netd\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.375021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00c60860-7a47-4782-9bc3-35d8a634cd22-kubelet-config\") pod \"global-pull-secret-syncer-5x227\" (UID: \"00c60860-7a47-4782-9bc3-35d8a634cd22\") " pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:45.375021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373780 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00c60860-7a47-4782-9bc3-35d8a634cd22-kubelet-config\") pod \"global-pull-secret-syncer-5x227\" (UID: \"00c60860-7a47-4782-9bc3-35d8a634cd22\") " pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:45.375021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373793 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-cnibin\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.375021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373834 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-registration-dir\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.375021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373854 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fb28c76-bbb2-4d94-ae75-98525afea6dc-tmp-dir\") pod \"node-resolver-wm4hz\" (UID: \"0fb28c76-bbb2-4d94-ae75-98525afea6dc\") " pod="openshift-dns/node-resolver-wm4hz" Jul 22 02:16:45.375021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373872 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.375021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373882 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/056fdfa0-f529-40da-95cc-cb54877585ea-ovnkube-config\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.375021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373908 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-registration-dir\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.375021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373913 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-system-cni-dir\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.375021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373946 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-var-lib-kubelet\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.375021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373966 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-var-lib-kubelet\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.375021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373945 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-system-cni-dir\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.375021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373962 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-kubelet-dir\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.375546 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.373997 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.375546 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374014 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-run-netns\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.375546 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374028 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-kubelet-dir\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.375546 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374037 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-run-multus-certs\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.375546 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374053 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-run-netns\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.375546 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374054 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00c60860-7a47-4782-9bc3-35d8a634cd22-dbus\") pod \"global-pull-secret-syncer-5x227\" (UID: \"00c60860-7a47-4782-9bc3-35d8a634cd22\") " pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:45.375546 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-etc-selinux\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.375546 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374078 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-run-multus-certs\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.375546 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374094 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00c60860-7a47-4782-9bc3-35d8a634cd22-dbus\") pod \"global-pull-secret-syncer-5x227\" (UID: \"00c60860-7a47-4782-9bc3-35d8a634cd22\") " pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:45.375546 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9l26\" (UniqueName: \"kubernetes.io/projected/6b6addb2-a454-42ff-a2f5-38df9185e169-kube-api-access-l9l26\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.375546 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c42e8544-729e-4248-a570-b30816bd8b23-cni-binary-copy\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.375546 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374154 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-run-netns\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.375546 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374156 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-etc-selinux\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.375546 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374174 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-slash\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.375546 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374193 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fb28c76-bbb2-4d94-ae75-98525afea6dc-tmp-dir\") pod \"node-resolver-wm4hz\" (UID: \"0fb28c76-bbb2-4d94-ae75-98525afea6dc\") " pod="openshift-dns/node-resolver-wm4hz" Jul 22 02:16:45.375546 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374208 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-slash\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.375546 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374210 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c42e8544-729e-4248-a570-b30816bd8b23-host-run-netns\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.376078 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374224 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-run-systemd\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.376078 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374242 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.376078 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374255 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-run-systemd\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.376078 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/056fdfa0-f529-40da-95cc-cb54877585ea-ovn-node-metrics-cert\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.376078 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-sys-fs\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.376078 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374301 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.376078 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374328 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-run-openvswitch\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.376078 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374368 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/056fdfa0-f529-40da-95cc-cb54877585ea-run-openvswitch\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.376078 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374359 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6b6addb2-a454-42ff-a2f5-38df9185e169-sys-fs\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.376078 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.374627 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c42e8544-729e-4248-a570-b30816bd8b23-cni-binary-copy\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.376557 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.376534 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/056fdfa0-f529-40da-95cc-cb54877585ea-ovn-node-metrics-cert\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.386306 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.386278 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwfcd\" (UniqueName: \"kubernetes.io/projected/0fb28c76-bbb2-4d94-ae75-98525afea6dc-kube-api-access-xwfcd\") pod \"node-resolver-wm4hz\" (UID: \"0fb28c76-bbb2-4d94-ae75-98525afea6dc\") " pod="openshift-dns/node-resolver-wm4hz" Jul 22 02:16:45.386306 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.386303 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2xgs\" (UniqueName: \"kubernetes.io/projected/056fdfa0-f529-40da-95cc-cb54877585ea-kube-api-access-v2xgs\") pod \"ovnkube-node-nhgq8\" (UID: \"056fdfa0-f529-40da-95cc-cb54877585ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.386511 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.386314 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9l26\" (UniqueName: \"kubernetes.io/projected/6b6addb2-a454-42ff-a2f5-38df9185e169-kube-api-access-l9l26\") pod \"aws-ebs-csi-driver-node-stwvp\" (UID: \"6b6addb2-a454-42ff-a2f5-38df9185e169\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.386511 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.386397 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzj5q\" (UniqueName: \"kubernetes.io/projected/c42e8544-729e-4248-a570-b30816bd8b23-kube-api-access-vzj5q\") pod \"multus-22g6m\" (UID: \"c42e8544-729e-4248-a570-b30816bd8b23\") " pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.387006 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.386988 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:45.387006 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.387008 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:45.387182 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.387018 2579 projected.go:196] Error preparing data for projected volume kube-api-access-k2vnq for pod openshift-network-diagnostics/network-check-target-dkjcx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:45.387182 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.387096 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq podName:dbc1cdb0-18c6-4606-8e83-27396ad3388e nodeName:}" failed. No retries permitted until 2026-07-22 02:16:45.887081041 +0000 UTC m=+2.138642518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k2vnq" (UniqueName: "kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq") pod "network-check-target-dkjcx" (UID: "dbc1cdb0-18c6-4606-8e83-27396ad3388e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:45.411932 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.411902 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:45.482847 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.482778 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qmrkw" Jul 22 02:16:45.497718 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.497698 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h9hdr" Jul 22 02:16:45.515679 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.515648 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rwn4x" Jul 22 02:16:45.520027 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.519997 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hnk2n" Jul 22 02:16:45.536084 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.536055 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" Jul 22 02:16:45.546941 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.546920 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:16:45.551017 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.550997 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-22g6m" Jul 22 02:16:45.588465 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.588437 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" Jul 22 02:16:45.594057 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.594038 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wm4hz" Jul 22 02:16:45.640417 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:45.640379 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3cb116ed8a362c1b5ea2fe16379342.slice/crio-9932f6e4de4949a3ba7f9babeb268749736063055cd844615fb14d564e5c81f9 WatchSource:0}: Error finding container 9932f6e4de4949a3ba7f9babeb268749736063055cd844615fb14d564e5c81f9: Status 404 returned error can't find the container with id 9932f6e4de4949a3ba7f9babeb268749736063055cd844615fb14d564e5c81f9 Jul 22 02:16:45.640804 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:45.640785 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7acaaf55abe01c6e7ca4d2a284040336.slice/crio-b085457a8cba83b78186b23d389637ea8374a8a4ccf76abdd78fc63581eb5bbe WatchSource:0}: Error finding container b085457a8cba83b78186b23d389637ea8374a8a4ccf76abdd78fc63581eb5bbe: Status 404 returned error can't find the container with id b085457a8cba83b78186b23d389637ea8374a8a4ccf76abdd78fc63581eb5bbe Jul 22 02:16:45.645681 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.645654 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 02:16:45.778438 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.778359 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs\") pod \"network-metrics-daemon-kfkc8\" (UID: \"9d672470-60f6-4b81-b905-187af05f5b29\") " pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:16:45.778577 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.778522 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:45.778614 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.778579 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs podName:9d672470-60f6-4b81-b905-187af05f5b29 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:46.778564101 +0000 UTC m=+3.030125579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs") pod "network-metrics-daemon-kfkc8" (UID: "9d672470-60f6-4b81-b905-187af05f5b29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:45.878716 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.878685 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret\") pod \"global-pull-secret-syncer-5x227\" (UID: \"00c60860-7a47-4782-9bc3-35d8a634cd22\") " pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:45.878891 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.878842 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:45.878939 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.878900 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret podName:00c60860-7a47-4782-9bc3-35d8a634cd22 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:46.878885336 +0000 UTC m=+3.130446811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret") pod "global-pull-secret-syncer-5x227" (UID: "00c60860-7a47-4782-9bc3-35d8a634cd22") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:45.979959 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:45.979924 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2vnq\" (UniqueName: \"kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq\") pod \"network-check-target-dkjcx\" (UID: \"dbc1cdb0-18c6-4606-8e83-27396ad3388e\") " pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:16:45.980105 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.980056 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:45.980105 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.980071 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:45.980105 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.980080 2579 projected.go:196] Error preparing data for projected volume kube-api-access-k2vnq for pod openshift-network-diagnostics/network-check-target-dkjcx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:45.980239 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:45.980127 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq podName:dbc1cdb0-18c6-4606-8e83-27396ad3388e nodeName:}" failed. No retries permitted until 2026-07-22 02:16:46.980113665 +0000 UTC m=+3.231675135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k2vnq" (UniqueName: "kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq") pod "network-check-target-dkjcx" (UID: "dbc1cdb0-18c6-4606-8e83-27396ad3388e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:45.985416 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:45.985390 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd702e61a_96f1_4db2_bdcc_8301df7cb325.slice/crio-ff1ebb5a939c78bf72d664eb6494329f5ce1270cc1992573d5c9643cf6bdb38b WatchSource:0}: Error finding container ff1ebb5a939c78bf72d664eb6494329f5ce1270cc1992573d5c9643cf6bdb38b: Status 404 returned error can't find the container with id ff1ebb5a939c78bf72d664eb6494329f5ce1270cc1992573d5c9643cf6bdb38b Jul 22 02:16:46.047057 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:46.047017 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod239e8e5b_5922_4d4c_a37b_100c6f0078c4.slice/crio-0f88998a6a2eaed1cae78458aa2313dac9ede8359d4d387230a3b75e3a6d95fb WatchSource:0}: Error finding container 0f88998a6a2eaed1cae78458aa2313dac9ede8359d4d387230a3b75e3a6d95fb: Status 404 returned error can't find the container with id 0f88998a6a2eaed1cae78458aa2313dac9ede8359d4d387230a3b75e3a6d95fb Jul 22 02:16:46.078273 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:46.078247 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c4dd7c_e350_4b18_b811_580ceb2f0e3a.slice/crio-0ad7e6b76e70b0cbfe7460e4c5bec38d73786e02a7419a8da41d9bc7ec67fcb8 WatchSource:0}: Error finding container 0ad7e6b76e70b0cbfe7460e4c5bec38d73786e02a7419a8da41d9bc7ec67fcb8: Status 404 returned error can't find the container with id 0ad7e6b76e70b0cbfe7460e4c5bec38d73786e02a7419a8da41d9bc7ec67fcb8 Jul 22 02:16:46.204608 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:46.204560 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 02:11:45 +0000 UTC" deadline="2028-01-20 01:13:24.666957112 +0000 UTC" Jul 22 02:16:46.204608 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:46.204597 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13126h56m38.462364401s" Jul 22 02:16:46.249953 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:46.249917 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6addb2_a454_42ff_a2f5_38df9185e169.slice/crio-91d4d9b4bef85f2d9faaa8028a740cd72318601afc814e57a18b52131c86ba67 WatchSource:0}: Error finding container 91d4d9b4bef85f2d9faaa8028a740cd72318601afc814e57a18b52131c86ba67: Status 404 returned error can't find the container with id 91d4d9b4bef85f2d9faaa8028a740cd72318601afc814e57a18b52131c86ba67 Jul 22 02:16:46.295762 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:46.295686 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f640819_bb86_4cac_bc28_45d32be254da.slice/crio-58d67953909827ddb1ae382b84c5382be727177197f56e166ae3e2eea25d938b WatchSource:0}: Error finding container 58d67953909827ddb1ae382b84c5382be727177197f56e166ae3e2eea25d938b: Status 404 returned error can't find the container with id 58d67953909827ddb1ae382b84c5382be727177197f56e166ae3e2eea25d938b Jul 22 02:16:46.328067 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:46.328037 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:46.347259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:46.347197 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" event={"ID":"6b6addb2-a454-42ff-a2f5-38df9185e169","Type":"ContainerStarted","Data":"91d4d9b4bef85f2d9faaa8028a740cd72318601afc814e57a18b52131c86ba67"} Jul 22 02:16:46.349062 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:46.349029 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qmrkw" event={"ID":"13620db1-75d1-4148-a52a-bcef93df1676","Type":"ContainerStarted","Data":"3b1df80d846d6989c068f7461aff6ea4fd0722efeee7c958dcdc8b2732cffb83"} Jul 22 02:16:46.351269 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:46.351045 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wm4hz" event={"ID":"0fb28c76-bbb2-4d94-ae75-98525afea6dc","Type":"ContainerStarted","Data":"4b149534ef2e0bd64096403f0fed9f0b05afed916d56306bb8e9a8ecf57db288"} Jul 22 02:16:46.352887 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:46.352840 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9hdr" event={"ID":"88c4dd7c-e350-4b18-b811-580ceb2f0e3a","Type":"ContainerStarted","Data":"0ad7e6b76e70b0cbfe7460e4c5bec38d73786e02a7419a8da41d9bc7ec67fcb8"} Jul 22 02:16:46.354906 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:46.354534 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hnk2n" event={"ID":"d702e61a-96f1-4db2-bdcc-8301df7cb325","Type":"ContainerStarted","Data":"ff1ebb5a939c78bf72d664eb6494329f5ce1270cc1992573d5c9643cf6bdb38b"} Jul 22 02:16:46.356005 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:46.355979 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal" event={"ID":"7acaaf55abe01c6e7ca4d2a284040336","Type":"ContainerStarted","Data":"b085457a8cba83b78186b23d389637ea8374a8a4ccf76abdd78fc63581eb5bbe"} Jul 22 02:16:46.357582 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:46.357546 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-37.ec2.internal" event={"ID":"cb3cb116ed8a362c1b5ea2fe16379342","Type":"ContainerStarted","Data":"9932f6e4de4949a3ba7f9babeb268749736063055cd844615fb14d564e5c81f9"} Jul 22 02:16:46.361889 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:46.360625 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" event={"ID":"8f640819-bb86-4cac-bc28-45d32be254da","Type":"ContainerStarted","Data":"58d67953909827ddb1ae382b84c5382be727177197f56e166ae3e2eea25d938b"} Jul 22 02:16:46.362926 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:16:46.362876 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc42e8544_729e_4248_a570_b30816bd8b23.slice/crio-6400b1fa6e3bb8a8c81f7b54528ea54d03ca1bc498847cd47bb90e3907acc3b7 WatchSource:0}: Error finding container 6400b1fa6e3bb8a8c81f7b54528ea54d03ca1bc498847cd47bb90e3907acc3b7: Status 404 returned error can't find the container with id 6400b1fa6e3bb8a8c81f7b54528ea54d03ca1bc498847cd47bb90e3907acc3b7 Jul 22 02:16:46.366332 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:46.366308 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" event={"ID":"056fdfa0-f529-40da-95cc-cb54877585ea","Type":"ContainerStarted","Data":"ee6ca59d09c3a72273c9ea3ead0b1c7a7d284c945f2f21251655d4b86b93de17"} Jul 22 02:16:46.369715 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:46.369632 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rwn4x" event={"ID":"239e8e5b-5922-4d4c-a37b-100c6f0078c4","Type":"ContainerStarted","Data":"0f88998a6a2eaed1cae78458aa2313dac9ede8359d4d387230a3b75e3a6d95fb"} Jul 22 02:16:46.736711 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:46.736594 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:46.787365 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:46.787327 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs\") pod \"network-metrics-daemon-kfkc8\" (UID: \"9d672470-60f6-4b81-b905-187af05f5b29\") " pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:16:46.787552 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:46.787503 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:46.787619 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:46.787574 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs podName:9d672470-60f6-4b81-b905-187af05f5b29 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:48.787553689 +0000 UTC m=+5.039115179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs") pod "network-metrics-daemon-kfkc8" (UID: "9d672470-60f6-4b81-b905-187af05f5b29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:46.888399 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:46.888296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret\") pod \"global-pull-secret-syncer-5x227\" (UID: \"00c60860-7a47-4782-9bc3-35d8a634cd22\") " pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:46.888594 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:46.888501 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:46.888594 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:46.888588 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret podName:00c60860-7a47-4782-9bc3-35d8a634cd22 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:48.888564614 +0000 UTC m=+5.140126089 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret") pod "global-pull-secret-syncer-5x227" (UID: "00c60860-7a47-4782-9bc3-35d8a634cd22") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:46.989885 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:46.989774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2vnq\" (UniqueName: \"kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq\") pod \"network-check-target-dkjcx\" (UID: \"dbc1cdb0-18c6-4606-8e83-27396ad3388e\") " pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:16:46.990055 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:46.989978 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:46.990055 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:46.990000 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:46.990055 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:46.990015 2579 projected.go:196] Error preparing data for projected volume kube-api-access-k2vnq for pod openshift-network-diagnostics/network-check-target-dkjcx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:46.990232 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:46.990076 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq podName:dbc1cdb0-18c6-4606-8e83-27396ad3388e nodeName:}" failed. No retries permitted until 2026-07-22 02:16:48.990060392 +0000 UTC m=+5.241621864 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k2vnq" (UniqueName: "kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq") pod "network-check-target-dkjcx" (UID: "dbc1cdb0-18c6-4606-8e83-27396ad3388e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:47.205656 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:47.205586 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 02:11:45 +0000 UTC" deadline="2027-12-28 12:50:05.567762229 +0000 UTC" Jul 22 02:16:47.205656 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:47.205648 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12586h33m18.362118149s" Jul 22 02:16:47.341459 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:47.340957 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:16:47.341459 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:47.340954 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:47.341459 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:47.341114 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:16:47.341459 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:47.341116 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:16:47.341459 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:47.341215 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:16:47.341459 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:47.341303 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:16:47.374228 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:47.374148 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-22g6m" event={"ID":"c42e8544-729e-4248-a570-b30816bd8b23","Type":"ContainerStarted","Data":"6400b1fa6e3bb8a8c81f7b54528ea54d03ca1bc498847cd47bb90e3907acc3b7"} Jul 22 02:16:48.803798 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:48.803242 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs\") pod \"network-metrics-daemon-kfkc8\" (UID: \"9d672470-60f6-4b81-b905-187af05f5b29\") " pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:16:48.803798 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:48.803383 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:48.803798 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:48.803449 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs podName:9d672470-60f6-4b81-b905-187af05f5b29 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:52.803430083 +0000 UTC m=+9.054991573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs") pod "network-metrics-daemon-kfkc8" (UID: "9d672470-60f6-4b81-b905-187af05f5b29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:48.904302 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:48.904266 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret\") pod \"global-pull-secret-syncer-5x227\" (UID: \"00c60860-7a47-4782-9bc3-35d8a634cd22\") " pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:48.904483 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:48.904440 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:48.904540 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:48.904514 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret podName:00c60860-7a47-4782-9bc3-35d8a634cd22 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:52.904493834 +0000 UTC m=+9.156055309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret") pod "global-pull-secret-syncer-5x227" (UID: "00c60860-7a47-4782-9bc3-35d8a634cd22") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:49.005526 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:49.004944 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2vnq\" (UniqueName: \"kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq\") pod \"network-check-target-dkjcx\" (UID: \"dbc1cdb0-18c6-4606-8e83-27396ad3388e\") " pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:16:49.005526 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:49.005098 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:49.005526 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:49.005120 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:49.005526 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:49.005135 2579 projected.go:196] Error preparing data for projected volume kube-api-access-k2vnq for pod openshift-network-diagnostics/network-check-target-dkjcx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:49.005526 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:49.005191 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq podName:dbc1cdb0-18c6-4606-8e83-27396ad3388e nodeName:}" failed. No retries permitted until 2026-07-22 02:16:53.00517237 +0000 UTC m=+9.256733861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k2vnq" (UniqueName: "kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq") pod "network-check-target-dkjcx" (UID: "dbc1cdb0-18c6-4606-8e83-27396ad3388e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:49.341843 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:49.341809 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:49.342029 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:49.341949 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:16:49.342337 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:49.342314 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:16:49.342458 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:49.342436 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:16:49.342526 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:49.342496 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:16:49.342611 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:49.342562 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:16:51.341487 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:51.341451 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:51.341971 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:51.341587 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:16:51.342412 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:51.342087 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:16:51.342412 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:51.342196 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:16:51.342412 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:51.342253 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:16:51.342412 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:51.342319 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:16:52.838207 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:52.838126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs\") pod \"network-metrics-daemon-kfkc8\" (UID: \"9d672470-60f6-4b81-b905-187af05f5b29\") " pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:16:52.838652 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:52.838319 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:52.838652 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:52.838394 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs podName:9d672470-60f6-4b81-b905-187af05f5b29 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:00.838373796 +0000 UTC m=+17.089935292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs") pod "network-metrics-daemon-kfkc8" (UID: "9d672470-60f6-4b81-b905-187af05f5b29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:52.939551 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:52.939239 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret\") pod \"global-pull-secret-syncer-5x227\" (UID: \"00c60860-7a47-4782-9bc3-35d8a634cd22\") " pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:52.939551 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:52.939382 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:52.939551 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:52.939443 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret podName:00c60860-7a47-4782-9bc3-35d8a634cd22 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:00.939425721 +0000 UTC m=+17.190987230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret") pod "global-pull-secret-syncer-5x227" (UID: "00c60860-7a47-4782-9bc3-35d8a634cd22") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:53.040332 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:53.040289 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2vnq\" (UniqueName: \"kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq\") pod \"network-check-target-dkjcx\" (UID: \"dbc1cdb0-18c6-4606-8e83-27396ad3388e\") " pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:16:53.040517 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:53.040492 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:53.040587 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:53.040526 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:53.040587 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:53.040539 2579 projected.go:196] Error preparing data for projected volume kube-api-access-k2vnq for pod openshift-network-diagnostics/network-check-target-dkjcx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:53.040689 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:53.040606 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq podName:dbc1cdb0-18c6-4606-8e83-27396ad3388e nodeName:}" failed. No retries permitted until 2026-07-22 02:17:01.040586987 +0000 UTC m=+17.292148465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k2vnq" (UniqueName: "kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq") pod "network-check-target-dkjcx" (UID: "dbc1cdb0-18c6-4606-8e83-27396ad3388e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:53.341470 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:53.340731 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:16:53.341470 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:53.340885 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:16:53.341470 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:53.340947 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:16:53.341470 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:53.341012 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:16:53.341470 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:53.340693 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:53.341470 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:53.341426 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:16:55.341587 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:55.341546 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:55.342057 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:55.341674 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:16:55.342057 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:55.341842 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:16:55.342057 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:55.341675 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:16:55.342057 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:55.341916 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:16:55.342057 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:55.341992 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:16:57.341425 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:57.341394 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:16:57.341425 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:57.341425 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:57.341921 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:57.341509 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:16:57.341921 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:57.341519 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:16:57.341921 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:57.341603 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:16:57.341921 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:57.341665 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:16:59.341457 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:59.341422 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:16:59.341898 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:59.341431 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:16:59.341898 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:59.341550 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:16:59.341898 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:16:59.341563 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:16:59.341898 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:59.341646 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:16:59.341898 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:16:59.341767 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:00.901940 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:00.901904 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs\") pod \"network-metrics-daemon-kfkc8\" (UID: \"9d672470-60f6-4b81-b905-187af05f5b29\") " pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:00.902348 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:00.902073 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:17:00.902348 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:00.902138 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs podName:9d672470-60f6-4b81-b905-187af05f5b29 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:16.902121346 +0000 UTC m=+33.153682817 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs") pod "network-metrics-daemon-kfkc8" (UID: "9d672470-60f6-4b81-b905-187af05f5b29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:17:01.002278 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:01.002246 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret\") pod \"global-pull-secret-syncer-5x227\" (UID: \"00c60860-7a47-4782-9bc3-35d8a634cd22\") " pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:01.002450 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:01.002375 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:17:01.002450 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:01.002440 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret podName:00c60860-7a47-4782-9bc3-35d8a634cd22 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:17.002425155 +0000 UTC m=+33.253986625 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret") pod "global-pull-secret-syncer-5x227" (UID: "00c60860-7a47-4782-9bc3-35d8a634cd22") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:17:01.103012 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:01.102973 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2vnq\" (UniqueName: \"kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq\") pod \"network-check-target-dkjcx\" (UID: \"dbc1cdb0-18c6-4606-8e83-27396ad3388e\") " pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:01.103171 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:01.103129 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:17:01.103171 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:01.103159 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:17:01.103267 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:01.103175 2579 projected.go:196] Error preparing data for projected volume kube-api-access-k2vnq for pod openshift-network-diagnostics/network-check-target-dkjcx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:17:01.103267 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:01.103231 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq podName:dbc1cdb0-18c6-4606-8e83-27396ad3388e nodeName:}" failed. No retries permitted until 2026-07-22 02:17:17.103213829 +0000 UTC m=+33.354775299 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k2vnq" (UniqueName: "kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq") pod "network-check-target-dkjcx" (UID: "dbc1cdb0-18c6-4606-8e83-27396ad3388e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:17:01.341616 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:01.341536 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:01.341784 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:01.341536 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:01.341784 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:01.341666 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:01.341784 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:01.341765 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:01.341931 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:01.341537 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:01.341931 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:01.341881 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:03.341723 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:03.341510 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:03.342134 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:03.341515 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:03.342134 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:03.341516 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:03.342134 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:03.341837 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:03.342134 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:03.341901 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:03.342134 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:03.341983 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:05.341151 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:05.340991 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:05.341597 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:05.341004 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:05.341597 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:05.341035 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:05.341597 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:05.341267 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:05.341597 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:05.341362 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:05.341597 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:05.341414 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:05.409376 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:05.409291 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-37.ec2.internal" event={"ID":"cb3cb116ed8a362c1b5ea2fe16379342","Type":"ContainerStarted","Data":"2703fa08294541b42bb99886af86c112f916989a4368e50daa979818c9dddc0d"} Jul 22 02:17:05.411333 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:05.411282 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" event={"ID":"8f640819-bb86-4cac-bc28-45d32be254da","Type":"ContainerStarted","Data":"af2e3e5d7a9f3374a1992729143ef4d6ef7466af49682ef4341715efa4b507fe"} Jul 22 02:17:05.413878 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:05.413610 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" event={"ID":"056fdfa0-f529-40da-95cc-cb54877585ea","Type":"ContainerStarted","Data":"24b282815a991a0892891fbce0c2c5ecc9aa3f2b2983471b0af24f855c7482df"} Jul 22 02:17:05.414088 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:05.414063 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" event={"ID":"056fdfa0-f529-40da-95cc-cb54877585ea","Type":"ContainerStarted","Data":"b2b04afc7a5def5f8f357aef8b15c0c604d580a40a881df96d0c3624a18bd302"} Jul 22 02:17:05.417075 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:05.416937 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-22g6m" event={"ID":"c42e8544-729e-4248-a570-b30816bd8b23","Type":"ContainerStarted","Data":"3bccae010e8657c6d6b49376dd598d44a2b50c4160eee72293ea163a0b2014b2"} Jul 22 02:17:05.431820 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:05.430881 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-37.ec2.internal" podStartSLOduration=20.430861388 podStartE2EDuration="20.430861388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:05.429776652 +0000 UTC m=+21.681338151" watchObservedRunningTime="2026-07-22 02:17:05.430861388 +0000 UTC m=+21.682422881" Jul 22 02:17:05.459131 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:05.459073 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-22g6m" podStartSLOduration=2.7002358319999997 podStartE2EDuration="21.459046582s" totalImagesPullingTime="18.75881075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:05.457382459 +0000 UTC m=+21.708943953" watchObservedRunningTime="2026-07-22 02:17:05.459046582 +0000 UTC m=+21.710608075" Jul 22 02:17:05.485152 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:05.485097 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bwsh4" podStartSLOduration=2.7434660859999997 podStartE2EDuration="21.485076931s" totalImagesPullingTime="18.741610845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:05.484820769 +0000 UTC m=+21.736382261" watchObservedRunningTime="2026-07-22 02:17:05.485076931 +0000 UTC m=+21.736638423" Jul 22 02:17:06.423205 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.422994 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" event={"ID":"6b6addb2-a454-42ff-a2f5-38df9185e169","Type":"ContainerStarted","Data":"203377b7b162d528275d4ed8f82593b92de3df6ba91ae819355222b0211cafd2"} Jul 22 02:17:06.424371 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.424350 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qmrkw" event={"ID":"13620db1-75d1-4148-a52a-bcef93df1676","Type":"ContainerStarted","Data":"33fe548005dc0ab949c74ceca8ae0d34d70925ee2cc4d9927d008def61243329"} Jul 22 02:17:06.425869 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.425840 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wm4hz" event={"ID":"0fb28c76-bbb2-4d94-ae75-98525afea6dc","Type":"ContainerStarted","Data":"4e3d0f8704a10bfa49d9558a93a5de9f370922341f1282f90143dd4935a96270"} Jul 22 02:17:06.427286 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.427265 2579 generic.go:356] "Generic (PLEG): container finished" podID="88c4dd7c-e350-4b18-b811-580ceb2f0e3a" containerID="4966044b94a90f85e76351ecd79554693eceb7ae85ff9dd268d3b71b197a71c7" exitCode=0 Jul 22 02:17:06.427383 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.427329 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9hdr" event={"ID":"88c4dd7c-e350-4b18-b811-580ceb2f0e3a","Type":"ContainerDied","Data":"4966044b94a90f85e76351ecd79554693eceb7ae85ff9dd268d3b71b197a71c7"} Jul 22 02:17:06.428804 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.428778 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hnk2n" event={"ID":"d702e61a-96f1-4db2-bdcc-8301df7cb325","Type":"ContainerStarted","Data":"b083565a291b96810c679961754c2feb8410e04891c1c8e547bdbbf913b7c687"} Jul 22 02:17:06.430280 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.430256 2579 generic.go:356] "Generic (PLEG): container finished" podID="7acaaf55abe01c6e7ca4d2a284040336" containerID="b4ed6318c0f157e82f5221cbe3542085cd759a313602b9e2f0e2fec79d7035ab" exitCode=0 Jul 22 02:17:06.430370 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.430344 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal" event={"ID":"7acaaf55abe01c6e7ca4d2a284040336","Type":"ContainerDied","Data":"b4ed6318c0f157e82f5221cbe3542085cd759a313602b9e2f0e2fec79d7035ab"} Jul 22 02:17:06.433347 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.433330 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" event={"ID":"056fdfa0-f529-40da-95cc-cb54877585ea","Type":"ContainerStarted","Data":"b2891b8de104a15d3ab653cc2654e76e47e588b6d3ed4a2365ccc4be7711ed8f"} Jul 22 02:17:06.433432 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.433392 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" event={"ID":"056fdfa0-f529-40da-95cc-cb54877585ea","Type":"ContainerStarted","Data":"4da5ff955cca731aaba9b6da3bcdfc4d62eba7e2fc52c3ed037dfe15acea40c5"} Jul 22 02:17:06.433480 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.433441 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" event={"ID":"056fdfa0-f529-40da-95cc-cb54877585ea","Type":"ContainerStarted","Data":"8a7b09f8cd86b6af2a73f498068f52fc1ff5861ea54c9eb0f00f8e9fa0ab7616"} Jul 22 02:17:06.433521 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.433488 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" event={"ID":"056fdfa0-f529-40da-95cc-cb54877585ea","Type":"ContainerStarted","Data":"318242ab9113b44ef1fb935f98b02d2787fec14b2cf5a895ad1261c50352abf5"} Jul 22 02:17:06.434852 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.434828 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rwn4x" event={"ID":"239e8e5b-5922-4d4c-a37b-100c6f0078c4","Type":"ContainerStarted","Data":"8d949917b2b3d8e6fd4e877b8a351a55c488a94eed9f9d558bd89f549dcfede3"} Jul 22 02:17:06.446971 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.446939 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qmrkw" podStartSLOduration=3.647596167 podStartE2EDuration="22.446927184s" totalImagesPullingTime="18.799331017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:06.445721169 +0000 UTC m=+22.697282672" watchObservedRunningTime="2026-07-22 02:17:06.446927184 +0000 UTC m=+22.698488672" Jul 22 02:17:06.533174 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.533125 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rwn4x" podStartSLOduration=3.538709556 podStartE2EDuration="22.533108416s" totalImagesPullingTime="18.99439886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:06.532946678 +0000 UTC m=+22.784508170" watchObservedRunningTime="2026-07-22 02:17:06.533108416 +0000 UTC m=+22.784669908" Jul 22 02:17:06.551785 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.551724 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hnk2n" podStartSLOduration=12.70882745 podStartE2EDuration="22.551708502s" totalImagesPullingTime="9.842881052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:06.551246798 +0000 UTC m=+22.802808291" watchObservedRunningTime="2026-07-22 02:17:06.551708502 +0000 UTC m=+22.803269991" Jul 22 02:17:06.639528 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.639493 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:06.716467 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.716442 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:06.726954 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.726928 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 02:17:06.818362 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.818329 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:06.960950 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:06.960871 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:07.062417 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:07.062383 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:07.232555 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:07.232371 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T02:17:06.726950288Z","UUID":"6927baf3-7557-47e9-a9f9-72841f0ad92c","Handler":null,"Name":"","Endpoint":""} Jul 22 02:17:07.233922 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:07.233895 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 02:17:07.234037 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:07.233929 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 02:17:07.235166 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:07.235148 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wm4hz_0fb28c76-bbb2-4d94-ae75-98525afea6dc/dns-node-resolver/0.log" Jul 22 02:17:07.243905 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:07.243883 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:07.340883 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:07.340854 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:07.341123 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:07.340893 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:07.341123 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:07.340854 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:07.341123 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:07.340996 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:07.341123 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:07.341087 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:07.341339 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:07.341144 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:07.345711 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:07.345686 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:07.439891 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:07.439818 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" event={"ID":"6b6addb2-a454-42ff-a2f5-38df9185e169","Type":"ContainerStarted","Data":"7aefe1fc331215ee205cd56c43327541c6a5967cc28f01caab78cad1d54445ca"} Jul 22 02:17:07.443472 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:07.443396 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal" event={"ID":"7acaaf55abe01c6e7ca4d2a284040336","Type":"ContainerStarted","Data":"ba75a08e8db26f36e90fc869e6425cd408407047f80ec2263794400b632ac465"} Jul 22 02:17:07.462798 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:07.462637 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wm4hz" podStartSLOduration=4.6262495470000005 podStartE2EDuration="23.462619076s" totalImagesPullingTime="18.836369529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:06.575620405 +0000 UTC m=+22.827181897" watchObservedRunningTime="2026-07-22 02:17:07.462619076 +0000 UTC m=+23.714180569" Jul 22 02:17:07.462942 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:07.462814 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-37.ec2.internal" podStartSLOduration=22.462802627 podStartE2EDuration="22.462802627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:07.462684406 +0000 UTC m=+23.714245898" watchObservedRunningTime="2026-07-22 02:17:07.462802627 +0000 UTC m=+23.714364117" Jul 22 02:17:07.558277 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:07.558237 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:07.660802 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:07.660773 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:08.229857 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:08.229790 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qmrkw_13620db1-75d1-4148-a52a-bcef93df1676/node-ca/0.log" Jul 22 02:17:08.448634 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:08.448599 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" event={"ID":"6b6addb2-a454-42ff-a2f5-38df9185e169","Type":"ContainerStarted","Data":"9af5a5ba693061eafc9e5af951d8ec32688157c3c9eda459251ff7ce1bbf569a"} Jul 22 02:17:08.452444 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:08.452386 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" event={"ID":"056fdfa0-f529-40da-95cc-cb54877585ea","Type":"ContainerStarted","Data":"a1889c0667ddc17682a9716f18fef488be5657550f26bf64da7c10d22e6662da"} Jul 22 02:17:08.467688 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:08.467635 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-stwvp" podStartSLOduration=3.051221895 podStartE2EDuration="24.46761455s" totalImagesPullingTime="21.416392655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:08.466348397 +0000 UTC m=+24.717909883" watchObservedRunningTime="2026-07-22 02:17:08.46761455 +0000 UTC m=+24.719176045" Jul 22 02:17:08.907621 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:08.907589 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:08.972384 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:08.972354 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:09.341114 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:09.341081 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:09.341114 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:09.341101 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:09.341338 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:09.341190 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:09.341338 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:09.341204 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:09.341338 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:09.341318 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:09.341480 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:09.341407 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:10.036593 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:10.036561 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:10.664295 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:10.664053 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:10.765412 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:10.765384 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:10.906470 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:10.906440 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:11.006686 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.006610 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:11.104381 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.104352 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:11.276965 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.276889 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hnk2n" Jul 22 02:17:11.277494 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.277474 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hnk2n" Jul 22 02:17:11.320787 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.320744 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:11.340765 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.340733 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:11.340765 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.340744 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:11.340867 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:11.340827 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:11.340867 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.340844 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:11.340948 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:11.340929 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:11.341016 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:11.340998 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:11.382530 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.382505 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:11.460919 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.460896 2579 generic.go:356] "Generic (PLEG): container finished" podID="88c4dd7c-e350-4b18-b811-580ceb2f0e3a" containerID="14d3457b836ff33e55ca28dc3b501e01922c1efa12023d55c4847fa977d36da7" exitCode=0 Jul 22 02:17:11.461019 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.460927 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9hdr" event={"ID":"88c4dd7c-e350-4b18-b811-580ceb2f0e3a","Type":"ContainerDied","Data":"14d3457b836ff33e55ca28dc3b501e01922c1efa12023d55c4847fa977d36da7"} Jul 22 02:17:11.464698 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.464676 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" event={"ID":"056fdfa0-f529-40da-95cc-cb54877585ea","Type":"ContainerStarted","Data":"c4f6503fce927f97bb9cc35260f036e21f74ef18204c184ecf39807470e0d467"} Jul 22 02:17:11.464974 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.464912 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hnk2n" Jul 22 02:17:11.464974 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.464966 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:17:11.465090 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.464997 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:17:11.465441 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.465427 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hnk2n" Jul 22 02:17:11.480193 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.480175 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:17:11.523425 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:11.523387 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" podStartSLOduration=8.636721057 podStartE2EDuration="27.523374479s" totalImagesPullingTime="18.886653422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:11.522252851 +0000 UTC m=+27.773814362" watchObservedRunningTime="2026-07-22 02:17:11.523374479 +0000 UTC m=+27.774935970" Jul 22 02:17:12.170703 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:12.170662 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:12.467396 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:12.467236 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:17:12.483950 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:12.483931 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:17:12.594897 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:12.594872 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:12.900940 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:12.900907 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:13.001766 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:13.001732 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:13.341447 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:13.341419 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:13.341849 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:13.341419 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:13.341849 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:13.341515 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:13.341849 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:13.341419 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:13.341849 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:13.341603 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:13.341849 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:13.341651 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:13.378917 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:13.378893 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:13.470558 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:13.470529 2579 generic.go:356] "Generic (PLEG): container finished" podID="88c4dd7c-e350-4b18-b811-580ceb2f0e3a" containerID="f576c54b36101c5052f2301ad4045fab486efcc1ba4cda412aa579f3f36c3c85" exitCode=0 Jul 22 02:17:13.470696 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:13.470599 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9hdr" event={"ID":"88c4dd7c-e350-4b18-b811-580ceb2f0e3a","Type":"ContainerDied","Data":"f576c54b36101c5052f2301ad4045fab486efcc1ba4cda412aa579f3f36c3c85"} Jul 22 02:17:13.796743 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:13.796661 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:13.985235 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:13.985203 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:14.175188 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:14.175156 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:14.376035 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:14.376005 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:14.474717 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:14.474681 2579 generic.go:356] "Generic (PLEG): container finished" podID="88c4dd7c-e350-4b18-b811-580ceb2f0e3a" containerID="59ebd92f7e54a0567055383e4563a9117f3914e93ef9276c9dad486f9b69ed05" exitCode=0 Jul 22 02:17:14.474889 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:14.474779 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9hdr" event={"ID":"88c4dd7c-e350-4b18-b811-580ceb2f0e3a","Type":"ContainerDied","Data":"59ebd92f7e54a0567055383e4563a9117f3914e93ef9276c9dad486f9b69ed05"} Jul 22 02:17:14.785419 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:14.785308 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:15.307471 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:15.307425 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:15.341385 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:15.341353 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:15.341566 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:15.341396 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:15.341566 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:15.341462 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:15.341566 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:15.341475 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:15.341566 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:15.341532 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:15.341793 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:15.341644 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:15.400235 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:15.400202 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:15.501240 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:15.501194 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:15.779057 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:15.778959 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:15.980158 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:15.980123 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:16.068060 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:16.068022 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:16.383099 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:16.383002 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:16.918773 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:16.918724 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs\") pod \"network-metrics-daemon-kfkc8\" (UID: \"9d672470-60f6-4b81-b905-187af05f5b29\") " pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:16.919175 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:16.918886 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:17:16.919175 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:16.918947 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs podName:9d672470-60f6-4b81-b905-187af05f5b29 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:48.918932877 +0000 UTC m=+65.170494347 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs") pod "network-metrics-daemon-kfkc8" (UID: "9d672470-60f6-4b81-b905-187af05f5b29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:17:16.974199 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:16.974166 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:17.020165 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:17.020139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret\") pod \"global-pull-secret-syncer-5x227\" (UID: \"00c60860-7a47-4782-9bc3-35d8a634cd22\") " pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:17.020358 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:17.020239 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:17:17.020358 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:17.020304 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret podName:00c60860-7a47-4782-9bc3-35d8a634cd22 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:49.020285516 +0000 UTC m=+65.271846986 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret") pod "global-pull-secret-syncer-5x227" (UID: "00c60860-7a47-4782-9bc3-35d8a634cd22") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:17:17.121002 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:17.120962 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2vnq\" (UniqueName: \"kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq\") pod \"network-check-target-dkjcx\" (UID: \"dbc1cdb0-18c6-4606-8e83-27396ad3388e\") " pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:17.121173 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:17.121125 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:17:17.121173 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:17.121147 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:17:17.121173 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:17.121162 2579 projected.go:196] Error preparing data for projected volume kube-api-access-k2vnq for pod openshift-network-diagnostics/network-check-target-dkjcx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:17:17.121331 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:17.121230 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq podName:dbc1cdb0-18c6-4606-8e83-27396ad3388e nodeName:}" failed. No retries permitted until 2026-07-22 02:17:49.121210474 +0000 UTC m=+65.372771950 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k2vnq" (UniqueName: "kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq") pod "network-check-target-dkjcx" (UID: "dbc1cdb0-18c6-4606-8e83-27396ad3388e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:17:17.256904 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:17.256825 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:17.341323 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:17.341287 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:17.341323 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:17.341320 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:17.341538 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:17.341320 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:17.341538 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:17.341415 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:17.341538 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:17.341510 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:17.341690 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:17.341596 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:17.429604 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:17.429566 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:17.530576 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:17.530493 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:17.598992 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:17.598960 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:17.685745 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:17.685709 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:17.793363 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:17.793274 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:17.979769 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:17.979724 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:18.080351 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:18.080322 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:18.181190 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:18.181160 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:18.378930 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:18.378832 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:18.478781 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:18.478736 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:18.580253 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:18.580220 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:18.849589 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:18.849556 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:18.907924 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:18.907888 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:19.172370 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:19.172335 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:19.291479 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:19.291440 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:19.340841 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:19.340810 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:19.340841 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:19.340844 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:19.341032 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:19.340916 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:19.341032 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:19.340971 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:19.341132 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:19.341041 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:19.341186 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:19.341140 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:19.392132 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:19.392104 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:19.489007 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:19.488922 2579 generic.go:356] "Generic (PLEG): container finished" podID="88c4dd7c-e350-4b18-b811-580ceb2f0e3a" containerID="299ff69aa294fa594f563ec4ce99cd0dd5475686c1e5cb63dde7755ca5687afd" exitCode=0 Jul 22 02:17:19.489173 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:19.489001 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9hdr" event={"ID":"88c4dd7c-e350-4b18-b811-580ceb2f0e3a","Type":"ContainerDied","Data":"299ff69aa294fa594f563ec4ce99cd0dd5475686c1e5cb63dde7755ca5687afd"} Jul 22 02:17:19.587437 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:19.587411 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:19.777433 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:19.777352 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:19.973648 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:19.973614 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:20.092314 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:20.092289 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:20.193044 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:20.193015 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:20.253200 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:20.253167 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:20.494209 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:20.494131 2579 generic.go:356] "Generic (PLEG): container finished" podID="88c4dd7c-e350-4b18-b811-580ceb2f0e3a" containerID="97a9603efa089677dd801bcd57ee7394930be56a83900a07f485e8390d6b2960" exitCode=0 Jul 22 02:17:20.494209 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:20.494184 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9hdr" event={"ID":"88c4dd7c-e350-4b18-b811-580ceb2f0e3a","Type":"ContainerDied","Data":"97a9603efa089677dd801bcd57ee7394930be56a83900a07f485e8390d6b2960"} Jul 22 02:17:20.847538 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:20.847508 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:20.947862 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:20.947830 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:21.180984 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:21.180907 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:21.341443 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:21.341415 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:21.341838 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:21.341478 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:21.341838 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:21.341480 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:21.341838 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:21.341551 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:21.341838 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:21.341602 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:21.341838 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:21.341676 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:21.374765 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:21.374713 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:21.499286 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:21.499202 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9hdr" event={"ID":"88c4dd7c-e350-4b18-b811-580ceb2f0e3a","Type":"ContainerStarted","Data":"7ed67b323992f937abaf589b43a90872cc922999a5844b7c4980dae49d63098d"} Jul 22 02:17:21.520804 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:21.520763 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h9hdr" podStartSLOduration=8.370429566 podStartE2EDuration="37.520733427s" totalImagesPullingTime="29.150303861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:21.520343051 +0000 UTC m=+37.771904554" watchObservedRunningTime="2026-07-22 02:17:21.520733427 +0000 UTC m=+37.772294918" Jul 22 02:17:21.576579 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:21.576545 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:21.777702 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:21.777624 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:23.340951 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:23.340921 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:23.341304 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:23.341036 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:23.341304 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:23.341060 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:23.341304 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:23.341038 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:23.341304 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:23.341137 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:23.341304 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:23.341200 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:25.340872 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:25.340835 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:25.341338 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:25.340835 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:25.341338 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:25.340980 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:25.341338 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:25.340835 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:25.341338 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:25.341016 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:25.341338 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:25.341088 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:25.503922 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:25.503884 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:25.565566 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:25.565530 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:27.340655 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:27.340620 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:27.341129 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:27.340726 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:27.341129 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:27.340729 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:27.341129 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:27.340867 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:27.341129 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:27.340894 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:27.341129 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:27.340955 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:29.101577 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:29.101546 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:29.158039 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:29.158014 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:29.341024 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:29.340996 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:29.341190 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:29.341091 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:29.341190 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:29.341103 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:29.341190 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:29.341116 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:29.341190 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:29.341173 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:29.341391 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:29.341237 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:30.118378 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:30.118344 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:30.215216 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:30.215182 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:30.310839 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:30.310807 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:30.414786 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:30.414686 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:31.003936 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:31.003904 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:31.099929 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:31.099900 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:31.341518 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:31.341481 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:31.341518 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:31.341502 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:31.341940 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:31.341509 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:31.341940 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:31.341618 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:31.341940 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:31.341720 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:31.341940 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:31.341803 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:31.649694 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:31.649380 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kfkc8"] Jul 22 02:17:31.649867 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:31.649732 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:31.649934 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:31.649877 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:31.650125 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:31.650107 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5x227"] Jul 22 02:17:31.650208 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:31.650187 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:31.650302 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:31.650281 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:31.652048 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:31.652027 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dkjcx"] Jul 22 02:17:31.652149 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:31.652092 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:31.652186 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:31.652161 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:31.732348 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:31.732317 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:31.873671 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:31.873642 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:31.936258 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:31.936194 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:33.302675 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:33.302640 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:33.340910 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:33.340876 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:33.340910 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:33.340899 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:33.341087 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:33.340876 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:33.341087 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:33.341015 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:33.341158 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:33.341137 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:33.341218 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:33.341199 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:33.357709 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:33.357682 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:35.341278 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:35.341249 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:35.341278 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:35.341278 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:35.341948 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:35.341362 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kfkc8" podUID="9d672470-60f6-4b81-b905-187af05f5b29" Jul 22 02:17:35.341948 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:35.341431 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5x227" podUID="00c60860-7a47-4782-9bc3-35d8a634cd22" Jul 22 02:17:35.341948 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:35.341474 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:35.341948 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:35.341542 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkjcx" podUID="dbc1cdb0-18c6-4606-8e83-27396ad3388e" Jul 22 02:17:35.513284 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:35.513255 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:35.582092 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:35.582062 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:36.018363 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.018290 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-37.ec2.internal" event="NodeReady" Jul 22 02:17:36.018500 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.018411 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 02:17:36.064004 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.063975 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-brjtc"] Jul 22 02:17:36.065879 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.065858 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-brjtc" Jul 22 02:17:36.066618 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.066597 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wqfnz"] Jul 22 02:17:36.068233 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.068219 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wqfnz" Jul 22 02:17:36.069295 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.069267 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 02:17:36.069600 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.069577 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 02:17:36.069784 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.069767 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-btqc6\"" Jul 22 02:17:36.072724 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.072705 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 02:17:36.072835 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.072799 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 02:17:36.072909 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.072892 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vv7c5\"" Jul 22 02:17:36.072968 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.072935 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 02:17:36.073022 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.073005 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 02:17:36.083139 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.083118 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-brjtc"] Jul 22 02:17:36.083881 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.083865 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wqfnz"] Jul 22 02:17:36.090177 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.090159 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qsw69"] Jul 22 02:17:36.091836 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.091820 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qsw69" Jul 22 02:17:36.094715 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.094686 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9s7nv\"" Jul 22 02:17:36.094808 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.094724 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 02:17:36.094808 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.094746 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 02:17:36.094808 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.094778 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 02:17:36.102140 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.102120 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qsw69"] Jul 22 02:17:36.162172 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.162134 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d8a5fb2-e0a1-469c-9d25-90ae7e60f184-crio-socket\") pod \"insights-runtime-extractor-wqfnz\" (UID: \"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184\") " pod="openshift-insights/insights-runtime-extractor-wqfnz" Jul 22 02:17:36.162315 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.162180 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d8a5fb2-e0a1-469c-9d25-90ae7e60f184-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wqfnz\" (UID: \"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184\") " pod="openshift-insights/insights-runtime-extractor-wqfnz" Jul 22 02:17:36.162315 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.162204 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pqv9\" (UniqueName: \"kubernetes.io/projected/6d8a5fb2-e0a1-469c-9d25-90ae7e60f184-kube-api-access-2pqv9\") pod \"insights-runtime-extractor-wqfnz\" (UID: \"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184\") " pod="openshift-insights/insights-runtime-extractor-wqfnz" Jul 22 02:17:36.162315 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.162220 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l45nf\" (UniqueName: \"kubernetes.io/projected/827dc975-54a6-4e48-a6e2-44d6e1afaf63-kube-api-access-l45nf\") pod \"ingress-canary-qsw69\" (UID: \"827dc975-54a6-4e48-a6e2-44d6e1afaf63\") " pod="openshift-ingress-canary/ingress-canary-qsw69" Jul 22 02:17:36.162315 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.162257 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d8a5fb2-e0a1-469c-9d25-90ae7e60f184-data-volume\") pod \"insights-runtime-extractor-wqfnz\" (UID: \"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184\") " pod="openshift-insights/insights-runtime-extractor-wqfnz" Jul 22 02:17:36.162315 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.162279 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/827dc975-54a6-4e48-a6e2-44d6e1afaf63-cert\") pod \"ingress-canary-qsw69\" (UID: \"827dc975-54a6-4e48-a6e2-44d6e1afaf63\") " pod="openshift-ingress-canary/ingress-canary-qsw69" Jul 22 02:17:36.162315 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.162303 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a39eaba3-240b-488d-a279-ed0c1c8409b5-config-volume\") pod \"dns-default-brjtc\" (UID: \"a39eaba3-240b-488d-a279-ed0c1c8409b5\") " pod="openshift-dns/dns-default-brjtc" Jul 22 02:17:36.162315 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.162317 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a39eaba3-240b-488d-a279-ed0c1c8409b5-metrics-tls\") pod \"dns-default-brjtc\" (UID: \"a39eaba3-240b-488d-a279-ed0c1c8409b5\") " pod="openshift-dns/dns-default-brjtc" Jul 22 02:17:36.162593 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.162331 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a39eaba3-240b-488d-a279-ed0c1c8409b5-tmp-dir\") pod \"dns-default-brjtc\" (UID: \"a39eaba3-240b-488d-a279-ed0c1c8409b5\") " pod="openshift-dns/dns-default-brjtc" Jul 22 02:17:36.162593 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.162383 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzwm9\" (UniqueName: \"kubernetes.io/projected/a39eaba3-240b-488d-a279-ed0c1c8409b5-kube-api-access-xzwm9\") pod \"dns-default-brjtc\" (UID: \"a39eaba3-240b-488d-a279-ed0c1c8409b5\") " pod="openshift-dns/dns-default-brjtc" Jul 22 02:17:36.162593 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.162414 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d8a5fb2-e0a1-469c-9d25-90ae7e60f184-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqfnz\" (UID: \"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184\") " pod="openshift-insights/insights-runtime-extractor-wqfnz" Jul 22 02:17:36.263719 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.263687 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d8a5fb2-e0a1-469c-9d25-90ae7e60f184-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wqfnz\" (UID: \"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184\") " pod="openshift-insights/insights-runtime-extractor-wqfnz" Jul 22 02:17:36.263878 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.263732 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pqv9\" (UniqueName: \"kubernetes.io/projected/6d8a5fb2-e0a1-469c-9d25-90ae7e60f184-kube-api-access-2pqv9\") pod \"insights-runtime-extractor-wqfnz\" (UID: \"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184\") " pod="openshift-insights/insights-runtime-extractor-wqfnz" Jul 22 02:17:36.263878 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.263773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l45nf\" (UniqueName: \"kubernetes.io/projected/827dc975-54a6-4e48-a6e2-44d6e1afaf63-kube-api-access-l45nf\") pod \"ingress-canary-qsw69\" (UID: \"827dc975-54a6-4e48-a6e2-44d6e1afaf63\") " pod="openshift-ingress-canary/ingress-canary-qsw69" Jul 22 02:17:36.263878 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.263798 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d8a5fb2-e0a1-469c-9d25-90ae7e60f184-data-volume\") pod \"insights-runtime-extractor-wqfnz\" (UID: \"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184\") " pod="openshift-insights/insights-runtime-extractor-wqfnz" Jul 22 02:17:36.263878 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.263819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/827dc975-54a6-4e48-a6e2-44d6e1afaf63-cert\") pod \"ingress-canary-qsw69\" (UID: \"827dc975-54a6-4e48-a6e2-44d6e1afaf63\") " pod="openshift-ingress-canary/ingress-canary-qsw69" Jul 22 02:17:36.263878 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.263855 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a39eaba3-240b-488d-a279-ed0c1c8409b5-config-volume\") pod \"dns-default-brjtc\" (UID: \"a39eaba3-240b-488d-a279-ed0c1c8409b5\") " pod="openshift-dns/dns-default-brjtc" Jul 22 02:17:36.263878 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.263877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a39eaba3-240b-488d-a279-ed0c1c8409b5-metrics-tls\") pod \"dns-default-brjtc\" (UID: \"a39eaba3-240b-488d-a279-ed0c1c8409b5\") " pod="openshift-dns/dns-default-brjtc" Jul 22 02:17:36.264240 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.264172 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d8a5fb2-e0a1-469c-9d25-90ae7e60f184-data-volume\") pod \"insights-runtime-extractor-wqfnz\" (UID: \"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184\") " pod="openshift-insights/insights-runtime-extractor-wqfnz" Jul 22 02:17:36.264360 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.264044 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a39eaba3-240b-488d-a279-ed0c1c8409b5-tmp-dir\") pod \"dns-default-brjtc\" (UID: \"a39eaba3-240b-488d-a279-ed0c1c8409b5\") " pod="openshift-dns/dns-default-brjtc" Jul 22 02:17:36.264416 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.264397 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzwm9\" (UniqueName: \"kubernetes.io/projected/a39eaba3-240b-488d-a279-ed0c1c8409b5-kube-api-access-xzwm9\") pod \"dns-default-brjtc\" (UID: \"a39eaba3-240b-488d-a279-ed0c1c8409b5\") " pod="openshift-dns/dns-default-brjtc" Jul 22 02:17:36.264471 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.264427 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d8a5fb2-e0a1-469c-9d25-90ae7e60f184-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wqfnz\" (UID: \"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184\") " pod="openshift-insights/insights-runtime-extractor-wqfnz" Jul 22 02:17:36.264520 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.264465 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a39eaba3-240b-488d-a279-ed0c1c8409b5-tmp-dir\") pod \"dns-default-brjtc\" (UID: \"a39eaba3-240b-488d-a279-ed0c1c8409b5\") " pod="openshift-dns/dns-default-brjtc" Jul 22 02:17:36.264580 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.264568 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a39eaba3-240b-488d-a279-ed0c1c8409b5-config-volume\") pod \"dns-default-brjtc\" (UID: \"a39eaba3-240b-488d-a279-ed0c1c8409b5\") " pod="openshift-dns/dns-default-brjtc" Jul 22 02:17:36.264648 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.264431 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d8a5fb2-e0a1-469c-9d25-90ae7e60f184-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqfnz\" (UID: \"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184\") " pod="openshift-insights/insights-runtime-extractor-wqfnz" Jul 22 02:17:36.264728 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.264652 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d8a5fb2-e0a1-469c-9d25-90ae7e60f184-crio-socket\") pod \"insights-runtime-extractor-wqfnz\" (UID: \"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184\") " pod="openshift-insights/insights-runtime-extractor-wqfnz" Jul 22 02:17:36.264847 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.264780 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d8a5fb2-e0a1-469c-9d25-90ae7e60f184-crio-socket\") pod \"insights-runtime-extractor-wqfnz\" (UID: \"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184\") " pod="openshift-insights/insights-runtime-extractor-wqfnz" Jul 22 02:17:36.264936 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.264897 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:36.267833 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.267805 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a39eaba3-240b-488d-a279-ed0c1c8409b5-metrics-tls\") pod \"dns-default-brjtc\" (UID: \"a39eaba3-240b-488d-a279-ed0c1c8409b5\") " pod="openshift-dns/dns-default-brjtc" Jul 22 02:17:36.267919 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.267838 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/827dc975-54a6-4e48-a6e2-44d6e1afaf63-cert\") pod \"ingress-canary-qsw69\" (UID: \"827dc975-54a6-4e48-a6e2-44d6e1afaf63\") " pod="openshift-ingress-canary/ingress-canary-qsw69" Jul 22 02:17:36.267919 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.267806 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d8a5fb2-e0a1-469c-9d25-90ae7e60f184-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wqfnz\" (UID: \"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184\") " pod="openshift-insights/insights-runtime-extractor-wqfnz" Jul 22 02:17:36.272040 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.271983 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l45nf\" (UniqueName: \"kubernetes.io/projected/827dc975-54a6-4e48-a6e2-44d6e1afaf63-kube-api-access-l45nf\") pod \"ingress-canary-qsw69\" (UID: \"827dc975-54a6-4e48-a6e2-44d6e1afaf63\") " pod="openshift-ingress-canary/ingress-canary-qsw69" Jul 22 02:17:36.272364 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.272348 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pqv9\" (UniqueName: \"kubernetes.io/projected/6d8a5fb2-e0a1-469c-9d25-90ae7e60f184-kube-api-access-2pqv9\") pod \"insights-runtime-extractor-wqfnz\" (UID: \"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184\") " pod="openshift-insights/insights-runtime-extractor-wqfnz" Jul 22 02:17:36.272574 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.272551 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzwm9\" (UniqueName: \"kubernetes.io/projected/a39eaba3-240b-488d-a279-ed0c1c8409b5-kube-api-access-xzwm9\") pod \"dns-default-brjtc\" (UID: \"a39eaba3-240b-488d-a279-ed0c1c8409b5\") " pod="openshift-dns/dns-default-brjtc" Jul 22 02:17:36.379490 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.379458 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-brjtc" Jul 22 02:17:36.382985 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.382968 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wqfnz" Jul 22 02:17:36.399170 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.399147 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qsw69" Jul 22 02:17:36.512225 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.512060 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:36.537830 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.537630 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-brjtc"] Jul 22 02:17:36.541145 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:17:36.541112 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda39eaba3_240b_488d_a279_ed0c1c8409b5.slice/crio-e1b21ffda512606ce60695a64e02df2f559d0dd63e94ab6c25038d6e666c0ccf WatchSource:0}: Error finding container e1b21ffda512606ce60695a64e02df2f559d0dd63e94ab6c25038d6e666c0ccf: Status 404 returned error can't find the container with id e1b21ffda512606ce60695a64e02df2f559d0dd63e94ab6c25038d6e666c0ccf Jul 22 02:17:36.542529 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.542507 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wqfnz"] Jul 22 02:17:36.544444 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:17:36.544423 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d8a5fb2_e0a1_469c_9d25_90ae7e60f184.slice/crio-a3fb2393543cf53e51889a53d01227f41ea4b717575c45ff7f4d5d46b0348588 WatchSource:0}: Error finding container a3fb2393543cf53e51889a53d01227f41ea4b717575c45ff7f4d5d46b0348588: Status 404 returned error can't find the container with id a3fb2393543cf53e51889a53d01227f41ea4b717575c45ff7f4d5d46b0348588 Jul 22 02:17:36.546637 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.546561 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qsw69"] Jul 22 02:17:36.549286 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:17:36.549267 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod827dc975_54a6_4e48_a6e2_44d6e1afaf63.slice/crio-fe5c226af49291b57809062cf7b0c93427f842da1d7d0857b642739b67310e43 WatchSource:0}: Error finding container fe5c226af49291b57809062cf7b0c93427f842da1d7d0857b642739b67310e43: Status 404 returned error can't find the container with id fe5c226af49291b57809062cf7b0c93427f842da1d7d0857b642739b67310e43 Jul 22 02:17:36.612912 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.612878 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:36.685130 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.685094 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vpt6g"] Jul 22 02:17:36.687527 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.687506 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vpt6g" Jul 22 02:17:36.689815 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.689738 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:36.689948 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.689850 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 22 02:17:36.689948 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.689892 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-txbww\"" Jul 22 02:17:36.698057 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.698039 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vpt6g"] Jul 22 02:17:36.769033 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.768999 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-vpt6g\" (UID: \"290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vpt6g" Jul 22 02:17:36.870277 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:36.870241 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-vpt6g\" (UID: \"290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vpt6g" Jul 22 02:17:36.870435 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:36.870395 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 22 02:17:36.870485 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:36.870471 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b-tls-certificates podName:290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b nodeName:}" failed. No retries permitted until 2026-07-22 02:17:37.37045529 +0000 UTC m=+53.622016761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-vpt6g" (UID: "290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b") : secret "prometheus-operator-admission-webhook-tls" not found Jul 22 02:17:37.341257 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.341226 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:37.341649 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.341632 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:37.342632 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.342605 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:37.347237 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.346458 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 02:17:37.347237 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.346613 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 02:17:37.347237 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.346713 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 02:17:37.347237 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.346906 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 02:17:37.347237 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.346991 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8wr9\"" Jul 22 02:17:37.347237 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.347147 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ngk6m\"" Jul 22 02:17:37.374927 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.374898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-vpt6g\" (UID: \"290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vpt6g" Jul 22 02:17:37.375058 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:37.375042 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 22 02:17:37.375117 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:17:37.375107 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b-tls-certificates podName:290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b nodeName:}" failed. No retries permitted until 2026-07-22 02:17:38.375088082 +0000 UTC m=+54.626649555 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-vpt6g" (UID: "290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b") : secret "prometheus-operator-admission-webhook-tls" not found Jul 22 02:17:37.473322 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.473277 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:37.506143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.505125 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d9b7c9c99-z9cln"] Jul 22 02:17:37.507391 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.507369 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.512097 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.510796 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lmd2l\"" Jul 22 02:17:37.512097 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.510900 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 22 02:17:37.512097 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.511007 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 02:17:37.512097 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.511129 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 22 02:17:37.512097 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.511223 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 22 02:17:37.512097 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.511881 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 02:17:37.512097 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.511917 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 22 02:17:37.512797 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.512586 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 22 02:17:37.516657 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.516638 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 22 02:17:37.519710 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.519688 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d9b7c9c99-z9cln"] Jul 22 02:17:37.537560 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.537488 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wqfnz" event={"ID":"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184","Type":"ContainerStarted","Data":"a3fb2393543cf53e51889a53d01227f41ea4b717575c45ff7f4d5d46b0348588"} Jul 22 02:17:37.539384 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.539354 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:37.541325 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.541294 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-brjtc" event={"ID":"a39eaba3-240b-488d-a279-ed0c1c8409b5","Type":"ContainerStarted","Data":"e1b21ffda512606ce60695a64e02df2f559d0dd63e94ab6c25038d6e666c0ccf"} Jul 22 02:17:37.543005 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.542981 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qsw69" event={"ID":"827dc975-54a6-4e48-a6e2-44d6e1afaf63","Type":"ContainerStarted","Data":"fe5c226af49291b57809062cf7b0c93427f842da1d7d0857b642739b67310e43"} Jul 22 02:17:37.575994 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.575965 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-trusted-ca-bundle\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.576128 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.576010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70579a7f-a5f4-46db-b464-da291b3814a5-console-serving-cert\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.576128 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.576037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7qp6\" (UniqueName: \"kubernetes.io/projected/70579a7f-a5f4-46db-b464-da291b3814a5-kube-api-access-r7qp6\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.576232 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.576144 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-console-config\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.576232 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.576178 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-service-ca\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.576333 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.576231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70579a7f-a5f4-46db-b464-da291b3814a5-console-oauth-config\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.576333 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.576259 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-oauth-serving-cert\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.677119 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.677042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-console-config\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.677119 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.677084 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-service-ca\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.677324 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.677137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70579a7f-a5f4-46db-b464-da291b3814a5-console-oauth-config\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.677324 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.677161 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-oauth-serving-cert\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.677324 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.677204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-trusted-ca-bundle\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.677324 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.677229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70579a7f-a5f4-46db-b464-da291b3814a5-console-serving-cert\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.677324 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.677251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7qp6\" (UniqueName: \"kubernetes.io/projected/70579a7f-a5f4-46db-b464-da291b3814a5-kube-api-access-r7qp6\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.678481 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.678441 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-console-config\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.679033 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.679012 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-service-ca\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.680589 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.680567 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-trusted-ca-bundle\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.681176 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.681155 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-oauth-serving-cert\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.689134 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.689093 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70579a7f-a5f4-46db-b464-da291b3814a5-console-serving-cert\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.690225 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.690202 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70579a7f-a5f4-46db-b464-da291b3814a5-console-oauth-config\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.702925 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.702901 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7qp6\" (UniqueName: \"kubernetes.io/projected/70579a7f-a5f4-46db-b464-da291b3814a5-kube-api-access-r7qp6\") pod \"console-5d9b7c9c99-z9cln\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.825197 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.825163 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:37.996093 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:37.995819 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d9b7c9c99-z9cln"] Jul 22 02:17:38.003698 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:17:38.003670 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70579a7f_a5f4_46db_b464_da291b3814a5.slice/crio-61464b7ec0eea964ace866cdbcc4fdcab3762bf0c182da92af6c8bb55573d102 WatchSource:0}: Error finding container 61464b7ec0eea964ace866cdbcc4fdcab3762bf0c182da92af6c8bb55573d102: Status 404 returned error can't find the container with id 61464b7ec0eea964ace866cdbcc4fdcab3762bf0c182da92af6c8bb55573d102 Jul 22 02:17:38.027299 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:38.027220 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:38.384565 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:38.384526 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-vpt6g\" (UID: \"290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vpt6g" Jul 22 02:17:38.388709 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:38.388680 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-vpt6g\" (UID: \"290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vpt6g" Jul 22 02:17:38.497106 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:38.496806 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vpt6g" Jul 22 02:17:38.547850 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:38.547770 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9b7c9c99-z9cln" event={"ID":"70579a7f-a5f4-46db-b464-da291b3814a5","Type":"ContainerStarted","Data":"61464b7ec0eea964ace866cdbcc4fdcab3762bf0c182da92af6c8bb55573d102"} Jul 22 02:17:39.905611 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:39.905504 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:39.960790 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:39.960736 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:40.676117 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:40.676076 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:40.733543 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:40.733512 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:43.111051 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:43.110925 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:43.212346 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:43.212316 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:44.003527 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:44.003463 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vpt6g"] Jul 22 02:17:44.011120 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:17:44.011079 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod290eddc4_9e4e_42b3_9a6f_a7d8f38cf48b.slice/crio-5acddf61ca981f340de2102612d6f52d7f0a90ef6c2c8d95bb32cca933b78fbe WatchSource:0}: Error finding container 5acddf61ca981f340de2102612d6f52d7f0a90ef6c2c8d95bb32cca933b78fbe: Status 404 returned error can't find the container with id 5acddf61ca981f340de2102612d6f52d7f0a90ef6c2c8d95bb32cca933b78fbe Jul 22 02:17:44.489223 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:44.489127 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nhgq8" Jul 22 02:17:44.566655 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:44.566610 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wqfnz" event={"ID":"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184","Type":"ContainerStarted","Data":"28eb49fe9c7ceb3a8a8ee7a0414bc8681e7790eafefa01c4bdbf61cfc96a867c"} Jul 22 02:17:44.568940 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:44.568910 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-brjtc" event={"ID":"a39eaba3-240b-488d-a279-ed0c1c8409b5","Type":"ContainerStarted","Data":"8c94ba30aa05abd6f297c7d33d9857397efb9b22a4c4880435c04cc895203c9b"} Jul 22 02:17:44.569055 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:44.568963 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-brjtc" event={"ID":"a39eaba3-240b-488d-a279-ed0c1c8409b5","Type":"ContainerStarted","Data":"5f1d58d15b8aadaf7cd2d5d7d11c0a7f68dd910acbee6d603e505bb4ad433512"} Jul 22 02:17:44.569055 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:44.569032 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-brjtc" Jul 22 02:17:44.571426 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:44.571399 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9b7c9c99-z9cln" event={"ID":"70579a7f-a5f4-46db-b464-da291b3814a5","Type":"ContainerStarted","Data":"23ffabcdda0912100a0c0fea7776ae198091feb85ebc2bd397e908ac38d27262"} Jul 22 02:17:44.573860 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:44.573107 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vpt6g" event={"ID":"290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b","Type":"ContainerStarted","Data":"5acddf61ca981f340de2102612d6f52d7f0a90ef6c2c8d95bb32cca933b78fbe"} Jul 22 02:17:44.574909 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:44.574784 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qsw69" event={"ID":"827dc975-54a6-4e48-a6e2-44d6e1afaf63","Type":"ContainerStarted","Data":"f131d2d3d61b80ecd65d9a2a2bed4dc72e86fc545b2d8ccc549182e0d89ac0b9"} Jul 22 02:17:44.593272 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:44.593220 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-brjtc" podStartSLOduration=2.294513778 podStartE2EDuration="8.593201979s" totalImagesPullingTime="6.298688201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:44.592001235 +0000 UTC m=+60.843562730" watchObservedRunningTime="2026-07-22 02:17:44.593201979 +0000 UTC m=+60.844763473" Jul 22 02:17:44.609669 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:44.609618 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qsw69" podStartSLOduration=1.287393587 podStartE2EDuration="8.60959883s" totalImagesPullingTime="7.322205243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:44.609495563 +0000 UTC m=+60.861057058" watchObservedRunningTime="2026-07-22 02:17:44.60959883 +0000 UTC m=+60.861160323" Jul 22 02:17:44.669808 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:44.669773 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:44.730179 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:44.730144 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:45.580050 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.579980 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vpt6g" event={"ID":"290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b","Type":"ContainerStarted","Data":"7c8b915fb1e8ebfac24874860d8f369a530f3375f7ac4d5d9c7acad2eb391751"} Jul 22 02:17:45.580498 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.580321 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vpt6g" Jul 22 02:17:45.585296 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.585271 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vpt6g" Jul 22 02:17:45.594907 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.594863 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-vpt6g" podStartSLOduration=8.353364695 podStartE2EDuration="9.594848477s" totalImagesPullingTime="1.241483782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:45.594275768 +0000 UTC m=+61.845837281" watchObservedRunningTime="2026-07-22 02:17:45.594848477 +0000 UTC m=+61.846409968" Jul 22 02:17:45.595445 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.595411 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d9b7c9c99-z9cln" podStartSLOduration=2.709287963 podStartE2EDuration="8.595401769s" totalImagesPullingTime="5.886113806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:44.634923159 +0000 UTC m=+60.886484652" watchObservedRunningTime="2026-07-22 02:17:45.595401769 +0000 UTC m=+61.846963261" Jul 22 02:17:45.717703 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.717668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:45.757840 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.757800 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-f28dl"] Jul 22 02:17:45.765133 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.765099 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" Jul 22 02:17:45.768196 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.768172 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 02:17:45.768357 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.768238 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 22 02:17:45.768357 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.768284 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 02:17:45.768526 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.768501 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 22 02:17:45.768596 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.768578 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8s46s\"" Jul 22 02:17:45.768672 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.768595 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 02:17:45.773868 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.773182 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-f28dl"] Jul 22 02:17:45.786625 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.786602 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:45.848588 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.848515 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af0578c0-9fbc-4d87-93d5-80df8b0ce521-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-f28dl\" (UID: \"af0578c0-9fbc-4d87-93d5-80df8b0ce521\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" Jul 22 02:17:45.848744 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.848674 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af0578c0-9fbc-4d87-93d5-80df8b0ce521-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-f28dl\" (UID: \"af0578c0-9fbc-4d87-93d5-80df8b0ce521\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" Jul 22 02:17:45.848744 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.848739 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/af0578c0-9fbc-4d87-93d5-80df8b0ce521-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-f28dl\" (UID: \"af0578c0-9fbc-4d87-93d5-80df8b0ce521\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" Jul 22 02:17:45.848854 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.848800 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klt8l\" (UniqueName: \"kubernetes.io/projected/af0578c0-9fbc-4d87-93d5-80df8b0ce521-kube-api-access-klt8l\") pod \"prometheus-operator-5945b5cfd-f28dl\" (UID: \"af0578c0-9fbc-4d87-93d5-80df8b0ce521\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" Jul 22 02:17:45.949130 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.949098 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af0578c0-9fbc-4d87-93d5-80df8b0ce521-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-f28dl\" (UID: \"af0578c0-9fbc-4d87-93d5-80df8b0ce521\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" Jul 22 02:17:45.949300 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.949282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af0578c0-9fbc-4d87-93d5-80df8b0ce521-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-f28dl\" (UID: \"af0578c0-9fbc-4d87-93d5-80df8b0ce521\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" Jul 22 02:17:45.949359 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.949325 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/af0578c0-9fbc-4d87-93d5-80df8b0ce521-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-f28dl\" (UID: \"af0578c0-9fbc-4d87-93d5-80df8b0ce521\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" Jul 22 02:17:45.949414 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.949359 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klt8l\" (UniqueName: \"kubernetes.io/projected/af0578c0-9fbc-4d87-93d5-80df8b0ce521-kube-api-access-klt8l\") pod \"prometheus-operator-5945b5cfd-f28dl\" (UID: \"af0578c0-9fbc-4d87-93d5-80df8b0ce521\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" Jul 22 02:17:45.949968 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.949937 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af0578c0-9fbc-4d87-93d5-80df8b0ce521-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-f28dl\" (UID: \"af0578c0-9fbc-4d87-93d5-80df8b0ce521\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" Jul 22 02:17:45.951879 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.951855 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af0578c0-9fbc-4d87-93d5-80df8b0ce521-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-f28dl\" (UID: \"af0578c0-9fbc-4d87-93d5-80df8b0ce521\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" Jul 22 02:17:45.952026 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.952003 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/af0578c0-9fbc-4d87-93d5-80df8b0ce521-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-f28dl\" (UID: \"af0578c0-9fbc-4d87-93d5-80df8b0ce521\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" Jul 22 02:17:45.957374 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.957318 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klt8l\" (UniqueName: \"kubernetes.io/projected/af0578c0-9fbc-4d87-93d5-80df8b0ce521-kube-api-access-klt8l\") pod \"prometheus-operator-5945b5cfd-f28dl\" (UID: \"af0578c0-9fbc-4d87-93d5-80df8b0ce521\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" Jul 22 02:17:45.978362 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:45.978321 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:46.075901 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:46.075841 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" Jul 22 02:17:47.533248 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:47.533105 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-f28dl"] Jul 22 02:17:47.535739 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:17:47.535714 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0578c0_9fbc_4d87_93d5_80df8b0ce521.slice/crio-5a1cb95bbfda7326e5a13b14e8060e8f095fbc1f006bbc215deb97f3ba724259 WatchSource:0}: Error finding container 5a1cb95bbfda7326e5a13b14e8060e8f095fbc1f006bbc215deb97f3ba724259: Status 404 returned error can't find the container with id 5a1cb95bbfda7326e5a13b14e8060e8f095fbc1f006bbc215deb97f3ba724259 Jul 22 02:17:47.588124 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:47.588092 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" event={"ID":"af0578c0-9fbc-4d87-93d5-80df8b0ce521","Type":"ContainerStarted","Data":"5a1cb95bbfda7326e5a13b14e8060e8f095fbc1f006bbc215deb97f3ba724259"} Jul 22 02:17:47.589837 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:47.589814 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wqfnz" event={"ID":"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184","Type":"ContainerStarted","Data":"6790e7fa33211de39664cf0edd04617895596ab12b970c7784854ec7eea18d5e"} Jul 22 02:17:47.752434 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:47.752324 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:47.826165 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:47.826130 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:47.826335 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:47.826192 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:17:47.827371 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:47.827346 2579 patch_prober.go:28] interesting pod/console-5d9b7c9c99-z9cln container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" start-of-body= Jul 22 02:17:47.827470 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:47.827390 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5d9b7c9c99-z9cln" podUID="70579a7f-a5f4-46db-b464-da291b3814a5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" Jul 22 02:17:47.856223 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:47.856185 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:48.974702 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:48.974678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs\") pod \"network-metrics-daemon-kfkc8\" (UID: \"9d672470-60f6-4b81-b905-187af05f5b29\") " pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:48.977279 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:48.977256 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 02:17:48.987306 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:48.987181 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d672470-60f6-4b81-b905-187af05f5b29-metrics-certs\") pod \"network-metrics-daemon-kfkc8\" (UID: \"9d672470-60f6-4b81-b905-187af05f5b29\") " pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:49.076098 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:49.076056 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret\") pod \"global-pull-secret-syncer-5x227\" (UID: \"00c60860-7a47-4782-9bc3-35d8a634cd22\") " pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:49.078887 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:49.078865 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 02:17:49.081921 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:49.081897 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8wr9\"" Jul 22 02:17:49.089071 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:49.089023 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00c60860-7a47-4782-9bc3-35d8a634cd22-original-pull-secret\") pod \"global-pull-secret-syncer-5x227\" (UID: \"00c60860-7a47-4782-9bc3-35d8a634cd22\") " pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:49.090507 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:49.090480 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kfkc8" Jul 22 02:17:49.177505 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:49.177426 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2vnq\" (UniqueName: \"kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq\") pod \"network-check-target-dkjcx\" (UID: \"dbc1cdb0-18c6-4606-8e83-27396ad3388e\") " pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:49.180469 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:49.180447 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 02:17:49.190733 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:49.190690 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 02:17:49.200801 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:49.200770 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2vnq\" (UniqueName: \"kubernetes.io/projected/dbc1cdb0-18c6-4606-8e83-27396ad3388e-kube-api-access-k2vnq\") pod \"network-check-target-dkjcx\" (UID: \"dbc1cdb0-18c6-4606-8e83-27396ad3388e\") " pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:49.208876 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:49.208847 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:49.247013 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:49.246988 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kfkc8"] Jul 22 02:17:49.250920 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:17:49.250893 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d672470_60f6_4b81_b905_187af05f5b29.slice/crio-c6af0132ff511c0a650c874c9542a6b4812b7315e91098cbce3805734c886ba6 WatchSource:0}: Error finding container c6af0132ff511c0a650c874c9542a6b4812b7315e91098cbce3805734c886ba6: Status 404 returned error can't find the container with id c6af0132ff511c0a650c874c9542a6b4812b7315e91098cbce3805734c886ba6 Jul 22 02:17:49.362687 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:49.362636 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5x227" Jul 22 02:17:49.374461 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:49.374439 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ngk6m\"" Jul 22 02:17:49.382780 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:49.382603 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:49.601809 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:49.601763 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" event={"ID":"af0578c0-9fbc-4d87-93d5-80df8b0ce521","Type":"ContainerStarted","Data":"46d14c330972faa90ac2c2ff0acad4c7d61f31b18bceccd19f5c2bcac0b73ff7"} Jul 22 02:17:49.601994 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:49.601829 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" event={"ID":"af0578c0-9fbc-4d87-93d5-80df8b0ce521","Type":"ContainerStarted","Data":"3103f80a1e8a301fd64963434d8d1ef2cc6ac0ee23525b6618f1a5628858b5b1"} Jul 22 02:17:49.602929 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:49.602901 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kfkc8" event={"ID":"9d672470-60f6-4b81-b905-187af05f5b29","Type":"ContainerStarted","Data":"c6af0132ff511c0a650c874c9542a6b4812b7315e91098cbce3805734c886ba6"} Jul 22 02:17:50.312770 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:50.312715 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:50.368555 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:50.368520 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:50.872507 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:50.872477 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:51.089665 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.089611 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-f28dl" podStartSLOduration=4.705384492 podStartE2EDuration="6.089588355s" totalImagesPullingTime="1.384203863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:49.625163336 +0000 UTC m=+65.876724837" watchObservedRunningTime="2026-07-22 02:17:51.089588355 +0000 UTC m=+67.341149840" Jul 22 02:17:51.090725 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.090701 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5x227"] Jul 22 02:17:51.094056 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:17:51.094006 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00c60860_7a47_4782_9bc3_35d8a634cd22.slice/crio-d415fb019f00dc34bd6300eff00043ed5c6d6affd306164719014ae3619f589c WatchSource:0}: Error finding container d415fb019f00dc34bd6300eff00043ed5c6d6affd306164719014ae3619f589c: Status 404 returned error can't find the container with id d415fb019f00dc34bd6300eff00043ed5c6d6affd306164719014ae3619f589c Jul 22 02:17:51.094984 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.094904 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:51.108597 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.108571 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dkjcx"] Jul 22 02:17:51.111670 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:17:51.111639 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc1cdb0_18c6_4606_8e83_27396ad3388e.slice/crio-8fb1edf0a1363f411a321feca9eda82b47c5cf1470bcec44876ef89ae2301e65 WatchSource:0}: Error finding container 8fb1edf0a1363f411a321feca9eda82b47c5cf1470bcec44876ef89ae2301e65: Status 404 returned error can't find the container with id 8fb1edf0a1363f411a321feca9eda82b47c5cf1470bcec44876ef89ae2301e65 Jul 22 02:17:51.116843 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.116520 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75"] Jul 22 02:17:51.120339 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.120320 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" Jul 22 02:17:51.124235 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.124177 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 22 02:17:51.124235 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.124222 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 22 02:17:51.124380 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.124259 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bzrxl\"" Jul 22 02:17:51.132064 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.132040 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75"] Jul 22 02:17:51.144038 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.144014 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-5mshl"] Jul 22 02:17:51.147403 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.147384 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.150332 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.150316 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 22 02:17:51.150429 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.150350 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 22 02:17:51.151164 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.151148 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fhkc8\"" Jul 22 02:17:51.151250 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.151151 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 22 02:17:51.177472 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.177450 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fb5pc"] Jul 22 02:17:51.180819 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.180800 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-5mshl"] Jul 22 02:17:51.180942 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.180923 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.183439 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.183416 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 02:17:51.183543 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.183441 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 02:17:51.183766 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.183734 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 02:17:51.184521 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.184503 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5k47c\"" Jul 22 02:17:51.190820 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.190801 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40203506-f9ca-4153-acfb-8bc7e16a9750-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-28v75\" (UID: \"40203506-f9ca-4153-acfb-8bc7e16a9750\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" Jul 22 02:17:51.190934 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.190829 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/40203506-f9ca-4153-acfb-8bc7e16a9750-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-28v75\" (UID: \"40203506-f9ca-4153-acfb-8bc7e16a9750\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" Jul 22 02:17:51.190934 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.190862 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/40aa0309-b8b4-4ef4-a101-2eab224d8109-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.190934 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.190901 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/40aa0309-b8b4-4ef4-a101-2eab224d8109-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.191053 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.190954 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptd2l\" (UniqueName: \"kubernetes.io/projected/40203506-f9ca-4153-acfb-8bc7e16a9750-kube-api-access-ptd2l\") pod \"openshift-state-metrics-79f6958cdf-28v75\" (UID: \"40203506-f9ca-4153-acfb-8bc7e16a9750\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" Jul 22 02:17:51.191053 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.190991 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40aa0309-b8b4-4ef4-a101-2eab224d8109-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.191053 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.191036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40aa0309-b8b4-4ef4-a101-2eab224d8109-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.191159 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.191058 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlf6w\" (UniqueName: \"kubernetes.io/projected/40aa0309-b8b4-4ef4-a101-2eab224d8109-kube-api-access-hlf6w\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.191159 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.191079 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40203506-f9ca-4153-acfb-8bc7e16a9750-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-28v75\" (UID: \"40203506-f9ca-4153-acfb-8bc7e16a9750\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" Jul 22 02:17:51.191159 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.191100 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/40aa0309-b8b4-4ef4-a101-2eab224d8109-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.199565 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.199543 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:51.266454 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.266427 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:51.292255 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292225 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-node-exporter-wtmp\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.292471 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292270 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40203506-f9ca-4153-acfb-8bc7e16a9750-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-28v75\" (UID: \"40203506-f9ca-4153-acfb-8bc7e16a9750\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" Jul 22 02:17:51.292471 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/40203506-f9ca-4153-acfb-8bc7e16a9750-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-28v75\" (UID: \"40203506-f9ca-4153-acfb-8bc7e16a9750\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" Jul 22 02:17:51.292471 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292358 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-node-exporter-accelerators-collector-config\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.292471 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292425 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-metrics-client-ca\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.292691 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/40aa0309-b8b4-4ef4-a101-2eab224d8109-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.292691 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292516 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/40aa0309-b8b4-4ef4-a101-2eab224d8109-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.292691 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292544 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptd2l\" (UniqueName: \"kubernetes.io/projected/40203506-f9ca-4153-acfb-8bc7e16a9750-kube-api-access-ptd2l\") pod \"openshift-state-metrics-79f6958cdf-28v75\" (UID: \"40203506-f9ca-4153-acfb-8bc7e16a9750\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" Jul 22 02:17:51.292691 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292575 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-node-exporter-tls\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.292691 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292592 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40aa0309-b8b4-4ef4-a101-2eab224d8109-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.292691 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292616 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40aa0309-b8b4-4ef4-a101-2eab224d8109-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.292691 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292657 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlf6w\" (UniqueName: \"kubernetes.io/projected/40aa0309-b8b4-4ef4-a101-2eab224d8109-kube-api-access-hlf6w\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.293059 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292696 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40203506-f9ca-4153-acfb-8bc7e16a9750-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-28v75\" (UID: \"40203506-f9ca-4153-acfb-8bc7e16a9750\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" Jul 22 02:17:51.293059 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292720 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzdkm\" (UniqueName: \"kubernetes.io/projected/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-kube-api-access-hzdkm\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.293059 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292761 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.293059 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292792 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-sys\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.293059 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-node-exporter-textfile\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.293059 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292847 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/40aa0309-b8b4-4ef4-a101-2eab224d8109-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.293059 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.292892 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-root\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.293402 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.293335 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/40aa0309-b8b4-4ef4-a101-2eab224d8109-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.293542 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.293520 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/40aa0309-b8b4-4ef4-a101-2eab224d8109-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.293607 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.293574 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40203506-f9ca-4153-acfb-8bc7e16a9750-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-28v75\" (UID: \"40203506-f9ca-4153-acfb-8bc7e16a9750\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" Jul 22 02:17:51.294209 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.294153 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40aa0309-b8b4-4ef4-a101-2eab224d8109-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.294971 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.294950 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/40203506-f9ca-4153-acfb-8bc7e16a9750-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-28v75\" (UID: \"40203506-f9ca-4153-acfb-8bc7e16a9750\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" Jul 22 02:17:51.295746 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.295703 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40203506-f9ca-4153-acfb-8bc7e16a9750-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-28v75\" (UID: \"40203506-f9ca-4153-acfb-8bc7e16a9750\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" Jul 22 02:17:51.295746 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.295716 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40aa0309-b8b4-4ef4-a101-2eab224d8109-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.295930 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.295913 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/40aa0309-b8b4-4ef4-a101-2eab224d8109-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.301160 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.301136 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlf6w\" (UniqueName: \"kubernetes.io/projected/40aa0309-b8b4-4ef4-a101-2eab224d8109-kube-api-access-hlf6w\") pod \"kube-state-metrics-56c5594674-5mshl\" (UID: \"40aa0309-b8b4-4ef4-a101-2eab224d8109\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.301160 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.301153 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptd2l\" (UniqueName: \"kubernetes.io/projected/40203506-f9ca-4153-acfb-8bc7e16a9750-kube-api-access-ptd2l\") pod \"openshift-state-metrics-79f6958cdf-28v75\" (UID: \"40203506-f9ca-4153-acfb-8bc7e16a9750\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" Jul 22 02:17:51.368090 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.368051 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:51.394175 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.394100 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-node-exporter-accelerators-collector-config\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.394175 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.394146 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-metrics-client-ca\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.394372 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.394182 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-node-exporter-tls\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.394372 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.394227 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdkm\" (UniqueName: \"kubernetes.io/projected/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-kube-api-access-hzdkm\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.394372 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.394253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.394372 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.394283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-sys\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.394372 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.394306 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-node-exporter-textfile\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.394372 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.394347 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-root\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.394372 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.394373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-node-exporter-wtmp\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.394685 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.394522 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-node-exporter-wtmp\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.394788 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.394768 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-node-exporter-accelerators-collector-config\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.394855 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.394768 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-metrics-client-ca\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.394855 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.394809 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-sys\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.395143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.395118 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-node-exporter-textfile\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.395247 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.395121 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-root\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.397278 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.397254 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.397415 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.397392 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-node-exporter-tls\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.402616 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.402597 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzdkm\" (UniqueName: \"kubernetes.io/projected/f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29-kube-api-access-hzdkm\") pod \"node-exporter-fb5pc\" (UID: \"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29\") " pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.430491 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.430469 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" Jul 22 02:17:51.456895 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.456867 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" Jul 22 02:17:51.468695 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.468665 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:51.491516 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.491490 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fb5pc" Jul 22 02:17:51.574204 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.574131 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:51.616408 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.616351 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dkjcx" event={"ID":"dbc1cdb0-18c6-4606-8e83-27396ad3388e","Type":"ContainerStarted","Data":"8fb1edf0a1363f411a321feca9eda82b47c5cf1470bcec44876ef89ae2301e65"} Jul 22 02:17:51.618588 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.618559 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fb5pc" event={"ID":"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29","Type":"ContainerStarted","Data":"2f2277cd68cc7d82da37a14649511e4d1d721f09cebdca736670c1ad2d2a2c41"} Jul 22 02:17:51.620067 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.620022 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5x227" event={"ID":"00c60860-7a47-4782-9bc3-35d8a634cd22","Type":"ContainerStarted","Data":"d415fb019f00dc34bd6300eff00043ed5c6d6affd306164719014ae3619f589c"} Jul 22 02:17:51.622956 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.622931 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wqfnz" event={"ID":"6d8a5fb2-e0a1-469c-9d25-90ae7e60f184","Type":"ContainerStarted","Data":"a57159701749563b46da4faa4f47f57a1bb79c2f756fb5de5820132368129af8"} Jul 22 02:17:51.625579 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.625561 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-5mshl"] Jul 22 02:17:51.631172 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:17:51.631080 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40aa0309_b8b4_4ef4_a101_2eab224d8109.slice/crio-6f09c7e193602f341b2937069c97b3b21612e3fe12b9e8ac710e24dc8902b9f1 WatchSource:0}: Error finding container 6f09c7e193602f341b2937069c97b3b21612e3fe12b9e8ac710e24dc8902b9f1: Status 404 returned error can't find the container with id 6f09c7e193602f341b2937069c97b3b21612e3fe12b9e8ac710e24dc8902b9f1 Jul 22 02:17:51.647593 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.647475 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75"] Jul 22 02:17:51.652057 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.650672 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wqfnz" podStartSLOduration=1.386984797 podStartE2EDuration="15.65065267s" totalImagesPullingTime="14.263667873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:17:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:51.650307826 +0000 UTC m=+67.901869319" watchObservedRunningTime="2026-07-22 02:17:51.65065267 +0000 UTC m=+67.902214162" Jul 22 02:17:51.657345 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:51.657257 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:52.109894 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:52.109851 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:52.201719 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:52.201639 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:52.311499 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:52.311400 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:52.366986 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:52.366729 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:52.639052 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:52.638829 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" event={"ID":"40203506-f9ca-4153-acfb-8bc7e16a9750","Type":"ContainerStarted","Data":"01b2df11b5646ab6de8bb50088690cb18af62a7dd71b0c814bd58eec2f0910fa"} Jul 22 02:17:52.639052 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:52.638902 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" event={"ID":"40203506-f9ca-4153-acfb-8bc7e16a9750","Type":"ContainerStarted","Data":"6ef96e8be7840b7172811fefb5077349e5dbdd7b6fae725dabbe600ed2729aea"} Jul 22 02:17:52.639052 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:52.638934 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" event={"ID":"40203506-f9ca-4153-acfb-8bc7e16a9750","Type":"ContainerStarted","Data":"14d66d004927a3f35c6025df94e2513beb9d9ae257963d149e9fefb0e72ec3b2"} Jul 22 02:17:52.643429 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:52.642538 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kfkc8" event={"ID":"9d672470-60f6-4b81-b905-187af05f5b29","Type":"ContainerStarted","Data":"03569141cb910380207c449ad85b33d839e1b43882b5747918ce9fe0699e280d"} Jul 22 02:17:52.643429 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:52.642592 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kfkc8" event={"ID":"9d672470-60f6-4b81-b905-187af05f5b29","Type":"ContainerStarted","Data":"6faaa62587847015e80368f2f965e3ec5ac70b58605e38f0e085c81bab043b69"} Jul 22 02:17:52.646800 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:52.645889 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" event={"ID":"40aa0309-b8b4-4ef4-a101-2eab224d8109","Type":"ContainerStarted","Data":"6f09c7e193602f341b2937069c97b3b21612e3fe12b9e8ac710e24dc8902b9f1"} Jul 22 02:17:52.660515 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:52.660121 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kfkc8" podStartSLOduration=66.38486248 podStartE2EDuration="1m8.660098963s" totalImagesPullingTime="2.275236483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:52.658431659 +0000 UTC m=+68.909993171" watchObservedRunningTime="2026-07-22 02:17:52.660098963 +0000 UTC m=+68.911660457" Jul 22 02:17:52.709452 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:52.709358 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:52.780164 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:52.780130 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:52.839737 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:52.839701 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:52.940530 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:52.940405 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:53.900824 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:53.900791 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:53.956176 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:53.956142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:54.066075 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:54.066044 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:54.151082 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:54.150987 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:54.454088 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:54.454008 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:54.581571 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:54.581477 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:54.582852 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:54.582828 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-brjtc" Jul 22 02:17:55.545626 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.545581 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-645645cc5f-gk29n"] Jul 22 02:17:55.547995 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.547972 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.550449 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.550427 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 22 02:17:55.550872 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.550847 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 22 02:17:55.551638 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.551615 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 22 02:17:55.551724 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.551643 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9nqje8djsi3v2\"" Jul 22 02:17:55.551985 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.551966 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 22 02:17:55.552130 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.551966 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rqzvl\"" Jul 22 02:17:55.558503 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.558481 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-645645cc5f-gk29n"] Jul 22 02:17:55.632221 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.632184 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28f51ddc-0ee9-433e-975f-062415fb6633-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.632404 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.632255 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/28f51ddc-0ee9-433e-975f-062415fb6633-audit-log\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.632404 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.632298 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/28f51ddc-0ee9-433e-975f-062415fb6633-metrics-server-audit-profiles\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.632404 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.632326 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqjgg\" (UniqueName: \"kubernetes.io/projected/28f51ddc-0ee9-433e-975f-062415fb6633-kube-api-access-wqjgg\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.632404 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.632370 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/28f51ddc-0ee9-433e-975f-062415fb6633-secret-metrics-server-tls\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.632404 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.632403 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/28f51ddc-0ee9-433e-975f-062415fb6633-secret-metrics-server-client-certs\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.632601 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.632432 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28f51ddc-0ee9-433e-975f-062415fb6633-client-ca-bundle\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.733492 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.733442 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28f51ddc-0ee9-433e-975f-062415fb6633-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.733682 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.733527 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/28f51ddc-0ee9-433e-975f-062415fb6633-audit-log\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.733682 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.733570 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/28f51ddc-0ee9-433e-975f-062415fb6633-metrics-server-audit-profiles\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.733682 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.733592 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqjgg\" (UniqueName: \"kubernetes.io/projected/28f51ddc-0ee9-433e-975f-062415fb6633-kube-api-access-wqjgg\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.733682 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.733617 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/28f51ddc-0ee9-433e-975f-062415fb6633-secret-metrics-server-tls\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.733682 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.733652 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/28f51ddc-0ee9-433e-975f-062415fb6633-secret-metrics-server-client-certs\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.733682 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.733681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28f51ddc-0ee9-433e-975f-062415fb6633-client-ca-bundle\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.734028 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.733998 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/28f51ddc-0ee9-433e-975f-062415fb6633-audit-log\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.734325 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.734287 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28f51ddc-0ee9-433e-975f-062415fb6633-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.734644 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.734619 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/28f51ddc-0ee9-433e-975f-062415fb6633-metrics-server-audit-profiles\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.736504 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.736482 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/28f51ddc-0ee9-433e-975f-062415fb6633-secret-metrics-server-tls\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.736582 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.736521 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28f51ddc-0ee9-433e-975f-062415fb6633-client-ca-bundle\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.736711 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.736689 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/28f51ddc-0ee9-433e-975f-062415fb6633-secret-metrics-server-client-certs\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.741852 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.741828 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqjgg\" (UniqueName: \"kubernetes.io/projected/28f51ddc-0ee9-433e-975f-062415fb6633-kube-api-access-wqjgg\") pod \"metrics-server-645645cc5f-gk29n\" (UID: \"28f51ddc-0ee9-433e-975f-062415fb6633\") " pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.860712 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.860668 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:17:55.915181 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.915148 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hstgx"] Jul 22 02:17:55.917659 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.917570 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hstgx" Jul 22 02:17:55.918621 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.918593 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:55.920097 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.920063 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-bh8n8\"" Jul 22 02:17:55.920185 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.920066 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 22 02:17:55.931926 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.931890 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hstgx"] Jul 22 02:17:55.959848 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.959818 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d9b7c9c99-z9cln"] Jul 22 02:17:55.987687 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.987659 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-656d6f7bf-8tv94"] Jul 22 02:17:55.989912 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:55.989891 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.002503 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.002478 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-656d6f7bf-8tv94"] Jul 22 02:17:56.011777 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.011720 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:56.036472 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.036441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/407d5dae-eeae-4036-9e7b-c2b746c77b54-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hstgx\" (UID: \"407d5dae-eeae-4036-9e7b-c2b746c77b54\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hstgx" Jul 22 02:17:56.036588 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.036489 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gjf5\" (UniqueName: \"kubernetes.io/projected/407d5dae-eeae-4036-9e7b-c2b746c77b54-kube-api-access-8gjf5\") pod \"monitoring-plugin-7b7b7bc8bf-hstgx\" (UID: \"407d5dae-eeae-4036-9e7b-c2b746c77b54\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hstgx" Jul 22 02:17:56.112420 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.112332 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:56.137573 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.137527 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-config\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.137573 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.137579 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqxvw\" (UniqueName: \"kubernetes.io/projected/47ceb614-61f6-4121-ad24-3a8597e3d8a1-kube-api-access-mqxvw\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.137833 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.137601 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-oauth-serving-cert\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.137833 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.137686 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-serving-cert\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.137833 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.137723 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-oauth-config\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.137833 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.137780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/407d5dae-eeae-4036-9e7b-c2b746c77b54-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hstgx\" (UID: \"407d5dae-eeae-4036-9e7b-c2b746c77b54\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hstgx" Jul 22 02:17:56.137833 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.137808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gjf5\" (UniqueName: \"kubernetes.io/projected/407d5dae-eeae-4036-9e7b-c2b746c77b54-kube-api-access-8gjf5\") pod \"monitoring-plugin-7b7b7bc8bf-hstgx\" (UID: \"407d5dae-eeae-4036-9e7b-c2b746c77b54\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hstgx" Jul 22 02:17:56.138038 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.137872 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-service-ca\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.138038 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.137905 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-trusted-ca-bundle\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.142452 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.142425 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/407d5dae-eeae-4036-9e7b-c2b746c77b54-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-hstgx\" (UID: \"407d5dae-eeae-4036-9e7b-c2b746c77b54\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hstgx" Jul 22 02:17:56.146000 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.145977 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gjf5\" (UniqueName: \"kubernetes.io/projected/407d5dae-eeae-4036-9e7b-c2b746c77b54-kube-api-access-8gjf5\") pod \"monitoring-plugin-7b7b7bc8bf-hstgx\" (UID: \"407d5dae-eeae-4036-9e7b-c2b746c77b54\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hstgx" Jul 22 02:17:56.229612 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.229576 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hstgx" Jul 22 02:17:56.238887 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.238855 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-oauth-serving-cert\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.239029 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.238909 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-serving-cert\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.239029 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.238938 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-oauth-config\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.239029 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.239001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-service-ca\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.239029 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.239028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-trusted-ca-bundle\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.239227 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.239057 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-config\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.239227 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.239097 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqxvw\" (UniqueName: \"kubernetes.io/projected/47ceb614-61f6-4121-ad24-3a8597e3d8a1-kube-api-access-mqxvw\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.239741 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.239710 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-oauth-serving-cert\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.239872 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.239814 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-service-ca\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.239931 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.239901 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-config\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.240005 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.239986 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-trusted-ca-bundle\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.241654 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.241626 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-oauth-config\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.241804 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.241785 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-serving-cert\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.247784 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.247721 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqxvw\" (UniqueName: \"kubernetes.io/projected/47ceb614-61f6-4121-ad24-3a8597e3d8a1-kube-api-access-mqxvw\") pod \"console-656d6f7bf-8tv94\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.299945 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.299908 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:17:56.618198 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.618150 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-656d6f7bf-8tv94"] Jul 22 02:17:56.630925 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.630851 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-645645cc5f-gk29n"] Jul 22 02:17:56.637730 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:17:56.637687 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f51ddc_0ee9_433e_975f_062415fb6633.slice/crio-523ad630190579752fe9e90a2bf67c7a8d637277750de76f4e18a3bf9b7746f3 WatchSource:0}: Error finding container 523ad630190579752fe9e90a2bf67c7a8d637277750de76f4e18a3bf9b7746f3: Status 404 returned error can't find the container with id 523ad630190579752fe9e90a2bf67c7a8d637277750de76f4e18a3bf9b7746f3 Jul 22 02:17:56.654597 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.654399 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hstgx"] Jul 22 02:17:56.673191 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.673009 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" event={"ID":"28f51ddc-0ee9-433e-975f-062415fb6633","Type":"ContainerStarted","Data":"523ad630190579752fe9e90a2bf67c7a8d637277750de76f4e18a3bf9b7746f3"} Jul 22 02:17:56.680003 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.679900 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656d6f7bf-8tv94" event={"ID":"47ceb614-61f6-4121-ad24-3a8597e3d8a1","Type":"ContainerStarted","Data":"c277baf084da126af67802c86112e190545c1eac0ba66db5e6b145b7a4e67a33"} Jul 22 02:17:56.686584 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.686475 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hstgx" event={"ID":"407d5dae-eeae-4036-9e7b-c2b746c77b54","Type":"ContainerStarted","Data":"8fe1660dff85642186f8851067c9e0aa9346f968c6c97a06664ddedd569524a1"} Jul 22 02:17:56.695735 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.695674 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" event={"ID":"40aa0309-b8b4-4ef4-a101-2eab224d8109","Type":"ContainerStarted","Data":"b711620eec376ad8edb4676091233747201e3cf5da63b9541440b2e613136bb0"} Jul 22 02:17:56.698015 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.697961 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dkjcx" event={"ID":"dbc1cdb0-18c6-4606-8e83-27396ad3388e","Type":"ContainerStarted","Data":"6d271d7d66302bbe13ddbc542dc3a16ac02ca2ffb38ef64cca37603d268c6d3e"} Jul 22 02:17:56.698810 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.698326 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:17:56.700839 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.700715 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fb5pc" event={"ID":"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29","Type":"ContainerStarted","Data":"d2df9787da2d024c0adfbd07d224e9954c3452efa6930753cf6b326f264db832"} Jul 22 02:17:56.706074 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.705575 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5x227" event={"ID":"00c60860-7a47-4782-9bc3-35d8a634cd22","Type":"ContainerStarted","Data":"d05471938660685316615368cc22df53eccf6ea53cbd1867031e3e9c2e2f14b7"} Jul 22 02:17:56.709442 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.709401 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" event={"ID":"40203506-f9ca-4153-acfb-8bc7e16a9750","Type":"ContainerStarted","Data":"82684d9a2392d9b9a57b50faf4c5fd0a04462aeec171c72e05dd3920f487ed77"} Jul 22 02:17:56.739718 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.739651 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dkjcx" podStartSLOduration=67.462149618 podStartE2EDuration="1m12.739628782s" totalImagesPullingTime="5.277479164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:56.717944179 +0000 UTC m=+72.969505672" watchObservedRunningTime="2026-07-22 02:17:56.739628782 +0000 UTC m=+72.991190280" Jul 22 02:17:56.749149 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.749088 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:56.755017 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.754894 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5x227" podStartSLOduration=67.448502818 podStartE2EDuration="1m12.754876185s" totalImagesPullingTime="5.306373367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:56.752937905 +0000 UTC m=+73.004499397" watchObservedRunningTime="2026-07-22 02:17:56.754876185 +0000 UTC m=+73.006437679" Jul 22 02:17:56.848860 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.848823 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:56.948467 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:56.948357 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:57.320834 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.320733 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:57.325639 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.325584 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-28v75" podStartSLOduration=1.766245097 podStartE2EDuration="6.325568493s" totalImagesPullingTime="4.559323396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:56.77446823 +0000 UTC m=+73.026029723" watchObservedRunningTime="2026-07-22 02:17:57.325568493 +0000 UTC m=+73.577129985" Jul 22 02:17:57.326591 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.326566 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 02:17:57.331961 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.331934 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.334874 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.334623 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2wgcx\"" Jul 22 02:17:57.334874 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.334872 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 22 02:17:57.335196 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.335044 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 22 02:17:57.335196 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.335037 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 22 02:17:57.335196 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.335131 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 22 02:17:57.335470 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.335453 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 22 02:17:57.335548 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.335533 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 22 02:17:57.335603 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.335573 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 22 02:17:57.336121 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.336104 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 22 02:17:57.336450 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.336432 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 22 02:17:57.339341 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.337053 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 22 02:17:57.339675 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.339658 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f1di5ihtrpje6\"" Jul 22 02:17:57.348933 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.340289 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 22 02:17:57.348933 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.340496 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 22 02:17:57.348933 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.340734 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 22 02:17:57.348933 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.343506 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 22 02:17:57.348933 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.348741 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 02:17:57.453143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.453143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452321 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.453143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452348 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.453143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452384 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.453143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.453143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452466 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.453143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452493 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.453143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452538 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8v5k\" (UniqueName: \"kubernetes.io/projected/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-kube-api-access-q8v5k\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.453143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452567 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.453143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452604 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.453143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452629 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-config\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.453143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452652 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.453143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452693 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.453143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.453143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452775 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-web-config\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.453143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452801 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.454066 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452852 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-config-out\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.454066 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452876 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.454066 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452916 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.454066 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.452946 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.495086 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.494995 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:57.553607 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.553567 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.553845 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.553615 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.553845 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.553641 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.553845 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.553669 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.553845 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.553710 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8v5k\" (UniqueName: \"kubernetes.io/projected/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-kube-api-access-q8v5k\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.553845 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.553734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.553845 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.553774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.553845 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.553805 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-config\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.553845 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.553830 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.554256 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.553853 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.554256 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.553883 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.554256 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.553905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-web-config\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.554256 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.553931 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.554256 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.553980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-config-out\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.554256 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.554005 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.554256 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.554042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.554256 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.554072 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.554256 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.554099 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.554256 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.554128 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.554256 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.554153 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.555932 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.555480 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.556112 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.556081 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.556831 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.556435 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.558511 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.557966 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.558956 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.558907 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.559458 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.559431 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.560058 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.560031 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.560268 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.560206 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.564187 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.564040 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.565642 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.565566 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-web-config\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.567962 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.567442 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8v5k\" (UniqueName: \"kubernetes.io/projected/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-kube-api-access-q8v5k\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.567962 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.567806 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.567962 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.567922 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.568344 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.568283 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.568778 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.568656 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.569004 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.568947 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.569100 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.569061 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-config-out\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.569640 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.569541 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-config\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.570220 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.570139 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.571739 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.571666 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.573655 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.573628 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:57.656968 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.656782 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:17:57.717325 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.717238 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" event={"ID":"40aa0309-b8b4-4ef4-a101-2eab224d8109","Type":"ContainerStarted","Data":"cbe51c657dac25c04d3f3ce1d6c9aa1a52814ab34fc44f3bc26a2a78a5345c23"} Jul 22 02:17:57.717325 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.717317 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" event={"ID":"40aa0309-b8b4-4ef4-a101-2eab224d8109","Type":"ContainerStarted","Data":"4ca266835c172d64e0cde25264922eb403472a2d21e4745c7cdc93ac5ed3ac78"} Jul 22 02:17:57.719913 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.719880 2579 generic.go:356] "Generic (PLEG): container finished" podID="f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29" containerID="d2df9787da2d024c0adfbd07d224e9954c3452efa6930753cf6b326f264db832" exitCode=0 Jul 22 02:17:57.720050 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.719979 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fb5pc" event={"ID":"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29","Type":"ContainerDied","Data":"d2df9787da2d024c0adfbd07d224e9954c3452efa6930753cf6b326f264db832"} Jul 22 02:17:57.731596 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.731562 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656d6f7bf-8tv94" event={"ID":"47ceb614-61f6-4121-ad24-3a8597e3d8a1","Type":"ContainerStarted","Data":"5e2f002ab6d9123e17e94afb40d42b7a6ac5c0879cf07273f982c43181aadbf1"} Jul 22 02:17:57.803270 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.802950 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-5mshl" podStartSLOduration=2.059957725 podStartE2EDuration="6.802929447s" totalImagesPullingTime="4.742971722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:57.757685263 +0000 UTC m=+74.009246756" watchObservedRunningTime="2026-07-22 02:17:57.802929447 +0000 UTC m=+74.054490940" Jul 22 02:17:57.803270 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.803096 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-656d6f7bf-8tv94" podStartSLOduration=2.803088245 podStartE2EDuration="2.803088245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:57.801768474 +0000 UTC m=+74.053329981" watchObservedRunningTime="2026-07-22 02:17:57.803088245 +0000 UTC m=+74.054649717" Jul 22 02:17:57.837789 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:57.837647 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 02:17:58.086538 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:17:58.086500 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ef18c3_ff7d_48b9_a05a_ab496ee4af6c.slice/crio-3ec8c8d587ff8309140cd3881e4c2f46f42c0bb9c730dbe397219e2b420400a5 WatchSource:0}: Error finding container 3ec8c8d587ff8309140cd3881e4c2f46f42c0bb9c730dbe397219e2b420400a5: Status 404 returned error can't find the container with id 3ec8c8d587ff8309140cd3881e4c2f46f42c0bb9c730dbe397219e2b420400a5 Jul 22 02:17:58.247818 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:58.247778 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:58.345110 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:58.345022 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:58.738655 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:58.738621 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c","Type":"ContainerStarted","Data":"3ec8c8d587ff8309140cd3881e4c2f46f42c0bb9c730dbe397219e2b420400a5"} Jul 22 02:17:58.740659 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:58.740633 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fb5pc" event={"ID":"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29","Type":"ContainerStarted","Data":"f4d78272b917337b261a953396b8d8bdd73b05b035906a97779025bcc3c0769e"} Jul 22 02:17:58.742200 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:58.742175 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" event={"ID":"28f51ddc-0ee9-433e-975f-062415fb6633","Type":"ContainerStarted","Data":"d4077bf0e91e4e3f07de3c48830fb8d5d4ecbfb26effcc2c272691fd9ad3da3b"} Jul 22 02:17:58.745060 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:58.745007 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hstgx" event={"ID":"407d5dae-eeae-4036-9e7b-c2b746c77b54","Type":"ContainerStarted","Data":"a4152f03407b18f2c80c5d39c72975abd95d4abc138e9ddff126e87bc58832d0"} Jul 22 02:17:58.745664 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:58.745644 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hstgx" Jul 22 02:17:58.751818 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:58.751795 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hstgx" Jul 22 02:17:58.775929 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:58.775847 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" podStartSLOduration=1.818674321 podStartE2EDuration="3.775809801s" totalImagesPullingTime="1.95713548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:58.760835862 +0000 UTC m=+75.012397356" watchObservedRunningTime="2026-07-22 02:17:58.775809801 +0000 UTC m=+75.027371292" Jul 22 02:17:58.777119 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:58.777073 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-hstgx" podStartSLOduration=1.85139056 podStartE2EDuration="3.777057866s" totalImagesPullingTime="1.925667306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:58.775542109 +0000 UTC m=+75.027103605" watchObservedRunningTime="2026-07-22 02:17:58.777057866 +0000 UTC m=+75.028619360" Jul 22 02:17:59.668249 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:59.668145 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:59.741769 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:59.741727 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:59.750769 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:59.750722 2579 generic.go:356] "Generic (PLEG): container finished" podID="e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c" containerID="7445b58629219e07b059fea63674a89c81b559693142a9faec399417aae98545" exitCode=0 Jul 22 02:17:59.750903 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:59.750794 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c","Type":"ContainerDied","Data":"7445b58629219e07b059fea63674a89c81b559693142a9faec399417aae98545"} Jul 22 02:17:59.756797 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:59.756766 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fb5pc" event={"ID":"f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29","Type":"ContainerStarted","Data":"6a71c618267e6e474f9bf1d690e4bc1e9d02944de7cac0c1e202ebb3e521a64e"} Jul 22 02:17:59.802156 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:17:59.802090 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fb5pc" podStartSLOduration=3.8265479 podStartE2EDuration="8.80207539s" totalImagesPullingTime="4.843931554s" totalInitContainerRuntime="131.595936ms" isStatefulPod=true podCreationTimestamp="2026-07-22 02:17:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:59.801009986 +0000 UTC m=+76.052571492" watchObservedRunningTime="2026-07-22 02:17:59.80207539 +0000 UTC m=+76.053636882" Jul 22 02:18:00.121717 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:00.121681 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:00.181890 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:00.181859 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:01.099374 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:01.099341 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:03.781049 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:03.781009 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c","Type":"ContainerStarted","Data":"701470783c19ae7a3897b1a649838d41a4a83fd90e87eb1198b7cdb28aafd9c3"} Jul 22 02:18:03.781448 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:03.781113 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c","Type":"ContainerStarted","Data":"5030ec49cc2df7e97209f4f6a03520fa0a3999ba83955045984ea444993006ce"} Jul 22 02:18:05.791930 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:05.791895 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c","Type":"ContainerStarted","Data":"c963f538f37215ab5cd1e17930fb8d38b343d89f497a4f2f78f263ad190f58c8"} Jul 22 02:18:05.792309 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:05.791959 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c","Type":"ContainerStarted","Data":"2f4e1866aacf9c21899a65aa98d73c0dd8c5f341b668786d1f7220dc34a49a85"} Jul 22 02:18:05.792309 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:05.791986 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c","Type":"ContainerStarted","Data":"3706210c1c1ef27e4246d10d6368072795f457b1311bfc3be1f38796b5239269"} Jul 22 02:18:05.792309 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:05.792013 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c","Type":"ContainerStarted","Data":"a552229d7d71b34a97905d565ea128409f5baa9b3a2656a290072dc337dda4e4"} Jul 22 02:18:05.849113 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:05.849055 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.672193466 podStartE2EDuration="8.849034279s" totalImagesPullingTime="6.157094907s" totalInitContainerRuntime="19.745906ms" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:18:05.847063844 +0000 UTC m=+82.098625336" watchObservedRunningTime="2026-07-22 02:18:05.849034279 +0000 UTC m=+82.100595771" Jul 22 02:18:05.878975 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:05.878943 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:05.953433 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:05.953404 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:06.300632 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:06.300599 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:18:06.300826 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:06.300693 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:18:06.305103 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:06.305079 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:18:06.799423 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:06.799391 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:18:06.969342 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:06.969309 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:07.070956 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:07.070925 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:07.170279 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:07.170247 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:07.349813 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:07.349719 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:07.451554 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:07.451522 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:07.657953 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:07.657861 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:18:14.666172 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:14.666136 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:14.724423 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:14.724392 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:15.861671 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:15.861644 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:18:15.862060 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:15.861706 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:18:20.983182 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:20.983117 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d9b7c9c99-z9cln" podUID="70579a7f-a5f4-46db-b464-da291b3814a5" containerName="console" containerID="cri-o://23ffabcdda0912100a0c0fea7776ae198091feb85ebc2bd397e908ac38d27262" gracePeriod=15 Jul 22 02:18:21.770425 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.770395 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:18:21.851843 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.851810 2579 generic.go:356] "Generic (PLEG): container finished" podID="70579a7f-a5f4-46db-b464-da291b3814a5" containerID="23ffabcdda0912100a0c0fea7776ae198091feb85ebc2bd397e908ac38d27262" exitCode=0 Jul 22 02:18:21.852001 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.851850 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9b7c9c99-z9cln" Jul 22 02:18:21.852001 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.851863 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9b7c9c99-z9cln" event={"ID":"70579a7f-a5f4-46db-b464-da291b3814a5","Type":"ContainerDied","Data":"23ffabcdda0912100a0c0fea7776ae198091feb85ebc2bd397e908ac38d27262"} Jul 22 02:18:21.852001 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.851903 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9b7c9c99-z9cln" event={"ID":"70579a7f-a5f4-46db-b464-da291b3814a5","Type":"ContainerDied","Data":"61464b7ec0eea964ace866cdbcc4fdcab3762bf0c182da92af6c8bb55573d102"} Jul 22 02:18:21.852001 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.851922 2579 scope.go:117] "RemoveContainer" containerID="23ffabcdda0912100a0c0fea7776ae198091feb85ebc2bd397e908ac38d27262" Jul 22 02:18:21.859819 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.859801 2579 scope.go:117] "RemoveContainer" containerID="23ffabcdda0912100a0c0fea7776ae198091feb85ebc2bd397e908ac38d27262" Jul 22 02:18:21.860085 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:18:21.860062 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23ffabcdda0912100a0c0fea7776ae198091feb85ebc2bd397e908ac38d27262\": container with ID starting with 23ffabcdda0912100a0c0fea7776ae198091feb85ebc2bd397e908ac38d27262 not found: ID does not exist" containerID="23ffabcdda0912100a0c0fea7776ae198091feb85ebc2bd397e908ac38d27262" Jul 22 02:18:21.860134 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.860094 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23ffabcdda0912100a0c0fea7776ae198091feb85ebc2bd397e908ac38d27262"} err="failed to get container status \"23ffabcdda0912100a0c0fea7776ae198091feb85ebc2bd397e908ac38d27262\": rpc error: code = NotFound desc = could not find container \"23ffabcdda0912100a0c0fea7776ae198091feb85ebc2bd397e908ac38d27262\": container with ID starting with 23ffabcdda0912100a0c0fea7776ae198091feb85ebc2bd397e908ac38d27262 not found: ID does not exist" Jul 22 02:18:21.865654 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.865636 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70579a7f-a5f4-46db-b464-da291b3814a5-console-serving-cert\") pod \"70579a7f-a5f4-46db-b464-da291b3814a5\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " Jul 22 02:18:21.865766 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.865691 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-trusted-ca-bundle\") pod \"70579a7f-a5f4-46db-b464-da291b3814a5\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " Jul 22 02:18:21.865766 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.865721 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-service-ca\") pod \"70579a7f-a5f4-46db-b464-da291b3814a5\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " Jul 22 02:18:21.865886 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.865780 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70579a7f-a5f4-46db-b464-da291b3814a5-console-oauth-config\") pod \"70579a7f-a5f4-46db-b464-da291b3814a5\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " Jul 22 02:18:21.865886 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.865834 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7qp6\" (UniqueName: \"kubernetes.io/projected/70579a7f-a5f4-46db-b464-da291b3814a5-kube-api-access-r7qp6\") pod \"70579a7f-a5f4-46db-b464-da291b3814a5\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " Jul 22 02:18:21.865886 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.865867 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-console-config\") pod \"70579a7f-a5f4-46db-b464-da291b3814a5\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " Jul 22 02:18:21.866021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.865899 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-oauth-serving-cert\") pod \"70579a7f-a5f4-46db-b464-da291b3814a5\" (UID: \"70579a7f-a5f4-46db-b464-da291b3814a5\") " Jul 22 02:18:21.866159 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.866127 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-service-ca" (OuterVolumeSpecName: "service-ca") pod "70579a7f-a5f4-46db-b464-da291b3814a5" (UID: "70579a7f-a5f4-46db-b464-da291b3814a5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:18:21.866262 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.866139 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "70579a7f-a5f4-46db-b464-da291b3814a5" (UID: "70579a7f-a5f4-46db-b464-da291b3814a5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:18:21.866324 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.866301 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "70579a7f-a5f4-46db-b464-da291b3814a5" (UID: "70579a7f-a5f4-46db-b464-da291b3814a5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:18:21.866521 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.866499 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-console-config" (OuterVolumeSpecName: "console-config") pod "70579a7f-a5f4-46db-b464-da291b3814a5" (UID: "70579a7f-a5f4-46db-b464-da291b3814a5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:18:21.868035 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.868013 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70579a7f-a5f4-46db-b464-da291b3814a5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "70579a7f-a5f4-46db-b464-da291b3814a5" (UID: "70579a7f-a5f4-46db-b464-da291b3814a5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:18:21.868324 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.868304 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70579a7f-a5f4-46db-b464-da291b3814a5-kube-api-access-r7qp6" (OuterVolumeSpecName: "kube-api-access-r7qp6") pod "70579a7f-a5f4-46db-b464-da291b3814a5" (UID: "70579a7f-a5f4-46db-b464-da291b3814a5"). InnerVolumeSpecName "kube-api-access-r7qp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:18:21.868388 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.868320 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70579a7f-a5f4-46db-b464-da291b3814a5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "70579a7f-a5f4-46db-b464-da291b3814a5" (UID: "70579a7f-a5f4-46db-b464-da291b3814a5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:18:21.967350 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.967280 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70579a7f-a5f4-46db-b464-da291b3814a5-console-oauth-config\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:18:21.967350 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.967309 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7qp6\" (UniqueName: \"kubernetes.io/projected/70579a7f-a5f4-46db-b464-da291b3814a5-kube-api-access-r7qp6\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:18:21.967350 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.967324 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-console-config\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:18:21.967350 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.967336 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-oauth-serving-cert\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:18:21.967350 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.967348 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70579a7f-a5f4-46db-b464-da291b3814a5-console-serving-cert\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:18:21.967571 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.967361 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-trusted-ca-bundle\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:18:21.967571 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:21.967372 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70579a7f-a5f4-46db-b464-da291b3814a5-service-ca\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:18:22.176006 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:22.175977 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d9b7c9c99-z9cln"] Jul 22 02:18:22.179950 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:22.179928 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d9b7c9c99-z9cln"] Jul 22 02:18:22.345858 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:22.345830 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70579a7f-a5f4-46db-b464-da291b3814a5" path="/var/lib/kubelet/pods/70579a7f-a5f4-46db-b464-da291b3814a5/volumes" Jul 22 02:18:27.734293 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:27.734262 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dkjcx" Jul 22 02:18:29.660068 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:29.660029 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:29.730234 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:29.730204 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:35.866524 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:35.866496 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:18:35.870933 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:35.870910 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-645645cc5f-gk29n" Jul 22 02:18:38.265066 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:38.265025 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:38.366021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:38.365981 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:38.435377 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:38.435345 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:18:57.658126 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:57.658089 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:18:57.676811 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:57.676769 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:18:57.995981 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:18:57.995908 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 02:19:10.350302 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:19:10.350264 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:10.731521 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:19:10.731421 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:18.764953 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:19:18.764921 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:25.593069 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:19:25.593033 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:25.668280 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:19:25.668246 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:27.600891 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:19:27.600863 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:28.205177 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:19:28.205148 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:28.264545 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:19:28.264518 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:37.564985 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:19:37.564905 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:37.623387 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:19:37.623361 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:38.120980 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:19:38.120943 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-656d6f7bf-8tv94"] Jul 22 02:19:38.250478 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:19:38.250443 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:38.351063 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:19:38.351008 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:38.418079 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:19:38.417993 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:44.670572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:19:44.670532 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:19:44.771251 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:19:44.771217 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:20:03.146953 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.146889 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-656d6f7bf-8tv94" podUID="47ceb614-61f6-4121-ad24-3a8597e3d8a1" containerName="console" containerID="cri-o://5e2f002ab6d9123e17e94afb40d42b7a6ac5c0879cf07273f982c43181aadbf1" gracePeriod=15 Jul 22 02:20:03.384508 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.384485 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:20:03.494911 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.494813 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-config\") pod \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " Jul 22 02:20:03.494911 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.494865 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-serving-cert\") pod \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " Jul 22 02:20:03.494911 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.494892 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqxvw\" (UniqueName: \"kubernetes.io/projected/47ceb614-61f6-4121-ad24-3a8597e3d8a1-kube-api-access-mqxvw\") pod \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " Jul 22 02:20:03.494911 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.494913 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-oauth-serving-cert\") pod \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " Jul 22 02:20:03.495236 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.494943 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-trusted-ca-bundle\") pod \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " Jul 22 02:20:03.495236 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.494962 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-oauth-config\") pod \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " Jul 22 02:20:03.495236 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.495022 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-service-ca\") pod \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\" (UID: \"47ceb614-61f6-4121-ad24-3a8597e3d8a1\") " Jul 22 02:20:03.495382 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.495325 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-config" (OuterVolumeSpecName: "console-config") pod "47ceb614-61f6-4121-ad24-3a8597e3d8a1" (UID: "47ceb614-61f6-4121-ad24-3a8597e3d8a1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:20:03.495382 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.495341 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "47ceb614-61f6-4121-ad24-3a8597e3d8a1" (UID: "47ceb614-61f6-4121-ad24-3a8597e3d8a1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:20:03.495554 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.495536 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-service-ca" (OuterVolumeSpecName: "service-ca") pod "47ceb614-61f6-4121-ad24-3a8597e3d8a1" (UID: "47ceb614-61f6-4121-ad24-3a8597e3d8a1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:20:03.495618 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.495580 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "47ceb614-61f6-4121-ad24-3a8597e3d8a1" (UID: "47ceb614-61f6-4121-ad24-3a8597e3d8a1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:20:03.497304 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.497275 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "47ceb614-61f6-4121-ad24-3a8597e3d8a1" (UID: "47ceb614-61f6-4121-ad24-3a8597e3d8a1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:20:03.497625 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.497599 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47ceb614-61f6-4121-ad24-3a8597e3d8a1-kube-api-access-mqxvw" (OuterVolumeSpecName: "kube-api-access-mqxvw") pod "47ceb614-61f6-4121-ad24-3a8597e3d8a1" (UID: "47ceb614-61f6-4121-ad24-3a8597e3d8a1"). InnerVolumeSpecName "kube-api-access-mqxvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:20:03.497625 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.497618 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "47ceb614-61f6-4121-ad24-3a8597e3d8a1" (UID: "47ceb614-61f6-4121-ad24-3a8597e3d8a1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:20:03.596017 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.595984 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-service-ca\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:20:03.596017 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.596014 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-config\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:20:03.596017 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.596023 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-serving-cert\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:20:03.596247 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.596033 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqxvw\" (UniqueName: \"kubernetes.io/projected/47ceb614-61f6-4121-ad24-3a8597e3d8a1-kube-api-access-mqxvw\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:20:03.596247 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.596043 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-oauth-serving-cert\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:20:03.596247 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.596052 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47ceb614-61f6-4121-ad24-3a8597e3d8a1-trusted-ca-bundle\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:20:03.596247 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:03.596059 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47ceb614-61f6-4121-ad24-3a8597e3d8a1-console-oauth-config\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:20:04.231089 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:04.231057 2579 generic.go:356] "Generic (PLEG): container finished" podID="47ceb614-61f6-4121-ad24-3a8597e3d8a1" containerID="5e2f002ab6d9123e17e94afb40d42b7a6ac5c0879cf07273f982c43181aadbf1" exitCode=0 Jul 22 02:20:04.231526 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:04.231099 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656d6f7bf-8tv94" event={"ID":"47ceb614-61f6-4121-ad24-3a8597e3d8a1","Type":"ContainerDied","Data":"5e2f002ab6d9123e17e94afb40d42b7a6ac5c0879cf07273f982c43181aadbf1"} Jul 22 02:20:04.231526 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:04.231107 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-656d6f7bf-8tv94" Jul 22 02:20:04.231526 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:04.231136 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-656d6f7bf-8tv94" event={"ID":"47ceb614-61f6-4121-ad24-3a8597e3d8a1","Type":"ContainerDied","Data":"c277baf084da126af67802c86112e190545c1eac0ba66db5e6b145b7a4e67a33"} Jul 22 02:20:04.231526 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:04.231156 2579 scope.go:117] "RemoveContainer" containerID="5e2f002ab6d9123e17e94afb40d42b7a6ac5c0879cf07273f982c43181aadbf1" Jul 22 02:20:04.239708 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:04.239689 2579 scope.go:117] "RemoveContainer" containerID="5e2f002ab6d9123e17e94afb40d42b7a6ac5c0879cf07273f982c43181aadbf1" Jul 22 02:20:04.239990 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:20:04.239971 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e2f002ab6d9123e17e94afb40d42b7a6ac5c0879cf07273f982c43181aadbf1\": container with ID starting with 5e2f002ab6d9123e17e94afb40d42b7a6ac5c0879cf07273f982c43181aadbf1 not found: ID does not exist" containerID="5e2f002ab6d9123e17e94afb40d42b7a6ac5c0879cf07273f982c43181aadbf1" Jul 22 02:20:04.240040 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:04.239998 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e2f002ab6d9123e17e94afb40d42b7a6ac5c0879cf07273f982c43181aadbf1"} err="failed to get container status \"5e2f002ab6d9123e17e94afb40d42b7a6ac5c0879cf07273f982c43181aadbf1\": rpc error: code = NotFound desc = could not find container \"5e2f002ab6d9123e17e94afb40d42b7a6ac5c0879cf07273f982c43181aadbf1\": container with ID starting with 5e2f002ab6d9123e17e94afb40d42b7a6ac5c0879cf07273f982c43181aadbf1 not found: ID does not exist" Jul 22 02:20:04.252554 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:04.252531 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-656d6f7bf-8tv94"] Jul 22 02:20:04.255982 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:04.255962 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-656d6f7bf-8tv94"] Jul 22 02:20:04.346830 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:04.346802 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47ceb614-61f6-4121-ad24-3a8597e3d8a1" path="/var/lib/kubelet/pods/47ceb614-61f6-4121-ad24-3a8597e3d8a1/volumes" Jul 22 02:20:27.318092 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:27.318063 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:20:27.415654 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:27.415624 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:20:54.108005 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:54.107962 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:20:54.863089 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:54.863055 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:20:57.676872 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:57.676844 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:20:57.883934 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:57.883904 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:20:59.805848 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:59.805819 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:20:59.913767 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:20:59.913714 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:00.240627 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:00.240542 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:00.344845 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:00.344813 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:02.604524 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:02.604489 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:02.815582 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:02.815539 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:04.473206 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:04.473176 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:04.573927 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:04.573891 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:09.805147 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:09.805063 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:09.859228 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:09.859191 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:10.409267 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.409240 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:10.699284 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.699207 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rthn8"] Jul 22 02:21:10.699507 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.699493 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70579a7f-a5f4-46db-b464-da291b3814a5" containerName="console" Jul 22 02:21:10.699547 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.699508 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="70579a7f-a5f4-46db-b464-da291b3814a5" containerName="console" Jul 22 02:21:10.699547 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.699522 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47ceb614-61f6-4121-ad24-3a8597e3d8a1" containerName="console" Jul 22 02:21:10.699547 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.699530 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="47ceb614-61f6-4121-ad24-3a8597e3d8a1" containerName="console" Jul 22 02:21:10.699638 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.699582 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="70579a7f-a5f4-46db-b464-da291b3814a5" containerName="console" Jul 22 02:21:10.699638 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.699592 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="47ceb614-61f6-4121-ad24-3a8597e3d8a1" containerName="console" Jul 22 02:21:10.702380 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.702359 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rthn8" Jul 22 02:21:10.705259 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.705235 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 22 02:21:10.705862 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.705849 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-htlnf\"" Jul 22 02:21:10.705862 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.705855 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 22 02:21:10.712839 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.712818 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rthn8"] Jul 22 02:21:10.725718 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.725698 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/133a4dd5-3758-4afa-b440-9a1e61b85695-bound-sa-token\") pod \"cert-manager-55b4d954d5-rthn8\" (UID: \"133a4dd5-3758-4afa-b440-9a1e61b85695\") " pod="cert-manager/cert-manager-55b4d954d5-rthn8" Jul 22 02:21:10.725846 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.725731 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48l4j\" (UniqueName: \"kubernetes.io/projected/133a4dd5-3758-4afa-b440-9a1e61b85695-kube-api-access-48l4j\") pod \"cert-manager-55b4d954d5-rthn8\" (UID: \"133a4dd5-3758-4afa-b440-9a1e61b85695\") " pod="cert-manager/cert-manager-55b4d954d5-rthn8" Jul 22 02:21:10.826964 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.826930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/133a4dd5-3758-4afa-b440-9a1e61b85695-bound-sa-token\") pod \"cert-manager-55b4d954d5-rthn8\" (UID: \"133a4dd5-3758-4afa-b440-9a1e61b85695\") " pod="cert-manager/cert-manager-55b4d954d5-rthn8" Jul 22 02:21:10.826964 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.826970 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48l4j\" (UniqueName: \"kubernetes.io/projected/133a4dd5-3758-4afa-b440-9a1e61b85695-kube-api-access-48l4j\") pod \"cert-manager-55b4d954d5-rthn8\" (UID: \"133a4dd5-3758-4afa-b440-9a1e61b85695\") " pod="cert-manager/cert-manager-55b4d954d5-rthn8" Jul 22 02:21:10.837831 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.837804 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/133a4dd5-3758-4afa-b440-9a1e61b85695-bound-sa-token\") pod \"cert-manager-55b4d954d5-rthn8\" (UID: \"133a4dd5-3758-4afa-b440-9a1e61b85695\") " pod="cert-manager/cert-manager-55b4d954d5-rthn8" Jul 22 02:21:10.837952 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:10.837855 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48l4j\" (UniqueName: \"kubernetes.io/projected/133a4dd5-3758-4afa-b440-9a1e61b85695-kube-api-access-48l4j\") pod \"cert-manager-55b4d954d5-rthn8\" (UID: \"133a4dd5-3758-4afa-b440-9a1e61b85695\") " pod="cert-manager/cert-manager-55b4d954d5-rthn8" Jul 22 02:21:11.023063 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:11.022968 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rthn8" Jul 22 02:21:11.151518 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:11.151488 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rthn8"] Jul 22 02:21:11.154854 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:21:11.154821 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod133a4dd5_3758_4afa_b440_9a1e61b85695.slice/crio-a5e62e46be2253af63811252c5ac9b3ba9c641d4977c1dfee48ae2c2ecc61454 WatchSource:0}: Error finding container a5e62e46be2253af63811252c5ac9b3ba9c641d4977c1dfee48ae2c2ecc61454: Status 404 returned error can't find the container with id a5e62e46be2253af63811252c5ac9b3ba9c641d4977c1dfee48ae2c2ecc61454 Jul 22 02:21:11.474025 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:11.473994 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rthn8" event={"ID":"133a4dd5-3758-4afa-b440-9a1e61b85695","Type":"ContainerStarted","Data":"a5e62e46be2253af63811252c5ac9b3ba9c641d4977c1dfee48ae2c2ecc61454"} Jul 22 02:21:14.896027 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:14.895992 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:14.995913 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:14.995881 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:17.498031 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:17.497995 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rthn8" event={"ID":"133a4dd5-3758-4afa-b440-9a1e61b85695","Type":"ContainerStarted","Data":"c45200e2ef04ce7694b1d2a3b31839cb7d585638234525fe809ccb7b52cc197c"} Jul 22 02:21:17.515494 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:17.515441 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-rthn8" podStartSLOduration=1.770117242 podStartE2EDuration="7.515424952s" totalImagesPullingTime="5.74530771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:21:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:21:17.514243954 +0000 UTC m=+273.765805445" watchObservedRunningTime="2026-07-22 02:21:17.515424952 +0000 UTC m=+273.766986443" Jul 22 02:21:23.344813 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:23.344779 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:24.677969 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:24.677938 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:25.018445 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:25.018366 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:31.195074 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:31.195036 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:31.255206 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:31.255177 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:37.353904 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.353862 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:37.459243 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.459206 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d"] Jul 22 02:21:37.464550 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.464525 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" Jul 22 02:21:37.468279 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.468259 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 22 02:21:37.469323 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.469305 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 22 02:21:37.469323 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.469311 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5zfmq\"" Jul 22 02:21:37.469485 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.469326 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 22 02:21:37.469485 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.469305 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 22 02:21:37.469485 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.469366 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 22 02:21:37.475180 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.475157 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d"] Jul 22 02:21:37.501865 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.501828 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:37.538580 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.538551 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/198bb068-511a-4a0c-a9da-534dc47c26b9-cert\") pod \"lws-controller-manager-6c9bd579-2rd4d\" (UID: \"198bb068-511a-4a0c-a9da-534dc47c26b9\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" Jul 22 02:21:37.538735 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.538598 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/198bb068-511a-4a0c-a9da-534dc47c26b9-metrics-cert\") pod \"lws-controller-manager-6c9bd579-2rd4d\" (UID: \"198bb068-511a-4a0c-a9da-534dc47c26b9\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" Jul 22 02:21:37.538735 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.538624 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47z2n\" (UniqueName: \"kubernetes.io/projected/198bb068-511a-4a0c-a9da-534dc47c26b9-kube-api-access-47z2n\") pod \"lws-controller-manager-6c9bd579-2rd4d\" (UID: \"198bb068-511a-4a0c-a9da-534dc47c26b9\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" Jul 22 02:21:37.538735 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.538647 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/198bb068-511a-4a0c-a9da-534dc47c26b9-manager-config\") pod \"lws-controller-manager-6c9bd579-2rd4d\" (UID: \"198bb068-511a-4a0c-a9da-534dc47c26b9\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" Jul 22 02:21:37.639402 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.639321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/198bb068-511a-4a0c-a9da-534dc47c26b9-metrics-cert\") pod \"lws-controller-manager-6c9bd579-2rd4d\" (UID: \"198bb068-511a-4a0c-a9da-534dc47c26b9\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" Jul 22 02:21:37.639402 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.639363 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47z2n\" (UniqueName: \"kubernetes.io/projected/198bb068-511a-4a0c-a9da-534dc47c26b9-kube-api-access-47z2n\") pod \"lws-controller-manager-6c9bd579-2rd4d\" (UID: \"198bb068-511a-4a0c-a9da-534dc47c26b9\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" Jul 22 02:21:37.639402 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.639386 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/198bb068-511a-4a0c-a9da-534dc47c26b9-manager-config\") pod \"lws-controller-manager-6c9bd579-2rd4d\" (UID: \"198bb068-511a-4a0c-a9da-534dc47c26b9\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" Jul 22 02:21:37.639636 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.639421 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/198bb068-511a-4a0c-a9da-534dc47c26b9-cert\") pod \"lws-controller-manager-6c9bd579-2rd4d\" (UID: \"198bb068-511a-4a0c-a9da-534dc47c26b9\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" Jul 22 02:21:37.640220 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.640197 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/198bb068-511a-4a0c-a9da-534dc47c26b9-manager-config\") pod \"lws-controller-manager-6c9bd579-2rd4d\" (UID: \"198bb068-511a-4a0c-a9da-534dc47c26b9\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" Jul 22 02:21:37.641840 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.641821 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/198bb068-511a-4a0c-a9da-534dc47c26b9-cert\") pod \"lws-controller-manager-6c9bd579-2rd4d\" (UID: \"198bb068-511a-4a0c-a9da-534dc47c26b9\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" Jul 22 02:21:37.642006 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.641985 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/198bb068-511a-4a0c-a9da-534dc47c26b9-metrics-cert\") pod \"lws-controller-manager-6c9bd579-2rd4d\" (UID: \"198bb068-511a-4a0c-a9da-534dc47c26b9\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" Jul 22 02:21:37.653162 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.653143 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47z2n\" (UniqueName: \"kubernetes.io/projected/198bb068-511a-4a0c-a9da-534dc47c26b9-kube-api-access-47z2n\") pod \"lws-controller-manager-6c9bd579-2rd4d\" (UID: \"198bb068-511a-4a0c-a9da-534dc47c26b9\") " pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" Jul 22 02:21:37.774130 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.774092 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" Jul 22 02:21:37.914148 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.914125 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d"] Jul 22 02:21:37.916408 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:21:37.916381 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod198bb068_511a_4a0c_a9da_534dc47c26b9.slice/crio-0cebd94d6395d5f256f2ca6f42c1766f8e6712fc36f51c4fea1ba5b86885262a WatchSource:0}: Error finding container 0cebd94d6395d5f256f2ca6f42c1766f8e6712fc36f51c4fea1ba5b86885262a: Status 404 returned error can't find the container with id 0cebd94d6395d5f256f2ca6f42c1766f8e6712fc36f51c4fea1ba5b86885262a Jul 22 02:21:37.937927 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:37.937892 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:38.043397 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:38.043362 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:38.527066 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:38.527028 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:38.575855 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:38.575815 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" event={"ID":"198bb068-511a-4a0c-a9da-534dc47c26b9","Type":"ContainerStarted","Data":"0cebd94d6395d5f256f2ca6f42c1766f8e6712fc36f51c4fea1ba5b86885262a"} Jul 22 02:21:38.904238 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:38.904191 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:39.037773 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.037705 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:39.059656 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.059626 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms"] Jul 22 02:21:39.063365 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.063336 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:39.066590 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.066563 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 22 02:21:39.066985 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.066946 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 22 02:21:39.067119 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.067011 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 22 02:21:39.067119 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.067058 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 22 02:21:39.067256 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.067234 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5fjrz\"" Jul 22 02:21:39.085178 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.085103 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms"] Jul 22 02:21:39.156098 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.156016 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/442c25fa-c730-4b9f-abed-8e4cc9474e89-webhook-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-4nkms\" (UID: \"442c25fa-c730-4b9f-abed-8e4cc9474e89\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:39.156098 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.156056 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg6rf\" (UniqueName: \"kubernetes.io/projected/442c25fa-c730-4b9f-abed-8e4cc9474e89-kube-api-access-qg6rf\") pod \"opendatahub-operator-controller-manager-57f477d5fd-4nkms\" (UID: \"442c25fa-c730-4b9f-abed-8e4cc9474e89\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:39.156098 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.156084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/442c25fa-c730-4b9f-abed-8e4cc9474e89-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-4nkms\" (UID: \"442c25fa-c730-4b9f-abed-8e4cc9474e89\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:39.156365 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.156170 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/442c25fa-c730-4b9f-abed-8e4cc9474e89-manifests\") pod \"opendatahub-operator-controller-manager-57f477d5fd-4nkms\" (UID: \"442c25fa-c730-4b9f-abed-8e4cc9474e89\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:39.156365 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.156218 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/442c25fa-c730-4b9f-abed-8e4cc9474e89-tmp\") pod \"opendatahub-operator-controller-manager-57f477d5fd-4nkms\" (UID: \"442c25fa-c730-4b9f-abed-8e4cc9474e89\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:39.208384 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.208349 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:39.257137 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.257094 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/442c25fa-c730-4b9f-abed-8e4cc9474e89-manifests\") pod \"opendatahub-operator-controller-manager-57f477d5fd-4nkms\" (UID: \"442c25fa-c730-4b9f-abed-8e4cc9474e89\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:39.257306 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.257160 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/442c25fa-c730-4b9f-abed-8e4cc9474e89-tmp\") pod \"opendatahub-operator-controller-manager-57f477d5fd-4nkms\" (UID: \"442c25fa-c730-4b9f-abed-8e4cc9474e89\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:39.257306 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.257210 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/442c25fa-c730-4b9f-abed-8e4cc9474e89-webhook-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-4nkms\" (UID: \"442c25fa-c730-4b9f-abed-8e4cc9474e89\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:39.257306 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.257230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg6rf\" (UniqueName: \"kubernetes.io/projected/442c25fa-c730-4b9f-abed-8e4cc9474e89-kube-api-access-qg6rf\") pod \"opendatahub-operator-controller-manager-57f477d5fd-4nkms\" (UID: \"442c25fa-c730-4b9f-abed-8e4cc9474e89\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:39.257488 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.257379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/442c25fa-c730-4b9f-abed-8e4cc9474e89-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-4nkms\" (UID: \"442c25fa-c730-4b9f-abed-8e4cc9474e89\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:39.257564 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.257549 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/442c25fa-c730-4b9f-abed-8e4cc9474e89-manifests\") pod \"opendatahub-operator-controller-manager-57f477d5fd-4nkms\" (UID: \"442c25fa-c730-4b9f-abed-8e4cc9474e89\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:39.260031 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.260007 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/442c25fa-c730-4b9f-abed-8e4cc9474e89-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-4nkms\" (UID: \"442c25fa-c730-4b9f-abed-8e4cc9474e89\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:39.260169 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.260080 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/442c25fa-c730-4b9f-abed-8e4cc9474e89-tmp\") pod \"opendatahub-operator-controller-manager-57f477d5fd-4nkms\" (UID: \"442c25fa-c730-4b9f-abed-8e4cc9474e89\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:39.260169 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.260097 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/442c25fa-c730-4b9f-abed-8e4cc9474e89-webhook-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-4nkms\" (UID: \"442c25fa-c730-4b9f-abed-8e4cc9474e89\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:39.272194 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.272168 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg6rf\" (UniqueName: \"kubernetes.io/projected/442c25fa-c730-4b9f-abed-8e4cc9474e89-kube-api-access-qg6rf\") pod \"opendatahub-operator-controller-manager-57f477d5fd-4nkms\" (UID: \"442c25fa-c730-4b9f-abed-8e4cc9474e89\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:39.306175 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.306119 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:39.378183 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.378145 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:39.407530 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.407454 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:39.525140 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.525106 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:39.611358 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.611315 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:39.711713 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.711632 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:39.827922 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:39.827878 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:40.399762 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:40.399721 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms"] Jul 22 02:21:40.403421 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:21:40.403388 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442c25fa_c730_4b9f_abed_8e4cc9474e89.slice/crio-26697a1ad413af4498c07067fcf52083f26dafbd8552389d9da4eaa10fbe8194 WatchSource:0}: Error finding container 26697a1ad413af4498c07067fcf52083f26dafbd8552389d9da4eaa10fbe8194: Status 404 returned error can't find the container with id 26697a1ad413af4498c07067fcf52083f26dafbd8552389d9da4eaa10fbe8194 Jul 22 02:21:40.585373 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:40.585330 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" event={"ID":"442c25fa-c730-4b9f-abed-8e4cc9474e89","Type":"ContainerStarted","Data":"26697a1ad413af4498c07067fcf52083f26dafbd8552389d9da4eaa10fbe8194"} Jul 22 02:21:40.586687 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:40.586660 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" event={"ID":"198bb068-511a-4a0c-a9da-534dc47c26b9","Type":"ContainerStarted","Data":"5bc16442deb952c5581903e7cb6b361249dd2545d0d61e0cdc8f8188b532b44e"} Jul 22 02:21:40.586826 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:40.586800 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" Jul 22 02:21:40.606553 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:40.606496 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" podStartSLOduration=1.204033153 podStartE2EDuration="3.606478777s" totalImagesPullingTime="2.402445624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:21:40.604677345 +0000 UTC m=+296.856238853" watchObservedRunningTime="2026-07-22 02:21:40.606478777 +0000 UTC m=+296.858040324" Jul 22 02:21:43.602377 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:43.602336 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" event={"ID":"442c25fa-c730-4b9f-abed-8e4cc9474e89","Type":"ContainerStarted","Data":"ce7671b732150e6d9e53f3256e5c18d766d60c46408bcdfcaae7c0b17462d8b7"} Jul 22 02:21:44.172395 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:44.172363 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 02:21:44.607846 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:44.607812 2579 generic.go:356] "Generic (PLEG): container finished" podID="442c25fa-c730-4b9f-abed-8e4cc9474e89" containerID="ce7671b732150e6d9e53f3256e5c18d766d60c46408bcdfcaae7c0b17462d8b7" exitCode=0 Jul 22 02:21:44.610056 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:44.607873 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" event={"ID":"442c25fa-c730-4b9f-abed-8e4cc9474e89","Type":"ContainerDied","Data":"ce7671b732150e6d9e53f3256e5c18d766d60c46408bcdfcaae7c0b17462d8b7"} Jul 22 02:21:45.613565 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:45.613528 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" event={"ID":"442c25fa-c730-4b9f-abed-8e4cc9474e89","Type":"ContainerStarted","Data":"bfdd1b17197452e851b70417bc4334e8c8072b9e0892935b73f1480d32c9d6e7"} Jul 22 02:21:45.613975 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:45.613618 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:45.642881 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:45.642832 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" podStartSLOduration=2.532367205 podStartE2EDuration="6.642815444s" totalImagesPullingTime="3.058106112s" totalInitContainerRuntime="1.052342127s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:21:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:21:45.640734841 +0000 UTC m=+301.892296334" watchObservedRunningTime="2026-07-22 02:21:45.642815444 +0000 UTC m=+301.894376944" Jul 22 02:21:50.091903 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:50.091872 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:50.315501 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:50.315472 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:51.593804 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:51.593775 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c9bd579-2rd4d" Jul 22 02:21:56.620473 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:56.620440 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-4nkms" Jul 22 02:21:58.735604 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:58.735570 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:58.884806 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:58.884733 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:59.518813 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.518773 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:59.537009 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.536966 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7756896c6-8zqcw"] Jul 22 02:21:59.547446 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.547424 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7756896c6-8zqcw" Jul 22 02:21:59.550213 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.550192 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-w8rqh\"" Jul 22 02:21:59.550344 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.550298 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 22 02:21:59.550424 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.550413 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 22 02:21:59.550534 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.550515 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 22 02:21:59.551155 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.551140 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 22 02:21:59.566253 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.566227 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7756896c6-8zqcw"] Jul 22 02:21:59.634486 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.634458 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a445730-a4dc-4b9d-a71b-c5b657ae201d-tls-certs\") pod \"kube-auth-proxy-7756896c6-8zqcw\" (UID: \"2a445730-a4dc-4b9d-a71b-c5b657ae201d\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-8zqcw" Jul 22 02:21:59.634486 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.634488 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a445730-a4dc-4b9d-a71b-c5b657ae201d-tmp\") pod \"kube-auth-proxy-7756896c6-8zqcw\" (UID: \"2a445730-a4dc-4b9d-a71b-c5b657ae201d\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-8zqcw" Jul 22 02:21:59.634674 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.634509 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vllvh\" (UniqueName: \"kubernetes.io/projected/2a445730-a4dc-4b9d-a71b-c5b657ae201d-kube-api-access-vllvh\") pod \"kube-auth-proxy-7756896c6-8zqcw\" (UID: \"2a445730-a4dc-4b9d-a71b-c5b657ae201d\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-8zqcw" Jul 22 02:21:59.735237 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.735204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a445730-a4dc-4b9d-a71b-c5b657ae201d-tls-certs\") pod \"kube-auth-proxy-7756896c6-8zqcw\" (UID: \"2a445730-a4dc-4b9d-a71b-c5b657ae201d\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-8zqcw" Jul 22 02:21:59.735434 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.735253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a445730-a4dc-4b9d-a71b-c5b657ae201d-tmp\") pod \"kube-auth-proxy-7756896c6-8zqcw\" (UID: \"2a445730-a4dc-4b9d-a71b-c5b657ae201d\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-8zqcw" Jul 22 02:21:59.735434 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.735290 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vllvh\" (UniqueName: \"kubernetes.io/projected/2a445730-a4dc-4b9d-a71b-c5b657ae201d-kube-api-access-vllvh\") pod \"kube-auth-proxy-7756896c6-8zqcw\" (UID: \"2a445730-a4dc-4b9d-a71b-c5b657ae201d\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-8zqcw" Jul 22 02:21:59.737775 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.737736 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a445730-a4dc-4b9d-a71b-c5b657ae201d-tmp\") pod \"kube-auth-proxy-7756896c6-8zqcw\" (UID: \"2a445730-a4dc-4b9d-a71b-c5b657ae201d\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-8zqcw" Jul 22 02:21:59.738167 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.738143 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a445730-a4dc-4b9d-a71b-c5b657ae201d-tls-certs\") pod \"kube-auth-proxy-7756896c6-8zqcw\" (UID: \"2a445730-a4dc-4b9d-a71b-c5b657ae201d\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-8zqcw" Jul 22 02:21:59.761503 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.761464 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vllvh\" (UniqueName: \"kubernetes.io/projected/2a445730-a4dc-4b9d-a71b-c5b657ae201d-kube-api-access-vllvh\") pod \"kube-auth-proxy-7756896c6-8zqcw\" (UID: \"2a445730-a4dc-4b9d-a71b-c5b657ae201d\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-8zqcw" Jul 22 02:21:59.781538 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.781458 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:59.858062 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.857789 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7756896c6-8zqcw" Jul 22 02:21:59.895697 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.895668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:21:59.975922 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:21:59.975891 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:00.014688 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:00.014666 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7756896c6-8zqcw"] Jul 22 02:22:00.016658 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:22:00.016623 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a445730_a4dc_4b9d_a71b_c5b657ae201d.slice/crio-85d9b6b1dbc050ddb7e2c92bcc8205f3585c8ac7ad4a00013d3e8f1fd3ce4c3a WatchSource:0}: Error finding container 85d9b6b1dbc050ddb7e2c92bcc8205f3585c8ac7ad4a00013d3e8f1fd3ce4c3a: Status 404 returned error can't find the container with id 85d9b6b1dbc050ddb7e2c92bcc8205f3585c8ac7ad4a00013d3e8f1fd3ce4c3a Jul 22 02:22:00.018573 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:00.018554 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 02:22:00.053138 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:00.053050 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:00.161127 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:00.161082 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:00.675891 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:00.675841 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7756896c6-8zqcw" event={"ID":"2a445730-a4dc-4b9d-a71b-c5b657ae201d","Type":"ContainerStarted","Data":"85d9b6b1dbc050ddb7e2c92bcc8205f3585c8ac7ad4a00013d3e8f1fd3ce4c3a"} Jul 22 02:22:00.739582 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:00.739537 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:01.216136 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:01.216097 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:01.310536 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:01.310478 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:02.195257 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:02.195224 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:03.691872 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:03.691837 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7756896c6-8zqcw" event={"ID":"2a445730-a4dc-4b9d-a71b-c5b657ae201d","Type":"ContainerStarted","Data":"93479ee1fa0d0d7d69e55c5a651c6a186a5c5247c2df716e47b0a64cd656a44c"} Jul 22 02:22:03.708014 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:03.707965 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7756896c6-8zqcw" podStartSLOduration=1.846747447 podStartE2EDuration="4.707948872s" totalImagesPullingTime="2.861201425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:22:03.707017903 +0000 UTC m=+319.958579419" watchObservedRunningTime="2026-07-22 02:22:03.707948872 +0000 UTC m=+319.959510363" Jul 22 02:22:06.304823 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:06.304791 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:06.404904 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:06.404854 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:06.597491 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:06.597464 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:06.700298 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:06.700259 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:06.922854 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:06.922775 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:10.273539 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:10.273493 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:10.338414 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:10.338383 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dt2dh"] Jul 22 02:22:10.341961 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:10.341935 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt2dh" Jul 22 02:22:10.345090 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:10.345054 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 22 02:22:10.345205 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:10.345137 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2dtgw\"" Jul 22 02:22:10.352364 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:10.352335 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dt2dh"] Jul 22 02:22:10.365976 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:10.365945 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:10.425301 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:10.425256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/268efab0-5430-4ebe-ab40-1987b4e0220a-cert\") pod \"kserve-controller-manager-d6f4b65b8-dt2dh\" (UID: \"268efab0-5430-4ebe-ab40-1987b4e0220a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt2dh" Jul 22 02:22:10.425474 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:10.425347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w6nj\" (UniqueName: \"kubernetes.io/projected/268efab0-5430-4ebe-ab40-1987b4e0220a-kube-api-access-7w6nj\") pod \"kserve-controller-manager-d6f4b65b8-dt2dh\" (UID: \"268efab0-5430-4ebe-ab40-1987b4e0220a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt2dh" Jul 22 02:22:10.526665 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:10.526546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/268efab0-5430-4ebe-ab40-1987b4e0220a-cert\") pod \"kserve-controller-manager-d6f4b65b8-dt2dh\" (UID: \"268efab0-5430-4ebe-ab40-1987b4e0220a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt2dh" Jul 22 02:22:10.526665 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:10.526615 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w6nj\" (UniqueName: \"kubernetes.io/projected/268efab0-5430-4ebe-ab40-1987b4e0220a-kube-api-access-7w6nj\") pod \"kserve-controller-manager-d6f4b65b8-dt2dh\" (UID: \"268efab0-5430-4ebe-ab40-1987b4e0220a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt2dh" Jul 22 02:22:10.529853 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:10.529824 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/268efab0-5430-4ebe-ab40-1987b4e0220a-cert\") pod \"kserve-controller-manager-d6f4b65b8-dt2dh\" (UID: \"268efab0-5430-4ebe-ab40-1987b4e0220a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt2dh" Jul 22 02:22:10.529979 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:10.529932 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:10.538764 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:10.538730 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w6nj\" (UniqueName: \"kubernetes.io/projected/268efab0-5430-4ebe-ab40-1987b4e0220a-kube-api-access-7w6nj\") pod \"kserve-controller-manager-d6f4b65b8-dt2dh\" (UID: \"268efab0-5430-4ebe-ab40-1987b4e0220a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt2dh" Jul 22 02:22:10.653638 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:10.653601 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt2dh" Jul 22 02:22:10.674485 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:10.674456 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:10.789409 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:10.789380 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dt2dh"] Jul 22 02:22:10.792206 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:22:10.792170 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268efab0_5430_4ebe_ab40_1987b4e0220a.slice/crio-8a4504fbc19f0faf09fa9807d202c0211e9d06c4d3e4779dbdb7bbe3a333174e WatchSource:0}: Error finding container 8a4504fbc19f0faf09fa9807d202c0211e9d06c4d3e4779dbdb7bbe3a333174e: Status 404 returned error can't find the container with id 8a4504fbc19f0faf09fa9807d202c0211e9d06c4d3e4779dbdb7bbe3a333174e Jul 22 02:22:11.552441 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:11.552406 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:11.661678 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:11.661597 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:11.729714 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:11.729681 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt2dh" event={"ID":"268efab0-5430-4ebe-ab40-1987b4e0220a","Type":"ContainerStarted","Data":"8a4504fbc19f0faf09fa9807d202c0211e9d06c4d3e4779dbdb7bbe3a333174e"} Jul 22 02:22:11.785504 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:11.785430 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:13.308338 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:13.308279 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:13.739508 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:13.739413 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt2dh" event={"ID":"268efab0-5430-4ebe-ab40-1987b4e0220a","Type":"ContainerStarted","Data":"9e7a3f33937cd8f7740aaf3d9633f57c35ff2355e7c3f7a4b18a1751c69e6ab9"} Jul 22 02:22:13.739672 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:13.739533 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt2dh" Jul 22 02:22:13.779512 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:13.779469 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt2dh" podStartSLOduration=1.598296651 podStartE2EDuration="3.779454153s" totalImagesPullingTime="2.181157502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:22:13.779095344 +0000 UTC m=+330.030656864" watchObservedRunningTime="2026-07-22 02:22:13.779454153 +0000 UTC m=+330.031015645" Jul 22 02:22:23.575611 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:23.575570 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:23.634337 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:23.634303 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:25.435984 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:25.435945 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:25.538076 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:25.538033 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:22:44.748801 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:22:44.748770 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dt2dh" Jul 22 02:23:00.228896 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:00.228859 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:00.331187 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:00.331154 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:00.443626 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:00.443595 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:01.181047 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:01.181015 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:01.393038 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:01.393007 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:41.169568 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:41.169538 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:42.701959 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:42.701925 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:46.307535 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:46.307495 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:46.408934 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:46.408897 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:50.884206 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:50.884167 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:51.308973 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:51.308943 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:52.746149 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:52.746116 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:54.311208 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:54.311159 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:55.125642 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:55.125589 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:55.225702 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:55.225657 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:56.139207 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:56.139167 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:56.241562 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:56.241515 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:56.499480 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:56.499390 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7228x"] Jul 22 02:23:56.502743 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:56.502721 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7228x" Jul 22 02:23:56.506577 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:56.506556 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 22 02:23:56.506699 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:56.506554 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2sm6h\"" Jul 22 02:23:56.507318 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:56.507304 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 02:23:56.507635 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:56.507620 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 02:23:56.521081 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:56.521058 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7228x"] Jul 22 02:23:56.620388 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:56.620350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbtc6\" (UniqueName: \"kubernetes.io/projected/aa4b1f55-cc0e-4851-8f28-50ec6b9897e6-kube-api-access-bbtc6\") pod \"dns-operator-controller-manager-864dd78c4c-7228x\" (UID: \"aa4b1f55-cc0e-4851-8f28-50ec6b9897e6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7228x" Jul 22 02:23:56.721046 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:56.721001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbtc6\" (UniqueName: \"kubernetes.io/projected/aa4b1f55-cc0e-4851-8f28-50ec6b9897e6-kube-api-access-bbtc6\") pod \"dns-operator-controller-manager-864dd78c4c-7228x\" (UID: \"aa4b1f55-cc0e-4851-8f28-50ec6b9897e6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7228x" Jul 22 02:23:56.737479 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:56.737410 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbtc6\" (UniqueName: \"kubernetes.io/projected/aa4b1f55-cc0e-4851-8f28-50ec6b9897e6-kube-api-access-bbtc6\") pod \"dns-operator-controller-manager-864dd78c4c-7228x\" (UID: \"aa4b1f55-cc0e-4851-8f28-50ec6b9897e6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7228x" Jul 22 02:23:56.812979 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:56.812944 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7228x" Jul 22 02:23:56.949931 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:56.949892 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7228x"] Jul 22 02:23:56.952723 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:23:56.952701 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4b1f55_cc0e_4851_8f28_50ec6b9897e6.slice/crio-e273c256a4a358417fca896f2ac424e7a21146903082575af47de82ee2c569e3 WatchSource:0}: Error finding container e273c256a4a358417fca896f2ac424e7a21146903082575af47de82ee2c569e3: Status 404 returned error can't find the container with id e273c256a4a358417fca896f2ac424e7a21146903082575af47de82ee2c569e3 Jul 22 02:23:57.160589 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:57.160511 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:57.166936 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:57.166907 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7228x" event={"ID":"aa4b1f55-cc0e-4851-8f28-50ec6b9897e6","Type":"ContainerStarted","Data":"e273c256a4a358417fca896f2ac424e7a21146903082575af47de82ee2c569e3"} Jul 22 02:23:58.492517 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:58.492487 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:58.595978 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:58.595921 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:23:59.178348 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:59.178314 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7228x" event={"ID":"aa4b1f55-cc0e-4851-8f28-50ec6b9897e6","Type":"ContainerStarted","Data":"38ef6c399fbe6218b2a88c62a72b2447959986e700b85bf407692ff511cd05ea"} Jul 22 02:23:59.178527 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:59.178452 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7228x" Jul 22 02:23:59.197161 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:23:59.197110 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7228x" podStartSLOduration=1.051263006 podStartE2EDuration="3.197092508s" totalImagesPullingTime="2.145829502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:23:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:23:59.195334564 +0000 UTC m=+435.446896075" watchObservedRunningTime="2026-07-22 02:23:59.197092508 +0000 UTC m=+435.448654000" Jul 22 02:24:00.046784 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.046732 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-27zh7"] Jul 22 02:24:00.050109 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.050092 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-27zh7" Jul 22 02:24:00.052794 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.052743 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 22 02:24:00.052890 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.052813 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t62r7\"" Jul 22 02:24:00.052890 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.052836 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 22 02:24:00.059402 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.059378 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-27zh7"] Jul 22 02:24:00.066021 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.065994 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:00.151226 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.151189 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-27zh7\" (UID: \"2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-27zh7" Jul 22 02:24:00.151383 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.151248 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-27zh7\" (UID: \"2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-27zh7" Jul 22 02:24:00.151383 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.151310 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nfpj\" (UniqueName: \"kubernetes.io/projected/2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2-kube-api-access-7nfpj\") pod \"kuadrant-console-plugin-66b5774985-27zh7\" (UID: \"2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-27zh7" Jul 22 02:24:00.252735 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.252700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nfpj\" (UniqueName: \"kubernetes.io/projected/2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2-kube-api-access-7nfpj\") pod \"kuadrant-console-plugin-66b5774985-27zh7\" (UID: \"2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-27zh7" Jul 22 02:24:00.252929 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.252820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-27zh7\" (UID: \"2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-27zh7" Jul 22 02:24:00.252929 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.252858 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-27zh7\" (UID: \"2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-27zh7" Jul 22 02:24:00.253517 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.253486 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-27zh7\" (UID: \"2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-27zh7" Jul 22 02:24:00.255269 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.255236 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-27zh7\" (UID: \"2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-27zh7" Jul 22 02:24:00.268552 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.268527 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nfpj\" (UniqueName: \"kubernetes.io/projected/2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2-kube-api-access-7nfpj\") pod \"kuadrant-console-plugin-66b5774985-27zh7\" (UID: \"2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-27zh7" Jul 22 02:24:00.316550 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.316518 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:00.359965 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.359934 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-27zh7" Jul 22 02:24:00.492233 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:00.492102 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-27zh7"] Jul 22 02:24:00.494411 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:24:00.494377 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2754e8e6_b04c_46ac_ad67_a1c61ea5dcb2.slice/crio-fb33f3d692fa386c2b4c4ea72973c1b79a4b87a3a8d1c4eb6fbc9946617698cd WatchSource:0}: Error finding container fb33f3d692fa386c2b4c4ea72973c1b79a4b87a3a8d1c4eb6fbc9946617698cd: Status 404 returned error can't find the container with id fb33f3d692fa386c2b4c4ea72973c1b79a4b87a3a8d1c4eb6fbc9946617698cd Jul 22 02:24:01.188408 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:01.188371 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-27zh7" event={"ID":"2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2","Type":"ContainerStarted","Data":"fb33f3d692fa386c2b4c4ea72973c1b79a4b87a3a8d1c4eb6fbc9946617698cd"} Jul 22 02:24:01.896613 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:01.896574 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:01.997055 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:01.997011 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:03.646213 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:03.646176 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:09.905366 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:09.905273 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc"] Jul 22 02:24:09.912361 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:09.912329 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc" Jul 22 02:24:09.915191 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:09.915165 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hcqmt\"" Jul 22 02:24:09.927704 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:09.927681 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc"] Jul 22 02:24:09.933931 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:09.933904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzfkc\" (UniqueName: \"kubernetes.io/projected/b754dcc3-4abd-4593-8e67-95264a30ef2b-kube-api-access-bzfkc\") pod \"kuadrant-operator-controller-manager-55467d9f7-4nzdc\" (UID: \"b754dcc3-4abd-4593-8e67-95264a30ef2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc" Jul 22 02:24:09.934041 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:09.933967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b754dcc3-4abd-4593-8e67-95264a30ef2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4nzdc\" (UID: \"b754dcc3-4abd-4593-8e67-95264a30ef2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc" Jul 22 02:24:10.035224 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.035190 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzfkc\" (UniqueName: \"kubernetes.io/projected/b754dcc3-4abd-4593-8e67-95264a30ef2b-kube-api-access-bzfkc\") pod \"kuadrant-operator-controller-manager-55467d9f7-4nzdc\" (UID: \"b754dcc3-4abd-4593-8e67-95264a30ef2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc" Jul 22 02:24:10.035391 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.035259 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b754dcc3-4abd-4593-8e67-95264a30ef2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4nzdc\" (UID: \"b754dcc3-4abd-4593-8e67-95264a30ef2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc" Jul 22 02:24:10.035771 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.035707 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b754dcc3-4abd-4593-8e67-95264a30ef2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4nzdc\" (UID: \"b754dcc3-4abd-4593-8e67-95264a30ef2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc" Jul 22 02:24:10.043799 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.043773 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzfkc\" (UniqueName: \"kubernetes.io/projected/b754dcc3-4abd-4593-8e67-95264a30ef2b-kube-api-access-bzfkc\") pod \"kuadrant-operator-controller-manager-55467d9f7-4nzdc\" (UID: \"b754dcc3-4abd-4593-8e67-95264a30ef2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc" Jul 22 02:24:10.185268 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.185189 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7228x" Jul 22 02:24:10.202649 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.202611 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc"] Jul 22 02:24:10.202958 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.202936 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc" Jul 22 02:24:10.216556 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.216515 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc"] Jul 22 02:24:10.245945 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.245900 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h"] Jul 22 02:24:10.251390 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.251362 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" Jul 22 02:24:10.267124 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.267092 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h"] Jul 22 02:24:10.338020 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.337980 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd58737f-4013-433f-8277-ce42679d97e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qq65h\" (UID: \"fd58737f-4013-433f-8277-ce42679d97e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" Jul 22 02:24:10.338197 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.338093 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55gb8\" (UniqueName: \"kubernetes.io/projected/fd58737f-4013-433f-8277-ce42679d97e8-kube-api-access-55gb8\") pod \"kuadrant-operator-controller-manager-55467d9f7-qq65h\" (UID: \"fd58737f-4013-433f-8277-ce42679d97e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" Jul 22 02:24:10.439613 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.439527 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd58737f-4013-433f-8277-ce42679d97e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qq65h\" (UID: \"fd58737f-4013-433f-8277-ce42679d97e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" Jul 22 02:24:10.439613 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.439586 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55gb8\" (UniqueName: \"kubernetes.io/projected/fd58737f-4013-433f-8277-ce42679d97e8-kube-api-access-55gb8\") pod \"kuadrant-operator-controller-manager-55467d9f7-qq65h\" (UID: \"fd58737f-4013-433f-8277-ce42679d97e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" Jul 22 02:24:10.439986 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.439958 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd58737f-4013-433f-8277-ce42679d97e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qq65h\" (UID: \"fd58737f-4013-433f-8277-ce42679d97e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" Jul 22 02:24:10.449692 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.449655 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55gb8\" (UniqueName: \"kubernetes.io/projected/fd58737f-4013-433f-8277-ce42679d97e8-kube-api-access-55gb8\") pod \"kuadrant-operator-controller-manager-55467d9f7-qq65h\" (UID: \"fd58737f-4013-433f-8277-ce42679d97e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" Jul 22 02:24:10.562548 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.562505 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:10.566792 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.566705 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" Jul 22 02:24:10.701043 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:10.700953 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:12.991466 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:12.991424 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:13.098042 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:13.097610 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:17.320084 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:17.320027 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:17.420643 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:17.420598 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:17.522091 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:17.522058 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:19.529439 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:19.529403 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:19.630406 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:19.629641 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:21.992305 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:21.992282 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h"] Jul 22 02:24:21.997019 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:24:21.996984 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd58737f_4013_433f_8277_ce42679d97e8.slice/crio-e9e5478c296b3a5a4298ea79852cfc67f8cb8d7256f58137a10836245f60a9a4 WatchSource:0}: Error finding container e9e5478c296b3a5a4298ea79852cfc67f8cb8d7256f58137a10836245f60a9a4: Status 404 returned error can't find the container with id e9e5478c296b3a5a4298ea79852cfc67f8cb8d7256f58137a10836245f60a9a4 Jul 22 02:24:22.027642 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:22.027606 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:22.302161 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:22.302129 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" event={"ID":"fd58737f-4013-433f-8277-ce42679d97e8","Type":"ContainerStarted","Data":"e9e5478c296b3a5a4298ea79852cfc67f8cb8d7256f58137a10836245f60a9a4"} Jul 22 02:24:23.308066 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:23.308027 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-27zh7" event={"ID":"2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2","Type":"ContainerStarted","Data":"f4357bfc7b7971da9f567780bb8fee0b9cc8f924caa559971d10994675370490"} Jul 22 02:24:23.360771 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:23.360702 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-27zh7" podStartSLOduration=1.602015686 podStartE2EDuration="23.360685314s" totalImagesPullingTime="21.758669628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:24:23.357229746 +0000 UTC m=+459.608791250" watchObservedRunningTime="2026-07-22 02:24:23.360685314 +0000 UTC m=+459.612246806" Jul 22 02:24:24.342740 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:24.342699 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:24.418493 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:24.418465 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:24.492525 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:24:24.492475 2579 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-4nzdc_kuadrant-system_b754dcc3-4abd-4593-8e67-95264a30ef2b_0(56d9ed2fb6275bb201eec5b8fc1aa91ac2e41583486c54276bcb596ab532a4d2): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-4nzdc to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jul 22 02:24:24.492612 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:24:24.492552 2579 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-4nzdc_kuadrant-system_b754dcc3-4abd-4593-8e67-95264a30ef2b_0(56d9ed2fb6275bb201eec5b8fc1aa91ac2e41583486c54276bcb596ab532a4d2): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-4nzdc to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc" Jul 22 02:24:25.317987 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:25.317948 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc" Jul 22 02:24:25.320800 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:24:25.320762 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4nzdc\" is forbidden: User \"system:node:ip-10-0-132-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-37.ec2.internal' and this object" podUID="b754dcc3-4abd-4593-8e67-95264a30ef2b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc" Jul 22 02:24:25.330525 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:25.330502 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc" Jul 22 02:24:25.333105 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:24:25.333077 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4nzdc\" is forbidden: User \"system:node:ip-10-0-132-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-37.ec2.internal' and this object" podUID="b754dcc3-4abd-4593-8e67-95264a30ef2b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc" Jul 22 02:24:25.374203 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:25.374171 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b754dcc3-4abd-4593-8e67-95264a30ef2b-extensions-socket-volume\") pod \"b754dcc3-4abd-4593-8e67-95264a30ef2b\" (UID: \"b754dcc3-4abd-4593-8e67-95264a30ef2b\") " Jul 22 02:24:25.374635 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:25.374304 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzfkc\" (UniqueName: \"kubernetes.io/projected/b754dcc3-4abd-4593-8e67-95264a30ef2b-kube-api-access-bzfkc\") pod \"b754dcc3-4abd-4593-8e67-95264a30ef2b\" (UID: \"b754dcc3-4abd-4593-8e67-95264a30ef2b\") " Jul 22 02:24:25.374635 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:25.374550 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b754dcc3-4abd-4593-8e67-95264a30ef2b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b754dcc3-4abd-4593-8e67-95264a30ef2b" (UID: "b754dcc3-4abd-4593-8e67-95264a30ef2b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:25.377004 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:25.376974 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b754dcc3-4abd-4593-8e67-95264a30ef2b-kube-api-access-bzfkc" (OuterVolumeSpecName: "kube-api-access-bzfkc") pod "b754dcc3-4abd-4593-8e67-95264a30ef2b" (UID: "b754dcc3-4abd-4593-8e67-95264a30ef2b"). InnerVolumeSpecName "kube-api-access-bzfkc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:24:25.475985 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:25.475948 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b754dcc3-4abd-4593-8e67-95264a30ef2b-extensions-socket-volume\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:24:25.475985 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:25.475981 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzfkc\" (UniqueName: \"kubernetes.io/projected/b754dcc3-4abd-4593-8e67-95264a30ef2b-kube-api-access-bzfkc\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:24:26.325025 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:26.324989 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc" Jul 22 02:24:26.327618 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:24:26.327586 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4nzdc\" is forbidden: User \"system:node:ip-10-0-132-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-37.ec2.internal' and this object" podUID="b754dcc3-4abd-4593-8e67-95264a30ef2b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc" Jul 22 02:24:26.335449 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:24:26.335423 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4nzdc\" is forbidden: User \"system:node:ip-10-0-132-37.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-37.ec2.internal' and this object" podUID="b754dcc3-4abd-4593-8e67-95264a30ef2b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4nzdc" Jul 22 02:24:26.347996 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:26.347965 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b754dcc3-4abd-4593-8e67-95264a30ef2b" path="/var/lib/kubelet/pods/b754dcc3-4abd-4593-8e67-95264a30ef2b/volumes" Jul 22 02:24:28.335699 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:28.335666 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" event={"ID":"fd58737f-4013-433f-8277-ce42679d97e8","Type":"ContainerStarted","Data":"ccd1679ad1f53ef0e587b8821915ed303f2137ae7c93b3b75786550256e8b088"} Jul 22 02:24:28.336102 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:28.335759 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" Jul 22 02:24:28.340056 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:28.340026 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:28.356949 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:28.356904 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" podStartSLOduration=12.887114748 podStartE2EDuration="18.356890412s" totalImagesPullingTime="5.469775664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:24:28.355628904 +0000 UTC m=+464.607190408" watchObservedRunningTime="2026-07-22 02:24:28.356890412 +0000 UTC m=+464.608451903" Jul 22 02:24:28.440176 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:28.440146 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:30.856090 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:30.856050 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:30.940471 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:30.940436 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:35.154371 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:35.154340 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:35.255428 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:35.255396 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:35.629955 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:35.629918 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:35.730672 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:35.730637 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:35.830897 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:35.830864 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:38.167039 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:38.167004 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:38.266554 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:38.266523 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:39.342247 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:39.342212 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" Jul 22 02:24:47.947057 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:47.947018 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:48.050990 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:48.050961 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:48.356986 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:48.356954 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:48.526266 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:48.526235 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:51.619168 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:51.619137 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h"] Jul 22 02:24:51.619530 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:51.619344 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" podUID="fd58737f-4013-433f-8277-ce42679d97e8" containerName="manager" containerID="cri-o://ccd1679ad1f53ef0e587b8821915ed303f2137ae7c93b3b75786550256e8b088" gracePeriod=10 Jul 22 02:24:51.875581 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:51.875520 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" Jul 22 02:24:52.002657 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:52.002621 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd58737f-4013-433f-8277-ce42679d97e8-extensions-socket-volume\") pod \"fd58737f-4013-433f-8277-ce42679d97e8\" (UID: \"fd58737f-4013-433f-8277-ce42679d97e8\") " Jul 22 02:24:52.002873 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:52.002688 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55gb8\" (UniqueName: \"kubernetes.io/projected/fd58737f-4013-433f-8277-ce42679d97e8-kube-api-access-55gb8\") pod \"fd58737f-4013-433f-8277-ce42679d97e8\" (UID: \"fd58737f-4013-433f-8277-ce42679d97e8\") " Jul 22 02:24:52.003089 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:52.003066 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd58737f-4013-433f-8277-ce42679d97e8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fd58737f-4013-433f-8277-ce42679d97e8" (UID: "fd58737f-4013-433f-8277-ce42679d97e8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:52.004896 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:52.004873 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd58737f-4013-433f-8277-ce42679d97e8-kube-api-access-55gb8" (OuterVolumeSpecName: "kube-api-access-55gb8") pod "fd58737f-4013-433f-8277-ce42679d97e8" (UID: "fd58737f-4013-433f-8277-ce42679d97e8"). InnerVolumeSpecName "kube-api-access-55gb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:24:52.103644 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:52.103595 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd58737f-4013-433f-8277-ce42679d97e8-extensions-socket-volume\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:24:52.103644 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:52.103638 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55gb8\" (UniqueName: \"kubernetes.io/projected/fd58737f-4013-433f-8277-ce42679d97e8-kube-api-access-55gb8\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:24:52.162145 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:52.162061 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:52.271487 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:52.271448 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:52.437570 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:52.437489 2579 generic.go:356] "Generic (PLEG): container finished" podID="fd58737f-4013-433f-8277-ce42679d97e8" containerID="ccd1679ad1f53ef0e587b8821915ed303f2137ae7c93b3b75786550256e8b088" exitCode=0 Jul 22 02:24:52.437570 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:52.437528 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" event={"ID":"fd58737f-4013-433f-8277-ce42679d97e8","Type":"ContainerDied","Data":"ccd1679ad1f53ef0e587b8821915ed303f2137ae7c93b3b75786550256e8b088"} Jul 22 02:24:52.437570 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:52.437570 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" event={"ID":"fd58737f-4013-433f-8277-ce42679d97e8","Type":"ContainerDied","Data":"e9e5478c296b3a5a4298ea79852cfc67f8cb8d7256f58137a10836245f60a9a4"} Jul 22 02:24:52.437828 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:52.437595 2579 scope.go:117] "RemoveContainer" containerID="ccd1679ad1f53ef0e587b8821915ed303f2137ae7c93b3b75786550256e8b088" Jul 22 02:24:52.437828 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:52.437534 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h" Jul 22 02:24:52.445892 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:52.445876 2579 scope.go:117] "RemoveContainer" containerID="ccd1679ad1f53ef0e587b8821915ed303f2137ae7c93b3b75786550256e8b088" Jul 22 02:24:52.446131 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:24:52.446113 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccd1679ad1f53ef0e587b8821915ed303f2137ae7c93b3b75786550256e8b088\": container with ID starting with ccd1679ad1f53ef0e587b8821915ed303f2137ae7c93b3b75786550256e8b088 not found: ID does not exist" containerID="ccd1679ad1f53ef0e587b8821915ed303f2137ae7c93b3b75786550256e8b088" Jul 22 02:24:52.446183 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:52.446139 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccd1679ad1f53ef0e587b8821915ed303f2137ae7c93b3b75786550256e8b088"} err="failed to get container status \"ccd1679ad1f53ef0e587b8821915ed303f2137ae7c93b3b75786550256e8b088\": rpc error: code = NotFound desc = could not find container \"ccd1679ad1f53ef0e587b8821915ed303f2137ae7c93b3b75786550256e8b088\": container with ID starting with ccd1679ad1f53ef0e587b8821915ed303f2137ae7c93b3b75786550256e8b088 not found: ID does not exist" Jul 22 02:24:52.455920 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:52.455900 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h"] Jul 22 02:24:52.464762 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:52.464732 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qq65h"] Jul 22 02:24:54.346575 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:54.346544 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd58737f-4013-433f-8277-ce42679d97e8" path="/var/lib/kubelet/pods/fd58737f-4013-433f-8277-ce42679d97e8/volumes" Jul 22 02:24:55.812879 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:55.812850 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:56.496587 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:56.496550 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:57.623363 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.623326 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:57.623767 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.623584 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6m2xf"] Jul 22 02:24:57.623930 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.623917 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd58737f-4013-433f-8277-ce42679d97e8" containerName="manager" Jul 22 02:24:57.623963 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.623932 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd58737f-4013-433f-8277-ce42679d97e8" containerName="manager" Jul 22 02:24:57.623995 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.623989 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd58737f-4013-433f-8277-ce42679d97e8" containerName="manager" Jul 22 02:24:57.631245 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.631226 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" Jul 22 02:24:57.633729 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.633706 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 22 02:24:57.636186 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.636164 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6m2xf"] Jul 22 02:24:57.721039 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.721002 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6m2xf"] Jul 22 02:24:57.738855 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.738822 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:57.751038 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.751010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k45g4\" (UniqueName: \"kubernetes.io/projected/89a3edd8-bd90-41f4-a10f-c72aa564eca8-kube-api-access-k45g4\") pod \"limitador-limitador-64c94fd64f-6m2xf\" (UID: \"89a3edd8-bd90-41f4-a10f-c72aa564eca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" Jul 22 02:24:57.751182 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.751142 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/89a3edd8-bd90-41f4-a10f-c72aa564eca8-config-file\") pod \"limitador-limitador-64c94fd64f-6m2xf\" (UID: \"89a3edd8-bd90-41f4-a10f-c72aa564eca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" Jul 22 02:24:57.838312 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.838274 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:57.851500 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.851476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/89a3edd8-bd90-41f4-a10f-c72aa564eca8-config-file\") pod \"limitador-limitador-64c94fd64f-6m2xf\" (UID: \"89a3edd8-bd90-41f4-a10f-c72aa564eca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" Jul 22 02:24:57.851582 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.851508 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k45g4\" (UniqueName: \"kubernetes.io/projected/89a3edd8-bd90-41f4-a10f-c72aa564eca8-kube-api-access-k45g4\") pod \"limitador-limitador-64c94fd64f-6m2xf\" (UID: \"89a3edd8-bd90-41f4-a10f-c72aa564eca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" Jul 22 02:24:57.852235 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.852217 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/89a3edd8-bd90-41f4-a10f-c72aa564eca8-config-file\") pod \"limitador-limitador-64c94fd64f-6m2xf\" (UID: \"89a3edd8-bd90-41f4-a10f-c72aa564eca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" Jul 22 02:24:57.859701 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.859672 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k45g4\" (UniqueName: \"kubernetes.io/projected/89a3edd8-bd90-41f4-a10f-c72aa564eca8-kube-api-access-k45g4\") pod \"limitador-limitador-64c94fd64f-6m2xf\" (UID: \"89a3edd8-bd90-41f4-a10f-c72aa564eca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" Jul 22 02:24:57.943173 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:57.943092 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" Jul 22 02:24:58.075418 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:58.075378 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6m2xf"] Jul 22 02:24:58.078264 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:24:58.078242 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a3edd8_bd90_41f4_a10f_c72aa564eca8.slice/crio-096c2ecda9c870304ce9f6b6f367c19ee2f150e58866ae2d796cb66cb1a1d7f2 WatchSource:0}: Error finding container 096c2ecda9c870304ce9f6b6f367c19ee2f150e58866ae2d796cb66cb1a1d7f2: Status 404 returned error can't find the container with id 096c2ecda9c870304ce9f6b6f367c19ee2f150e58866ae2d796cb66cb1a1d7f2 Jul 22 02:24:58.413197 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:58.413165 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-sfs4t"] Jul 22 02:24:58.418099 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:58.418079 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sfs4t" Jul 22 02:24:58.420913 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:58.420892 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qgq27\"" Jul 22 02:24:58.421985 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:58.421964 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-sfs4t"] Jul 22 02:24:58.444864 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:58.444841 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:58.455447 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:58.455418 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdxcb\" (UniqueName: \"kubernetes.io/projected/7ee37470-d6ac-46a5-9036-cc43d546bdbe-kube-api-access-kdxcb\") pod \"authorino-58cd955675-sfs4t\" (UID: \"7ee37470-d6ac-46a5-9036-cc43d546bdbe\") " pod="kuadrant-system/authorino-58cd955675-sfs4t" Jul 22 02:24:58.466112 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:58.466087 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" event={"ID":"89a3edd8-bd90-41f4-a10f-c72aa564eca8","Type":"ContainerStarted","Data":"096c2ecda9c870304ce9f6b6f367c19ee2f150e58866ae2d796cb66cb1a1d7f2"} Jul 22 02:24:58.502533 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:58.502499 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:24:58.556756 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:58.556730 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdxcb\" (UniqueName: \"kubernetes.io/projected/7ee37470-d6ac-46a5-9036-cc43d546bdbe-kube-api-access-kdxcb\") pod \"authorino-58cd955675-sfs4t\" (UID: \"7ee37470-d6ac-46a5-9036-cc43d546bdbe\") " pod="kuadrant-system/authorino-58cd955675-sfs4t" Jul 22 02:24:58.571142 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:58.571112 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdxcb\" (UniqueName: \"kubernetes.io/projected/7ee37470-d6ac-46a5-9036-cc43d546bdbe-kube-api-access-kdxcb\") pod \"authorino-58cd955675-sfs4t\" (UID: \"7ee37470-d6ac-46a5-9036-cc43d546bdbe\") " pod="kuadrant-system/authorino-58cd955675-sfs4t" Jul 22 02:24:58.728621 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:58.728541 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sfs4t" Jul 22 02:24:58.912814 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:58.912783 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-sfs4t"] Jul 22 02:24:58.918764 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:24:58.918717 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ee37470_d6ac_46a5_9036_cc43d546bdbe.slice/crio-c3dac85e5148818d666739886af98906f89de50f413127b6e1f7f1bdbae30172 WatchSource:0}: Error finding container c3dac85e5148818d666739886af98906f89de50f413127b6e1f7f1bdbae30172: Status 404 returned error can't find the container with id c3dac85e5148818d666739886af98906f89de50f413127b6e1f7f1bdbae30172 Jul 22 02:24:59.472279 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:24:59.472242 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sfs4t" event={"ID":"7ee37470-d6ac-46a5-9036-cc43d546bdbe","Type":"ContainerStarted","Data":"c3dac85e5148818d666739886af98906f89de50f413127b6e1f7f1bdbae30172"} Jul 22 02:25:03.496203 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:03.496163 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" event={"ID":"89a3edd8-bd90-41f4-a10f-c72aa564eca8","Type":"ContainerStarted","Data":"5ed09dee32f70e1e06c5a3861f0a5319d5caf1b4613d47953d38caed2b1497ef"} Jul 22 02:25:03.496692 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:03.496234 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" Jul 22 02:25:03.497610 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:03.497588 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sfs4t" event={"ID":"7ee37470-d6ac-46a5-9036-cc43d546bdbe","Type":"ContainerStarted","Data":"a37eee7bab6c8b57f6c15799c1e7c54259fcc5536293e925c1c49dbea28238d7"} Jul 22 02:25:03.513781 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:03.513721 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" podStartSLOduration=1.9720988560000001 podStartE2EDuration="6.513708221s" totalImagesPullingTime="4.541609365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:25:03.513019464 +0000 UTC m=+499.764580976" watchObservedRunningTime="2026-07-22 02:25:03.513708221 +0000 UTC m=+499.765269713" Jul 22 02:25:03.528428 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:03.528372 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-sfs4t" podStartSLOduration=1.821203203 podStartE2EDuration="5.528358326s" totalImagesPullingTime="3.707155123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:25:03.528336203 +0000 UTC m=+499.779897710" watchObservedRunningTime="2026-07-22 02:25:03.528358326 +0000 UTC m=+499.779919818" Jul 22 02:25:03.730879 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:03.730838 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-sfs4t"] Jul 22 02:25:05.506573 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:05.506534 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-sfs4t" podUID="7ee37470-d6ac-46a5-9036-cc43d546bdbe" containerName="authorino" containerID="cri-o://a37eee7bab6c8b57f6c15799c1e7c54259fcc5536293e925c1c49dbea28238d7" gracePeriod=30 Jul 22 02:25:05.747233 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:05.747210 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sfs4t" Jul 22 02:25:05.829514 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:05.829481 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdxcb\" (UniqueName: \"kubernetes.io/projected/7ee37470-d6ac-46a5-9036-cc43d546bdbe-kube-api-access-kdxcb\") pod \"7ee37470-d6ac-46a5-9036-cc43d546bdbe\" (UID: \"7ee37470-d6ac-46a5-9036-cc43d546bdbe\") " Jul 22 02:25:05.831496 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:05.831466 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ee37470-d6ac-46a5-9036-cc43d546bdbe-kube-api-access-kdxcb" (OuterVolumeSpecName: "kube-api-access-kdxcb") pod "7ee37470-d6ac-46a5-9036-cc43d546bdbe" (UID: "7ee37470-d6ac-46a5-9036-cc43d546bdbe"). InnerVolumeSpecName "kube-api-access-kdxcb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:25:05.930264 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:05.930212 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdxcb\" (UniqueName: \"kubernetes.io/projected/7ee37470-d6ac-46a5-9036-cc43d546bdbe-kube-api-access-kdxcb\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:25:06.512190 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:06.512155 2579 generic.go:356] "Generic (PLEG): container finished" podID="7ee37470-d6ac-46a5-9036-cc43d546bdbe" containerID="a37eee7bab6c8b57f6c15799c1e7c54259fcc5536293e925c1c49dbea28238d7" exitCode=0 Jul 22 02:25:06.512190 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:06.512189 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-sfs4t" Jul 22 02:25:06.512679 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:06.512224 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sfs4t" event={"ID":"7ee37470-d6ac-46a5-9036-cc43d546bdbe","Type":"ContainerDied","Data":"a37eee7bab6c8b57f6c15799c1e7c54259fcc5536293e925c1c49dbea28238d7"} Jul 22 02:25:06.512679 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:06.512257 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-sfs4t" event={"ID":"7ee37470-d6ac-46a5-9036-cc43d546bdbe","Type":"ContainerDied","Data":"c3dac85e5148818d666739886af98906f89de50f413127b6e1f7f1bdbae30172"} Jul 22 02:25:06.512679 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:06.512277 2579 scope.go:117] "RemoveContainer" containerID="a37eee7bab6c8b57f6c15799c1e7c54259fcc5536293e925c1c49dbea28238d7" Jul 22 02:25:06.520276 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:06.520258 2579 scope.go:117] "RemoveContainer" containerID="a37eee7bab6c8b57f6c15799c1e7c54259fcc5536293e925c1c49dbea28238d7" Jul 22 02:25:06.520522 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:25:06.520501 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a37eee7bab6c8b57f6c15799c1e7c54259fcc5536293e925c1c49dbea28238d7\": container with ID starting with a37eee7bab6c8b57f6c15799c1e7c54259fcc5536293e925c1c49dbea28238d7 not found: ID does not exist" containerID="a37eee7bab6c8b57f6c15799c1e7c54259fcc5536293e925c1c49dbea28238d7" Jul 22 02:25:06.520565 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:06.520532 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a37eee7bab6c8b57f6c15799c1e7c54259fcc5536293e925c1c49dbea28238d7"} err="failed to get container status \"a37eee7bab6c8b57f6c15799c1e7c54259fcc5536293e925c1c49dbea28238d7\": rpc error: code = NotFound desc = could not find container \"a37eee7bab6c8b57f6c15799c1e7c54259fcc5536293e925c1c49dbea28238d7\": container with ID starting with a37eee7bab6c8b57f6c15799c1e7c54259fcc5536293e925c1c49dbea28238d7 not found: ID does not exist" Jul 22 02:25:06.529611 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:06.529588 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-sfs4t"] Jul 22 02:25:06.535994 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:06.535974 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-sfs4t"] Jul 22 02:25:08.346320 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:08.346280 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ee37470-d6ac-46a5-9036-cc43d546bdbe" path="/var/lib/kubelet/pods/7ee37470-d6ac-46a5-9036-cc43d546bdbe/volumes" Jul 22 02:25:12.732218 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:12.732184 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6m2xf"] Jul 22 02:25:12.732599 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:12.732360 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" podUID="89a3edd8-bd90-41f4-a10f-c72aa564eca8" containerName="limitador" containerID="cri-o://5ed09dee32f70e1e06c5a3861f0a5319d5caf1b4613d47953d38caed2b1497ef" gracePeriod=30 Jul 22 02:25:12.733094 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:12.733077 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" Jul 22 02:25:13.544723 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:13.544700 2579 generic.go:356] "Generic (PLEG): container finished" podID="89a3edd8-bd90-41f4-a10f-c72aa564eca8" containerID="5ed09dee32f70e1e06c5a3861f0a5319d5caf1b4613d47953d38caed2b1497ef" exitCode=0 Jul 22 02:25:13.544843 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:13.544786 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" event={"ID":"89a3edd8-bd90-41f4-a10f-c72aa564eca8","Type":"ContainerDied","Data":"5ed09dee32f70e1e06c5a3861f0a5319d5caf1b4613d47953d38caed2b1497ef"} Jul 22 02:25:13.673386 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:13.673362 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" Jul 22 02:25:13.797345 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:13.797246 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k45g4\" (UniqueName: \"kubernetes.io/projected/89a3edd8-bd90-41f4-a10f-c72aa564eca8-kube-api-access-k45g4\") pod \"89a3edd8-bd90-41f4-a10f-c72aa564eca8\" (UID: \"89a3edd8-bd90-41f4-a10f-c72aa564eca8\") " Jul 22 02:25:13.797345 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:13.797302 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/89a3edd8-bd90-41f4-a10f-c72aa564eca8-config-file\") pod \"89a3edd8-bd90-41f4-a10f-c72aa564eca8\" (UID: \"89a3edd8-bd90-41f4-a10f-c72aa564eca8\") " Jul 22 02:25:13.797808 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:13.797721 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89a3edd8-bd90-41f4-a10f-c72aa564eca8-config-file" (OuterVolumeSpecName: "config-file") pod "89a3edd8-bd90-41f4-a10f-c72aa564eca8" (UID: "89a3edd8-bd90-41f4-a10f-c72aa564eca8"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:25:13.799407 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:13.799382 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89a3edd8-bd90-41f4-a10f-c72aa564eca8-kube-api-access-k45g4" (OuterVolumeSpecName: "kube-api-access-k45g4") pod "89a3edd8-bd90-41f4-a10f-c72aa564eca8" (UID: "89a3edd8-bd90-41f4-a10f-c72aa564eca8"). InnerVolumeSpecName "kube-api-access-k45g4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:25:13.897976 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:13.897936 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k45g4\" (UniqueName: \"kubernetes.io/projected/89a3edd8-bd90-41f4-a10f-c72aa564eca8-kube-api-access-k45g4\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:25:13.897976 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:13.897965 2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/89a3edd8-bd90-41f4-a10f-c72aa564eca8-config-file\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:25:14.550872 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:14.550835 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" event={"ID":"89a3edd8-bd90-41f4-a10f-c72aa564eca8","Type":"ContainerDied","Data":"096c2ecda9c870304ce9f6b6f367c19ee2f150e58866ae2d796cb66cb1a1d7f2"} Jul 22 02:25:14.551088 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:14.550900 2579 scope.go:117] "RemoveContainer" containerID="5ed09dee32f70e1e06c5a3861f0a5319d5caf1b4613d47953d38caed2b1497ef" Jul 22 02:25:14.551088 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:14.550842 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-6m2xf" Jul 22 02:25:14.567899 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:14.567874 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6m2xf"] Jul 22 02:25:14.571000 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:14.570981 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-6m2xf"] Jul 22 02:25:16.346088 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:16.346055 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89a3edd8-bd90-41f4-a10f-c72aa564eca8" path="/var/lib/kubelet/pods/89a3edd8-bd90-41f4-a10f-c72aa564eca8/volumes" Jul 22 02:25:18.966592 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:18.966554 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:19.063554 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.063518 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:19.459746 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.459715 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h2tld"] Jul 22 02:25:19.460060 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.460047 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ee37470-d6ac-46a5-9036-cc43d546bdbe" containerName="authorino" Jul 22 02:25:19.460105 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.460061 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ee37470-d6ac-46a5-9036-cc43d546bdbe" containerName="authorino" Jul 22 02:25:19.460105 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.460070 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89a3edd8-bd90-41f4-a10f-c72aa564eca8" containerName="limitador" Jul 22 02:25:19.460105 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.460075 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="89a3edd8-bd90-41f4-a10f-c72aa564eca8" containerName="limitador" Jul 22 02:25:19.460203 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.460131 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="89a3edd8-bd90-41f4-a10f-c72aa564eca8" containerName="limitador" Jul 22 02:25:19.460203 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.460141 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ee37470-d6ac-46a5-9036-cc43d546bdbe" containerName="authorino" Jul 22 02:25:19.462584 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.462569 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2tld" Jul 22 02:25:19.465432 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.465407 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 02:25:19.465432 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.465422 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 22 02:25:19.466382 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.466359 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-ff8xz\"" Jul 22 02:25:19.466468 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.466383 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 22 02:25:19.471715 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.471694 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h2tld"] Jul 22 02:25:19.491410 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.491388 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:19.547383 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.547336 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0a36f808-24d7-429c-8813-cf6072cb3398-data\") pod \"postgres-69fb4594cf-h2tld\" (UID: \"0a36f808-24d7-429c-8813-cf6072cb3398\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2tld" Jul 22 02:25:19.547542 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.547461 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bz8t\" (UniqueName: \"kubernetes.io/projected/0a36f808-24d7-429c-8813-cf6072cb3398-kube-api-access-8bz8t\") pod \"postgres-69fb4594cf-h2tld\" (UID: \"0a36f808-24d7-429c-8813-cf6072cb3398\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2tld" Jul 22 02:25:19.648929 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.648889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0a36f808-24d7-429c-8813-cf6072cb3398-data\") pod \"postgres-69fb4594cf-h2tld\" (UID: \"0a36f808-24d7-429c-8813-cf6072cb3398\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2tld" Jul 22 02:25:19.649143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.648961 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bz8t\" (UniqueName: \"kubernetes.io/projected/0a36f808-24d7-429c-8813-cf6072cb3398-kube-api-access-8bz8t\") pod \"postgres-69fb4594cf-h2tld\" (UID: \"0a36f808-24d7-429c-8813-cf6072cb3398\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2tld" Jul 22 02:25:19.649355 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.649329 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0a36f808-24d7-429c-8813-cf6072cb3398-data\") pod \"postgres-69fb4594cf-h2tld\" (UID: \"0a36f808-24d7-429c-8813-cf6072cb3398\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2tld" Jul 22 02:25:19.657466 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.657437 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bz8t\" (UniqueName: \"kubernetes.io/projected/0a36f808-24d7-429c-8813-cf6072cb3398-kube-api-access-8bz8t\") pod \"postgres-69fb4594cf-h2tld\" (UID: \"0a36f808-24d7-429c-8813-cf6072cb3398\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2tld" Jul 22 02:25:19.773282 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.773192 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2tld" Jul 22 02:25:19.905084 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:19.904996 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h2tld"] Jul 22 02:25:19.907319 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:25:19.907291 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a36f808_24d7_429c_8813_cf6072cb3398.slice/crio-0b5dd415352a86a9ddef9fc1a1469e6f3db9147030b186475b3927b03b075e0e WatchSource:0}: Error finding container 0b5dd415352a86a9ddef9fc1a1469e6f3db9147030b186475b3927b03b075e0e: Status 404 returned error can't find the container with id 0b5dd415352a86a9ddef9fc1a1469e6f3db9147030b186475b3927b03b075e0e Jul 22 02:25:20.576069 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:20.576039 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2tld" event={"ID":"0a36f808-24d7-429c-8813-cf6072cb3398","Type":"ContainerStarted","Data":"0b5dd415352a86a9ddef9fc1a1469e6f3db9147030b186475b3927b03b075e0e"} Jul 22 02:25:25.603404 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:25.603304 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2tld" event={"ID":"0a36f808-24d7-429c-8813-cf6072cb3398","Type":"ContainerStarted","Data":"a14e30e21d33383994fc32e28d128be2215a9765ce2b4dccc92d2ff37fd1d468"} Jul 22 02:25:25.603404 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:25.603369 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2tld" Jul 22 02:25:25.632675 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:25.632617 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2tld" podStartSLOduration=1.192677995 podStartE2EDuration="6.632602871s" totalImagesPullingTime="5.439924876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:25:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:25:25.631362815 +0000 UTC m=+521.882924305" watchObservedRunningTime="2026-07-22 02:25:25.632602871 +0000 UTC m=+521.884164386" Jul 22 02:25:31.637569 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:31.637537 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2tld" Jul 22 02:25:32.004736 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.004645 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:32.233203 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.233169 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bb76k"] Jul 22 02:25:32.239044 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.239027 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bb76k" Jul 22 02:25:32.241948 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.241923 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qgq27\"" Jul 22 02:25:32.243211 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.243190 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bb76k"] Jul 22 02:25:32.363739 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.363697 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h98sn\" (UniqueName: \"kubernetes.io/projected/1baf1d2d-3900-49eb-828e-2b0580370780-kube-api-access-h98sn\") pod \"authorino-5d4b67c446-bb76k\" (UID: \"1baf1d2d-3900-49eb-828e-2b0580370780\") " pod="kuadrant-system/authorino-5d4b67c446-bb76k" Jul 22 02:25:32.464921 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.464882 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h98sn\" (UniqueName: \"kubernetes.io/projected/1baf1d2d-3900-49eb-828e-2b0580370780-kube-api-access-h98sn\") pod \"authorino-5d4b67c446-bb76k\" (UID: \"1baf1d2d-3900-49eb-828e-2b0580370780\") " pod="kuadrant-system/authorino-5d4b67c446-bb76k" Jul 22 02:25:32.474393 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.474366 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h98sn\" (UniqueName: \"kubernetes.io/projected/1baf1d2d-3900-49eb-828e-2b0580370780-kube-api-access-h98sn\") pod \"authorino-5d4b67c446-bb76k\" (UID: \"1baf1d2d-3900-49eb-828e-2b0580370780\") " pod="kuadrant-system/authorino-5d4b67c446-bb76k" Jul 22 02:25:32.509838 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.509800 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bb76k"] Jul 22 02:25:32.510091 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.510073 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bb76k" Jul 22 02:25:32.519001 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.518970 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:32.546763 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.546718 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-88c648f68-hq48l"] Jul 22 02:25:32.551915 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.551892 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-88c648f68-hq48l" Jul 22 02:25:32.559567 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.559295 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-88c648f68-hq48l"] Jul 22 02:25:32.657524 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.657454 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bb76k"] Jul 22 02:25:32.659854 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:25:32.659823 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1baf1d2d_3900_49eb_828e_2b0580370780.slice/crio-f915d0180d87ad2b9f149cb79bcb531e35aec5e6b9c52dfc474cc55e8fd16256 WatchSource:0}: Error finding container f915d0180d87ad2b9f149cb79bcb531e35aec5e6b9c52dfc474cc55e8fd16256: Status 404 returned error can't find the container with id f915d0180d87ad2b9f149cb79bcb531e35aec5e6b9c52dfc474cc55e8fd16256 Jul 22 02:25:32.667011 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.666985 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzxsr\" (UniqueName: \"kubernetes.io/projected/9202776d-f63c-41bf-9466-6c33f33ec2cf-kube-api-access-vzxsr\") pod \"authorino-88c648f68-hq48l\" (UID: \"9202776d-f63c-41bf-9466-6c33f33ec2cf\") " pod="kuadrant-system/authorino-88c648f68-hq48l" Jul 22 02:25:32.768142 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.768107 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzxsr\" (UniqueName: \"kubernetes.io/projected/9202776d-f63c-41bf-9466-6c33f33ec2cf-kube-api-access-vzxsr\") pod \"authorino-88c648f68-hq48l\" (UID: \"9202776d-f63c-41bf-9466-6c33f33ec2cf\") " pod="kuadrant-system/authorino-88c648f68-hq48l" Jul 22 02:25:32.777950 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.777928 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzxsr\" (UniqueName: \"kubernetes.io/projected/9202776d-f63c-41bf-9466-6c33f33ec2cf-kube-api-access-vzxsr\") pod \"authorino-88c648f68-hq48l\" (UID: \"9202776d-f63c-41bf-9466-6c33f33ec2cf\") " pod="kuadrant-system/authorino-88c648f68-hq48l" Jul 22 02:25:32.784333 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.784307 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-88c648f68-hq48l"] Jul 22 02:25:32.784623 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.784602 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-88c648f68-hq48l" Jul 22 02:25:32.918632 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:32.918512 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-88c648f68-hq48l"] Jul 22 02:25:32.920973 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:25:32.920942 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9202776d_f63c_41bf_9466_6c33f33ec2cf.slice/crio-141d62597f8c1584ad6afb5eb03fd8f4d1f357a69cd9a4b6ca98aeb8c6c8e8b0 WatchSource:0}: Error finding container 141d62597f8c1584ad6afb5eb03fd8f4d1f357a69cd9a4b6ca98aeb8c6c8e8b0: Status 404 returned error can't find the container with id 141d62597f8c1584ad6afb5eb03fd8f4d1f357a69cd9a4b6ca98aeb8c6c8e8b0 Jul 22 02:25:33.638404 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:33.638313 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bb76k" event={"ID":"1baf1d2d-3900-49eb-828e-2b0580370780","Type":"ContainerStarted","Data":"eebbe6de8ebd8bb94a551a890c1627969e9f5d6acef766249b1292429193f383"} Jul 22 02:25:33.638404 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:33.638330 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-bb76k" podUID="1baf1d2d-3900-49eb-828e-2b0580370780" containerName="authorino" containerID="cri-o://eebbe6de8ebd8bb94a551a890c1627969e9f5d6acef766249b1292429193f383" gracePeriod=30 Jul 22 02:25:33.638404 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:33.638361 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bb76k" event={"ID":"1baf1d2d-3900-49eb-828e-2b0580370780","Type":"ContainerStarted","Data":"f915d0180d87ad2b9f149cb79bcb531e35aec5e6b9c52dfc474cc55e8fd16256"} Jul 22 02:25:33.639994 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:33.639964 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-88c648f68-hq48l" event={"ID":"9202776d-f63c-41bf-9466-6c33f33ec2cf","Type":"ContainerStarted","Data":"3674c72a85ac934f09c105bbac4a16dd25f9a3cf0c7f6734aed16aca48ebaf6a"} Jul 22 02:25:33.640117 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:33.639989 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-88c648f68-hq48l" podUID="9202776d-f63c-41bf-9466-6c33f33ec2cf" containerName="authorino" containerID="cri-o://3674c72a85ac934f09c105bbac4a16dd25f9a3cf0c7f6734aed16aca48ebaf6a" gracePeriod=30 Jul 22 02:25:33.640117 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:33.640003 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-88c648f68-hq48l" event={"ID":"9202776d-f63c-41bf-9466-6c33f33ec2cf","Type":"ContainerStarted","Data":"141d62597f8c1584ad6afb5eb03fd8f4d1f357a69cd9a4b6ca98aeb8c6c8e8b0"} Jul 22 02:25:33.668553 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:33.668512 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-88c648f68-hq48l" podStartSLOduration=1.250832224 podStartE2EDuration="1.668495604s" totalImagesPullingTime="417.66338ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:25:33.668184759 +0000 UTC m=+529.919746273" watchObservedRunningTime="2026-07-22 02:25:33.668495604 +0000 UTC m=+529.920057142" Jul 22 02:25:33.669269 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:33.669241 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-bb76k" podStartSLOduration=1.382349984 podStartE2EDuration="1.669230557s" totalImagesPullingTime="286.880573ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:25:33.653172398 +0000 UTC m=+529.904733891" watchObservedRunningTime="2026-07-22 02:25:33.669230557 +0000 UTC m=+529.920792123" Jul 22 02:25:33.963822 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:33.963784 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-88c648f68-hq48l" Jul 22 02:25:33.975562 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:33.975531 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bb76k" Jul 22 02:25:34.079411 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.079377 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzxsr\" (UniqueName: \"kubernetes.io/projected/9202776d-f63c-41bf-9466-6c33f33ec2cf-kube-api-access-vzxsr\") pod \"9202776d-f63c-41bf-9466-6c33f33ec2cf\" (UID: \"9202776d-f63c-41bf-9466-6c33f33ec2cf\") " Jul 22 02:25:34.079601 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.079449 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h98sn\" (UniqueName: \"kubernetes.io/projected/1baf1d2d-3900-49eb-828e-2b0580370780-kube-api-access-h98sn\") pod \"1baf1d2d-3900-49eb-828e-2b0580370780\" (UID: \"1baf1d2d-3900-49eb-828e-2b0580370780\") " Jul 22 02:25:34.081393 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.081359 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9202776d-f63c-41bf-9466-6c33f33ec2cf-kube-api-access-vzxsr" (OuterVolumeSpecName: "kube-api-access-vzxsr") pod "9202776d-f63c-41bf-9466-6c33f33ec2cf" (UID: "9202776d-f63c-41bf-9466-6c33f33ec2cf"). InnerVolumeSpecName "kube-api-access-vzxsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:25:34.081527 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.081511 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1baf1d2d-3900-49eb-828e-2b0580370780-kube-api-access-h98sn" (OuterVolumeSpecName: "kube-api-access-h98sn") pod "1baf1d2d-3900-49eb-828e-2b0580370780" (UID: "1baf1d2d-3900-49eb-828e-2b0580370780"). InnerVolumeSpecName "kube-api-access-h98sn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:25:34.180642 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.180550 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzxsr\" (UniqueName: \"kubernetes.io/projected/9202776d-f63c-41bf-9466-6c33f33ec2cf-kube-api-access-vzxsr\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:25:34.180642 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.180580 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h98sn\" (UniqueName: \"kubernetes.io/projected/1baf1d2d-3900-49eb-828e-2b0580370780-kube-api-access-h98sn\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:25:34.645676 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.645640 2579 generic.go:356] "Generic (PLEG): container finished" podID="1baf1d2d-3900-49eb-828e-2b0580370780" containerID="eebbe6de8ebd8bb94a551a890c1627969e9f5d6acef766249b1292429193f383" exitCode=0 Jul 22 02:25:34.645849 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.645699 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bb76k" Jul 22 02:25:34.645849 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.645723 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bb76k" event={"ID":"1baf1d2d-3900-49eb-828e-2b0580370780","Type":"ContainerDied","Data":"eebbe6de8ebd8bb94a551a890c1627969e9f5d6acef766249b1292429193f383"} Jul 22 02:25:34.645849 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.645776 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bb76k" event={"ID":"1baf1d2d-3900-49eb-828e-2b0580370780","Type":"ContainerDied","Data":"f915d0180d87ad2b9f149cb79bcb531e35aec5e6b9c52dfc474cc55e8fd16256"} Jul 22 02:25:34.645849 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.645794 2579 scope.go:117] "RemoveContainer" containerID="eebbe6de8ebd8bb94a551a890c1627969e9f5d6acef766249b1292429193f383" Jul 22 02:25:34.647157 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.647131 2579 generic.go:356] "Generic (PLEG): container finished" podID="9202776d-f63c-41bf-9466-6c33f33ec2cf" containerID="3674c72a85ac934f09c105bbac4a16dd25f9a3cf0c7f6734aed16aca48ebaf6a" exitCode=0 Jul 22 02:25:34.647299 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.647210 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-88c648f68-hq48l" event={"ID":"9202776d-f63c-41bf-9466-6c33f33ec2cf","Type":"ContainerDied","Data":"3674c72a85ac934f09c105bbac4a16dd25f9a3cf0c7f6734aed16aca48ebaf6a"} Jul 22 02:25:34.647299 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.647239 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-88c648f68-hq48l" event={"ID":"9202776d-f63c-41bf-9466-6c33f33ec2cf","Type":"ContainerDied","Data":"141d62597f8c1584ad6afb5eb03fd8f4d1f357a69cd9a4b6ca98aeb8c6c8e8b0"} Jul 22 02:25:34.647382 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.647305 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-88c648f68-hq48l" Jul 22 02:25:34.655018 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.655000 2579 scope.go:117] "RemoveContainer" containerID="eebbe6de8ebd8bb94a551a890c1627969e9f5d6acef766249b1292429193f383" Jul 22 02:25:34.655278 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:25:34.655256 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eebbe6de8ebd8bb94a551a890c1627969e9f5d6acef766249b1292429193f383\": container with ID starting with eebbe6de8ebd8bb94a551a890c1627969e9f5d6acef766249b1292429193f383 not found: ID does not exist" containerID="eebbe6de8ebd8bb94a551a890c1627969e9f5d6acef766249b1292429193f383" Jul 22 02:25:34.655372 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.655290 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebbe6de8ebd8bb94a551a890c1627969e9f5d6acef766249b1292429193f383"} err="failed to get container status \"eebbe6de8ebd8bb94a551a890c1627969e9f5d6acef766249b1292429193f383\": rpc error: code = NotFound desc = could not find container \"eebbe6de8ebd8bb94a551a890c1627969e9f5d6acef766249b1292429193f383\": container with ID starting with eebbe6de8ebd8bb94a551a890c1627969e9f5d6acef766249b1292429193f383 not found: ID does not exist" Jul 22 02:25:34.655372 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.655312 2579 scope.go:117] "RemoveContainer" containerID="3674c72a85ac934f09c105bbac4a16dd25f9a3cf0c7f6734aed16aca48ebaf6a" Jul 22 02:25:34.662940 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.662916 2579 scope.go:117] "RemoveContainer" containerID="3674c72a85ac934f09c105bbac4a16dd25f9a3cf0c7f6734aed16aca48ebaf6a" Jul 22 02:25:34.663206 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:25:34.663187 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3674c72a85ac934f09c105bbac4a16dd25f9a3cf0c7f6734aed16aca48ebaf6a\": container with ID starting with 3674c72a85ac934f09c105bbac4a16dd25f9a3cf0c7f6734aed16aca48ebaf6a not found: ID does not exist" containerID="3674c72a85ac934f09c105bbac4a16dd25f9a3cf0c7f6734aed16aca48ebaf6a" Jul 22 02:25:34.663271 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.663211 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3674c72a85ac934f09c105bbac4a16dd25f9a3cf0c7f6734aed16aca48ebaf6a"} err="failed to get container status \"3674c72a85ac934f09c105bbac4a16dd25f9a3cf0c7f6734aed16aca48ebaf6a\": rpc error: code = NotFound desc = could not find container \"3674c72a85ac934f09c105bbac4a16dd25f9a3cf0c7f6734aed16aca48ebaf6a\": container with ID starting with 3674c72a85ac934f09c105bbac4a16dd25f9a3cf0c7f6734aed16aca48ebaf6a not found: ID does not exist" Jul 22 02:25:34.675676 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.675650 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bb76k"] Jul 22 02:25:34.684802 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.684775 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bb76k"] Jul 22 02:25:34.697320 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.697299 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-88c648f68-hq48l"] Jul 22 02:25:34.704005 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:34.703983 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-88c648f68-hq48l"] Jul 22 02:25:36.346323 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:36.346250 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1baf1d2d-3900-49eb-828e-2b0580370780" path="/var/lib/kubelet/pods/1baf1d2d-3900-49eb-828e-2b0580370780/volumes" Jul 22 02:25:36.346682 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:36.346552 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9202776d-f63c-41bf-9466-6c33f33ec2cf" path="/var/lib/kubelet/pods/9202776d-f63c-41bf-9466-6c33f33ec2cf/volumes" Jul 22 02:25:38.956107 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:38.956063 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:39.031127 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.031099 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65458f5dc4-27h7k"] Jul 22 02:25:39.031435 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.031424 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9202776d-f63c-41bf-9466-6c33f33ec2cf" containerName="authorino" Jul 22 02:25:39.031478 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.031437 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9202776d-f63c-41bf-9466-6c33f33ec2cf" containerName="authorino" Jul 22 02:25:39.031478 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.031462 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1baf1d2d-3900-49eb-828e-2b0580370780" containerName="authorino" Jul 22 02:25:39.031478 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.031468 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1baf1d2d-3900-49eb-828e-2b0580370780" containerName="authorino" Jul 22 02:25:39.031570 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.031547 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1baf1d2d-3900-49eb-828e-2b0580370780" containerName="authorino" Jul 22 02:25:39.031570 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.031555 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9202776d-f63c-41bf-9466-6c33f33ec2cf" containerName="authorino" Jul 22 02:25:39.076065 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.076031 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65458f5dc4-27h7k"] Jul 22 02:25:39.076226 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.076172 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65458f5dc4-27h7k" Jul 22 02:25:39.081382 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.081360 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 22 02:25:39.081528 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.081400 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jzlms\"" Jul 22 02:25:39.082832 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.082813 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 02:25:39.134081 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.134047 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:39.225437 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.225345 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crrgw\" (UniqueName: \"kubernetes.io/projected/9045a748-f263-4246-acca-06065344e8f6-kube-api-access-crrgw\") pod \"maas-controller-65458f5dc4-27h7k\" (UID: \"9045a748-f263-4246-acca-06065344e8f6\") " pod="opendatahub/maas-controller-65458f5dc4-27h7k" Jul 22 02:25:39.225437 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.225393 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9045a748-f263-4246-acca-06065344e8f6-webhook-cert\") pod \"maas-controller-65458f5dc4-27h7k\" (UID: \"9045a748-f263-4246-acca-06065344e8f6\") " pod="opendatahub/maas-controller-65458f5dc4-27h7k" Jul 22 02:25:39.239013 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.238979 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bb9586989-lk5qf"] Jul 22 02:25:39.241228 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.241208 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb9586989-lk5qf" Jul 22 02:25:39.264430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.264407 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb9586989-lk5qf"] Jul 22 02:25:39.322867 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.322841 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:39.326019 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.325992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crrgw\" (UniqueName: \"kubernetes.io/projected/9045a748-f263-4246-acca-06065344e8f6-kube-api-access-crrgw\") pod \"maas-controller-65458f5dc4-27h7k\" (UID: \"9045a748-f263-4246-acca-06065344e8f6\") " pod="opendatahub/maas-controller-65458f5dc4-27h7k" Jul 22 02:25:39.326140 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.326050 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9045a748-f263-4246-acca-06065344e8f6-webhook-cert\") pod \"maas-controller-65458f5dc4-27h7k\" (UID: \"9045a748-f263-4246-acca-06065344e8f6\") " pod="opendatahub/maas-controller-65458f5dc4-27h7k" Jul 22 02:25:39.328518 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.328501 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9045a748-f263-4246-acca-06065344e8f6-webhook-cert\") pod \"maas-controller-65458f5dc4-27h7k\" (UID: \"9045a748-f263-4246-acca-06065344e8f6\") " pod="opendatahub/maas-controller-65458f5dc4-27h7k" Jul 22 02:25:39.337670 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.337642 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crrgw\" (UniqueName: \"kubernetes.io/projected/9045a748-f263-4246-acca-06065344e8f6-kube-api-access-crrgw\") pod \"maas-controller-65458f5dc4-27h7k\" (UID: \"9045a748-f263-4246-acca-06065344e8f6\") " pod="opendatahub/maas-controller-65458f5dc4-27h7k" Jul 22 02:25:39.387769 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.387718 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65458f5dc4-27h7k" Jul 22 02:25:39.426647 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.426602 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p54s5\" (UniqueName: \"kubernetes.io/projected/d586a58f-9801-4191-89b2-842cfe13ece5-kube-api-access-p54s5\") pod \"maas-controller-6bb9586989-lk5qf\" (UID: \"d586a58f-9801-4191-89b2-842cfe13ece5\") " pod="opendatahub/maas-controller-6bb9586989-lk5qf" Jul 22 02:25:39.426647 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.426665 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d586a58f-9801-4191-89b2-842cfe13ece5-webhook-cert\") pod \"maas-controller-6bb9586989-lk5qf\" (UID: \"d586a58f-9801-4191-89b2-842cfe13ece5\") " pod="opendatahub/maas-controller-6bb9586989-lk5qf" Jul 22 02:25:39.527315 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.527250 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65458f5dc4-27h7k"] Jul 22 02:25:39.527512 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.527486 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d586a58f-9801-4191-89b2-842cfe13ece5-webhook-cert\") pod \"maas-controller-6bb9586989-lk5qf\" (UID: \"d586a58f-9801-4191-89b2-842cfe13ece5\") " pod="opendatahub/maas-controller-6bb9586989-lk5qf" Jul 22 02:25:39.527593 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.527580 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p54s5\" (UniqueName: \"kubernetes.io/projected/d586a58f-9801-4191-89b2-842cfe13ece5-kube-api-access-p54s5\") pod \"maas-controller-6bb9586989-lk5qf\" (UID: \"d586a58f-9801-4191-89b2-842cfe13ece5\") " pod="opendatahub/maas-controller-6bb9586989-lk5qf" Jul 22 02:25:39.529905 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.529884 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d586a58f-9801-4191-89b2-842cfe13ece5-webhook-cert\") pod \"maas-controller-6bb9586989-lk5qf\" (UID: \"d586a58f-9801-4191-89b2-842cfe13ece5\") " pod="opendatahub/maas-controller-6bb9586989-lk5qf" Jul 22 02:25:39.529998 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:25:39.529950 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9045a748_f263_4246_acca_06065344e8f6.slice/crio-c5eca64e8e85bee0b16f754ec02c4f831a512025530baf050099968069919857 WatchSource:0}: Error finding container c5eca64e8e85bee0b16f754ec02c4f831a512025530baf050099968069919857: Status 404 returned error can't find the container with id c5eca64e8e85bee0b16f754ec02c4f831a512025530baf050099968069919857 Jul 22 02:25:39.539424 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.539403 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p54s5\" (UniqueName: \"kubernetes.io/projected/d586a58f-9801-4191-89b2-842cfe13ece5-kube-api-access-p54s5\") pod \"maas-controller-6bb9586989-lk5qf\" (UID: \"d586a58f-9801-4191-89b2-842cfe13ece5\") " pod="opendatahub/maas-controller-6bb9586989-lk5qf" Jul 22 02:25:39.551284 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.551265 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb9586989-lk5qf" Jul 22 02:25:39.674952 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.674911 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65458f5dc4-27h7k" event={"ID":"9045a748-f263-4246-acca-06065344e8f6","Type":"ContainerStarted","Data":"c5eca64e8e85bee0b16f754ec02c4f831a512025530baf050099968069919857"} Jul 22 02:25:39.687221 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:39.687071 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb9586989-lk5qf"] Jul 22 02:25:39.689270 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:25:39.689240 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd586a58f_9801_4191_89b2_842cfe13ece5.slice/crio-52cab6b57e054a58b068fbd892fa5b1aaffc7f15efc5f2cff6205d2d91c4a0ec WatchSource:0}: Error finding container 52cab6b57e054a58b068fbd892fa5b1aaffc7f15efc5f2cff6205d2d91c4a0ec: Status 404 returned error can't find the container with id 52cab6b57e054a58b068fbd892fa5b1aaffc7f15efc5f2cff6205d2d91c4a0ec Jul 22 02:25:40.684208 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:40.684170 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb9586989-lk5qf" event={"ID":"d586a58f-9801-4191-89b2-842cfe13ece5","Type":"ContainerStarted","Data":"52cab6b57e054a58b068fbd892fa5b1aaffc7f15efc5f2cff6205d2d91c4a0ec"} Jul 22 02:25:42.290591 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:42.290561 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:42.448599 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:42.448556 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:25:42.696234 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:42.696205 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb9586989-lk5qf" event={"ID":"d586a58f-9801-4191-89b2-842cfe13ece5","Type":"ContainerStarted","Data":"f2d0d7a5c7b97b0e82cf41717fc88235772904e2589d74b67deef5ee6b6c8084"} Jul 22 02:25:42.696419 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:42.696292 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bb9586989-lk5qf" Jul 22 02:25:42.697728 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:42.697704 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65458f5dc4-27h7k" event={"ID":"9045a748-f263-4246-acca-06065344e8f6","Type":"ContainerStarted","Data":"f885a823b553c95fb521bd74b27cff9bfda7783224be4771f1556a211736bdec"} Jul 22 02:25:42.697856 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:42.697746 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65458f5dc4-27h7k" Jul 22 02:25:42.730260 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:42.730162 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bb9586989-lk5qf" podStartSLOduration=1.363878368 podStartE2EDuration="3.730144929s" totalImagesPullingTime="2.366266561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:25:42.728275395 +0000 UTC m=+538.979836907" watchObservedRunningTime="2026-07-22 02:25:42.730144929 +0000 UTC m=+538.981706420" Jul 22 02:25:42.769746 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:42.769680 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65458f5dc4-27h7k" podStartSLOduration=2.251092233 podStartE2EDuration="4.769656315s" totalImagesPullingTime="2.518564082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:25:42.767383776 +0000 UTC m=+539.018945270" watchObservedRunningTime="2026-07-22 02:25:42.769656315 +0000 UTC m=+539.021217808" Jul 22 02:25:53.706146 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:53.706110 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65458f5dc4-27h7k" Jul 22 02:25:53.706667 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:53.706197 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bb9586989-lk5qf" Jul 22 02:25:53.770971 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:53.770931 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65458f5dc4-27h7k"] Jul 22 02:25:53.771242 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:53.771190 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-65458f5dc4-27h7k" podUID="9045a748-f263-4246-acca-06065344e8f6" containerName="manager" containerID="cri-o://f885a823b553c95fb521bd74b27cff9bfda7783224be4771f1556a211736bdec" gracePeriod=30 Jul 22 02:25:54.014735 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:54.014711 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65458f5dc4-27h7k" Jul 22 02:25:54.043361 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:54.043334 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9045a748-f263-4246-acca-06065344e8f6-webhook-cert\") pod \"9045a748-f263-4246-acca-06065344e8f6\" (UID: \"9045a748-f263-4246-acca-06065344e8f6\") " Jul 22 02:25:54.043528 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:54.043402 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crrgw\" (UniqueName: \"kubernetes.io/projected/9045a748-f263-4246-acca-06065344e8f6-kube-api-access-crrgw\") pod \"9045a748-f263-4246-acca-06065344e8f6\" (UID: \"9045a748-f263-4246-acca-06065344e8f6\") " Jul 22 02:25:54.045533 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:54.045503 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9045a748-f263-4246-acca-06065344e8f6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9045a748-f263-4246-acca-06065344e8f6" (UID: "9045a748-f263-4246-acca-06065344e8f6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:25:54.045649 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:54.045582 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9045a748-f263-4246-acca-06065344e8f6-kube-api-access-crrgw" (OuterVolumeSpecName: "kube-api-access-crrgw") pod "9045a748-f263-4246-acca-06065344e8f6" (UID: "9045a748-f263-4246-acca-06065344e8f6"). InnerVolumeSpecName "kube-api-access-crrgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:25:54.143934 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:54.143900 2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9045a748-f263-4246-acca-06065344e8f6-webhook-cert\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:25:54.143934 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:54.143930 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crrgw\" (UniqueName: \"kubernetes.io/projected/9045a748-f263-4246-acca-06065344e8f6-kube-api-access-crrgw\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:25:54.752903 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:54.752820 2579 generic.go:356] "Generic (PLEG): container finished" podID="9045a748-f263-4246-acca-06065344e8f6" containerID="f885a823b553c95fb521bd74b27cff9bfda7783224be4771f1556a211736bdec" exitCode=0 Jul 22 02:25:54.752903 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:54.752873 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65458f5dc4-27h7k" Jul 22 02:25:54.753318 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:54.752902 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65458f5dc4-27h7k" event={"ID":"9045a748-f263-4246-acca-06065344e8f6","Type":"ContainerDied","Data":"f885a823b553c95fb521bd74b27cff9bfda7783224be4771f1556a211736bdec"} Jul 22 02:25:54.753318 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:54.752960 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65458f5dc4-27h7k" event={"ID":"9045a748-f263-4246-acca-06065344e8f6","Type":"ContainerDied","Data":"c5eca64e8e85bee0b16f754ec02c4f831a512025530baf050099968069919857"} Jul 22 02:25:54.753318 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:54.752990 2579 scope.go:117] "RemoveContainer" containerID="f885a823b553c95fb521bd74b27cff9bfda7783224be4771f1556a211736bdec" Jul 22 02:25:54.760976 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:54.760948 2579 scope.go:117] "RemoveContainer" containerID="f885a823b553c95fb521bd74b27cff9bfda7783224be4771f1556a211736bdec" Jul 22 02:25:54.761237 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:25:54.761217 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f885a823b553c95fb521bd74b27cff9bfda7783224be4771f1556a211736bdec\": container with ID starting with f885a823b553c95fb521bd74b27cff9bfda7783224be4771f1556a211736bdec not found: ID does not exist" containerID="f885a823b553c95fb521bd74b27cff9bfda7783224be4771f1556a211736bdec" Jul 22 02:25:54.761307 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:54.761247 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f885a823b553c95fb521bd74b27cff9bfda7783224be4771f1556a211736bdec"} err="failed to get container status \"f885a823b553c95fb521bd74b27cff9bfda7783224be4771f1556a211736bdec\": rpc error: code = NotFound desc = could not find container \"f885a823b553c95fb521bd74b27cff9bfda7783224be4771f1556a211736bdec\": container with ID starting with f885a823b553c95fb521bd74b27cff9bfda7783224be4771f1556a211736bdec not found: ID does not exist" Jul 22 02:25:54.769767 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:54.769734 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65458f5dc4-27h7k"] Jul 22 02:25:54.774432 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:54.774404 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-65458f5dc4-27h7k"] Jul 22 02:25:56.345910 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:25:56.345882 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9045a748-f263-4246-acca-06065344e8f6" path="/var/lib/kubelet/pods/9045a748-f263-4246-acca-06065344e8f6/volumes" Jul 22 02:26:14.120345 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:14.120303 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:14.259704 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:14.259672 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:14.692433 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:14.692404 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:14.824672 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:14.824629 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk"] Jul 22 02:26:14.824991 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:14.824977 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9045a748-f263-4246-acca-06065344e8f6" containerName="manager" Jul 22 02:26:14.825033 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:14.824993 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9045a748-f263-4246-acca-06065344e8f6" containerName="manager" Jul 22 02:26:14.825070 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:14.825046 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9045a748-f263-4246-acca-06065344e8f6" containerName="manager" Jul 22 02:26:14.827897 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:14.827882 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk" Jul 22 02:26:14.832530 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:14.832506 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 22 02:26:14.832643 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:14.832595 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9nl5f\"" Jul 22 02:26:14.841579 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:14.841554 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk"] Jul 22 02:26:14.913667 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:14.913639 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f13303-264a-4cd2-af1c-ce3da0c1567b-maas-api-tls\") pod \"maas-api-5b77f8c7b9-kr5tk\" (UID: \"04f13303-264a-4cd2-af1c-ce3da0c1567b\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk" Jul 22 02:26:14.913831 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:14.913715 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvkqj\" (UniqueName: \"kubernetes.io/projected/04f13303-264a-4cd2-af1c-ce3da0c1567b-kube-api-access-jvkqj\") pod \"maas-api-5b77f8c7b9-kr5tk\" (UID: \"04f13303-264a-4cd2-af1c-ce3da0c1567b\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk" Jul 22 02:26:14.913831 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:14.913773 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f13303-264a-4cd2-af1c-ce3da0c1567b-openshift-service-ca\") pod \"maas-api-5b77f8c7b9-kr5tk\" (UID: \"04f13303-264a-4cd2-af1c-ce3da0c1567b\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk" Jul 22 02:26:15.014390 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:15.014313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f13303-264a-4cd2-af1c-ce3da0c1567b-openshift-service-ca\") pod \"maas-api-5b77f8c7b9-kr5tk\" (UID: \"04f13303-264a-4cd2-af1c-ce3da0c1567b\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk" Jul 22 02:26:15.014390 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:15.014359 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f13303-264a-4cd2-af1c-ce3da0c1567b-maas-api-tls\") pod \"maas-api-5b77f8c7b9-kr5tk\" (UID: \"04f13303-264a-4cd2-af1c-ce3da0c1567b\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk" Jul 22 02:26:15.014589 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:15.014422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvkqj\" (UniqueName: \"kubernetes.io/projected/04f13303-264a-4cd2-af1c-ce3da0c1567b-kube-api-access-jvkqj\") pod \"maas-api-5b77f8c7b9-kr5tk\" (UID: \"04f13303-264a-4cd2-af1c-ce3da0c1567b\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk" Jul 22 02:26:15.014975 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:15.014953 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f13303-264a-4cd2-af1c-ce3da0c1567b-openshift-service-ca\") pod \"maas-api-5b77f8c7b9-kr5tk\" (UID: \"04f13303-264a-4cd2-af1c-ce3da0c1567b\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk" Jul 22 02:26:15.016777 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:15.016743 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f13303-264a-4cd2-af1c-ce3da0c1567b-maas-api-tls\") pod \"maas-api-5b77f8c7b9-kr5tk\" (UID: \"04f13303-264a-4cd2-af1c-ce3da0c1567b\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk" Jul 22 02:26:15.029892 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:15.029863 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvkqj\" (UniqueName: \"kubernetes.io/projected/04f13303-264a-4cd2-af1c-ce3da0c1567b-kube-api-access-jvkqj\") pod \"maas-api-5b77f8c7b9-kr5tk\" (UID: \"04f13303-264a-4cd2-af1c-ce3da0c1567b\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk" Jul 22 02:26:15.106635 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:15.106598 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:15.138298 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:15.138272 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk" Jul 22 02:26:15.276133 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:15.276106 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk"] Jul 22 02:26:15.278546 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:26:15.278519 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f13303_264a_4cd2_af1c_ce3da0c1567b.slice/crio-237d0a4abdf7d67d64947a2c2265c1c4d9f2c3674ba14dfcd5d1afc89e371c31 WatchSource:0}: Error finding container 237d0a4abdf7d67d64947a2c2265c1c4d9f2c3674ba14dfcd5d1afc89e371c31: Status 404 returned error can't find the container with id 237d0a4abdf7d67d64947a2c2265c1c4d9f2c3674ba14dfcd5d1afc89e371c31 Jul 22 02:26:15.629982 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:15.629946 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:15.830467 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:15.830415 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:15.851231 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:15.851197 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk" event={"ID":"04f13303-264a-4cd2-af1c-ce3da0c1567b","Type":"ContainerStarted","Data":"237d0a4abdf7d67d64947a2c2265c1c4d9f2c3674ba14dfcd5d1afc89e371c31"} Jul 22 02:26:16.220977 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:16.220945 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-fjh96"] Jul 22 02:26:16.224625 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:16.224604 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-fjh96" Jul 22 02:26:16.227807 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:16.227785 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xrm96\"" Jul 22 02:26:16.228170 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:16.228151 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 22 02:26:16.263073 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:16.263039 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-fjh96"] Jul 22 02:26:16.326051 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:16.326011 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5813a3d5-719d-4cbb-8437-067923ab504d-plugins-config-volume\") pod \"payload-processing-5bf47cd988-fjh96\" (UID: \"5813a3d5-719d-4cbb-8437-067923ab504d\") " pod="openshift-ingress/payload-processing-5bf47cd988-fjh96" Jul 22 02:26:16.326051 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:16.326048 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42twq\" (UniqueName: \"kubernetes.io/projected/5813a3d5-719d-4cbb-8437-067923ab504d-kube-api-access-42twq\") pod \"payload-processing-5bf47cd988-fjh96\" (UID: \"5813a3d5-719d-4cbb-8437-067923ab504d\") " pod="openshift-ingress/payload-processing-5bf47cd988-fjh96" Jul 22 02:26:16.427489 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:16.427444 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5813a3d5-719d-4cbb-8437-067923ab504d-plugins-config-volume\") pod \"payload-processing-5bf47cd988-fjh96\" (UID: \"5813a3d5-719d-4cbb-8437-067923ab504d\") " pod="openshift-ingress/payload-processing-5bf47cd988-fjh96" Jul 22 02:26:16.427677 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:16.427494 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42twq\" (UniqueName: \"kubernetes.io/projected/5813a3d5-719d-4cbb-8437-067923ab504d-kube-api-access-42twq\") pod \"payload-processing-5bf47cd988-fjh96\" (UID: \"5813a3d5-719d-4cbb-8437-067923ab504d\") " pod="openshift-ingress/payload-processing-5bf47cd988-fjh96" Jul 22 02:26:16.428206 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:16.428184 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5813a3d5-719d-4cbb-8437-067923ab504d-plugins-config-volume\") pod \"payload-processing-5bf47cd988-fjh96\" (UID: \"5813a3d5-719d-4cbb-8437-067923ab504d\") " pod="openshift-ingress/payload-processing-5bf47cd988-fjh96" Jul 22 02:26:16.443315 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:16.443275 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42twq\" (UniqueName: \"kubernetes.io/projected/5813a3d5-719d-4cbb-8437-067923ab504d-kube-api-access-42twq\") pod \"payload-processing-5bf47cd988-fjh96\" (UID: \"5813a3d5-719d-4cbb-8437-067923ab504d\") " pod="openshift-ingress/payload-processing-5bf47cd988-fjh96" Jul 22 02:26:16.534585 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:16.534501 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-fjh96" Jul 22 02:26:16.941529 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:16.941506 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-fjh96"] Jul 22 02:26:16.943934 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:26:16.943906 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5813a3d5_719d_4cbb_8437_067923ab504d.slice/crio-6cec6e411901c199244e919432a8670f1f5688fbacd35ba70ab6bc98205cc55e WatchSource:0}: Error finding container 6cec6e411901c199244e919432a8670f1f5688fbacd35ba70ab6bc98205cc55e: Status 404 returned error can't find the container with id 6cec6e411901c199244e919432a8670f1f5688fbacd35ba70ab6bc98205cc55e Jul 22 02:26:17.864917 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:17.864880 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk" event={"ID":"04f13303-264a-4cd2-af1c-ce3da0c1567b","Type":"ContainerStarted","Data":"a38360b0a09de162ee5df826f6e944291ef5a535a702c2f624e7086ccc2f1b64"} Jul 22 02:26:17.865417 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:17.864980 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk" Jul 22 02:26:17.866151 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:17.866122 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-fjh96" event={"ID":"5813a3d5-719d-4cbb-8437-067923ab504d","Type":"ContainerStarted","Data":"6cec6e411901c199244e919432a8670f1f5688fbacd35ba70ab6bc98205cc55e"} Jul 22 02:26:17.907076 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:17.907028 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk" podStartSLOduration=2.354460157 podStartE2EDuration="3.907010651s" totalImagesPullingTime="1.552550494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:26:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:26:17.906490518 +0000 UTC m=+574.158052045" watchObservedRunningTime="2026-07-22 02:26:17.907010651 +0000 UTC m=+574.158572142" Jul 22 02:26:18.872552 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:18.872518 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-fjh96" event={"ID":"5813a3d5-719d-4cbb-8437-067923ab504d","Type":"ContainerStarted","Data":"a8efa2cad3404dafdce067f28dd5ef95cf41290baf8997fb2576c5d525c57029"} Jul 22 02:26:18.873054 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:18.872746 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-fjh96" Jul 22 02:26:18.899910 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:18.899858 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-fjh96" podStartSLOduration=1.5241413110000002 podStartE2EDuration="2.899837313s" totalImagesPullingTime="1.375696002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:26:18.899401724 +0000 UTC m=+575.150963234" watchObservedRunningTime="2026-07-22 02:26:18.899837313 +0000 UTC m=+575.151398804" Jul 22 02:26:23.877685 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:23.877652 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-kr5tk" Jul 22 02:26:25.708911 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:25.708870 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:27.142003 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:27.141967 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:29.878985 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:29.878955 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-fjh96" Jul 22 02:26:32.621077 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:32.621045 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:37.235842 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.235811 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56"] Jul 22 02:26:37.238997 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.238979 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.242609 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.242587 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 22 02:26:37.243208 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.243190 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 22 02:26:37.243306 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.243213 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 22 02:26:37.243306 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.243258 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rs444\"" Jul 22 02:26:37.260123 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.260096 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56"] Jul 22 02:26:37.310976 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.310947 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52160973-04e8-49b4-86bd-600fe5581930-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.310976 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.310982 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52160973-04e8-49b4-86bd-600fe5581930-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.311162 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.311002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52160973-04e8-49b4-86bd-600fe5581930-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.311162 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.311075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52160973-04e8-49b4-86bd-600fe5581930-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.311162 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.311101 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52160973-04e8-49b4-86bd-600fe5581930-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.311162 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.311136 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh9zv\" (UniqueName: \"kubernetes.io/projected/52160973-04e8-49b4-86bd-600fe5581930-kube-api-access-zh9zv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.363876 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.363837 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:37.411572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.411542 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52160973-04e8-49b4-86bd-600fe5581930-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.411572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.411574 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52160973-04e8-49b4-86bd-600fe5581930-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.411835 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.411604 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh9zv\" (UniqueName: \"kubernetes.io/projected/52160973-04e8-49b4-86bd-600fe5581930-kube-api-access-zh9zv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.411835 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.411645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52160973-04e8-49b4-86bd-600fe5581930-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.411835 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.411664 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52160973-04e8-49b4-86bd-600fe5581930-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.411835 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.411680 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52160973-04e8-49b4-86bd-600fe5581930-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.412066 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.412041 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52160973-04e8-49b4-86bd-600fe5581930-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.412120 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.412061 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52160973-04e8-49b4-86bd-600fe5581930-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.412159 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.412136 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52160973-04e8-49b4-86bd-600fe5581930-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.413891 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.413873 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52160973-04e8-49b4-86bd-600fe5581930-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.414127 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.414109 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52160973-04e8-49b4-86bd-600fe5581930-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.422577 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.422556 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh9zv\" (UniqueName: \"kubernetes.io/projected/52160973-04e8-49b4-86bd-600fe5581930-kube-api-access-zh9zv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xkz56\" (UID: \"52160973-04e8-49b4-86bd-600fe5581930\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.549445 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.549363 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:37.685554 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.685531 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56"] Jul 22 02:26:37.687920 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:26:37.687890 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52160973_04e8_49b4_86bd_600fe5581930.slice/crio-b81e6a95ce26895c35b9af0ab4f59136ff945427d0a679e72abd1d3cae0a45ac WatchSource:0}: Error finding container b81e6a95ce26895c35b9af0ab4f59136ff945427d0a679e72abd1d3cae0a45ac: Status 404 returned error can't find the container with id b81e6a95ce26895c35b9af0ab4f59136ff945427d0a679e72abd1d3cae0a45ac Jul 22 02:26:37.955537 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:37.955501 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" event={"ID":"52160973-04e8-49b4-86bd-600fe5581930","Type":"ContainerStarted","Data":"b81e6a95ce26895c35b9af0ab4f59136ff945427d0a679e72abd1d3cae0a45ac"} Jul 22 02:26:38.962329 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:38.962294 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" event={"ID":"52160973-04e8-49b4-86bd-600fe5581930","Type":"ContainerStarted","Data":"ee970cb26d4f9486caf180c3dc2990db2a928ffc9b1cf62496db81bcac7f31b2"} Jul 22 02:26:38.985198 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:38.985152 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" podStartSLOduration=0.92755003 podStartE2EDuration="1.985137835s" totalImagesPullingTime="1.057587805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:26:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:26:38.983574135 +0000 UTC m=+595.235135633" watchObservedRunningTime="2026-07-22 02:26:38.985137835 +0000 UTC m=+595.236699328" Jul 22 02:26:40.514414 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:40.514377 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:47.549549 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:47.549513 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:47.552057 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:47.549582 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:47.562190 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:47.562160 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:48.012093 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:48.012065 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xkz56" Jul 22 02:26:48.818567 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:48.818531 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz"] Jul 22 02:26:48.821927 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:48.821905 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:48.824405 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:48.824387 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 22 02:26:48.832642 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:48.832619 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz"] Jul 22 02:26:48.844467 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:48.844446 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:48.909610 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:48.909573 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca8b100c-2fb1-4616-87fa-d9940a847fa5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:48.909610 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:48.909613 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca8b100c-2fb1-4616-87fa-d9940a847fa5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:48.909891 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:48.909637 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca8b100c-2fb1-4616-87fa-d9940a847fa5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:48.909891 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:48.909717 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8b100c-2fb1-4616-87fa-d9940a847fa5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:48.909891 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:48.909814 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5b25\" (UniqueName: \"kubernetes.io/projected/ca8b100c-2fb1-4616-87fa-d9940a847fa5-kube-api-access-t5b25\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:48.909891 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:48.909858 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca8b100c-2fb1-4616-87fa-d9940a847fa5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:49.011158 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:49.011126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca8b100c-2fb1-4616-87fa-d9940a847fa5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:49.011158 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:49.011162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca8b100c-2fb1-4616-87fa-d9940a847fa5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:49.011366 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:49.011185 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca8b100c-2fb1-4616-87fa-d9940a847fa5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:49.011366 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:49.011295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8b100c-2fb1-4616-87fa-d9940a847fa5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:49.011366 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:49.011340 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5b25\" (UniqueName: \"kubernetes.io/projected/ca8b100c-2fb1-4616-87fa-d9940a847fa5-kube-api-access-t5b25\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:49.011484 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:49.011372 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca8b100c-2fb1-4616-87fa-d9940a847fa5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:49.011618 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:49.011598 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca8b100c-2fb1-4616-87fa-d9940a847fa5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:49.011692 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:49.011623 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca8b100c-2fb1-4616-87fa-d9940a847fa5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:49.011806 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:49.011787 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca8b100c-2fb1-4616-87fa-d9940a847fa5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:49.013381 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:49.013359 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca8b100c-2fb1-4616-87fa-d9940a847fa5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:49.013684 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:49.013665 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca8b100c-2fb1-4616-87fa-d9940a847fa5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:49.020739 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:49.020716 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5b25\" (UniqueName: \"kubernetes.io/projected/ca8b100c-2fb1-4616-87fa-d9940a847fa5-kube-api-access-t5b25\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz\" (UID: \"ca8b100c-2fb1-4616-87fa-d9940a847fa5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:49.132248 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:49.132173 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:49.268059 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:49.268022 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz"] Jul 22 02:26:49.272824 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:26:49.272796 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca8b100c_2fb1_4616_87fa_d9940a847fa5.slice/crio-7cba1c2bd2ed69f1c85ff1a162f44aa319bf2af62ef593f3b392558cccd0339e WatchSource:0}: Error finding container 7cba1c2bd2ed69f1c85ff1a162f44aa319bf2af62ef593f3b392558cccd0339e: Status 404 returned error can't find the container with id 7cba1c2bd2ed69f1c85ff1a162f44aa319bf2af62ef593f3b392558cccd0339e Jul 22 02:26:50.012628 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:50.012594 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" event={"ID":"ca8b100c-2fb1-4616-87fa-d9940a847fa5","Type":"ContainerStarted","Data":"486323a26aa636a8cb96f6a0cf5e5537573e2a2ae1862e08c1c93b64ddbcdfc4"} Jul 22 02:26:50.013053 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:50.012653 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" event={"ID":"ca8b100c-2fb1-4616-87fa-d9940a847fa5","Type":"ContainerStarted","Data":"7cba1c2bd2ed69f1c85ff1a162f44aa319bf2af62ef593f3b392558cccd0339e"} Jul 22 02:26:50.037859 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:50.037811 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" podStartSLOduration=1.866422888 podStartE2EDuration="2.03779545s" totalImagesPullingTime="171.372562ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:26:50.035481093 +0000 UTC m=+606.287042605" watchObservedRunningTime="2026-07-22 02:26:50.03779545 +0000 UTC m=+606.289356942" Jul 22 02:26:59.050006 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:59.049973 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:26:59.133078 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:59.133047 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:59.133241 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:59.133104 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:59.145463 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:59.145431 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:26:59.150602 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:26:59.150579 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:27:00.069640 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:00.069609 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz" Jul 22 02:27:10.959238 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:10.959162 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:27:19.108860 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.108826 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7"] Jul 22 02:27:19.114954 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.114932 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.117657 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.117634 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 22 02:27:19.124635 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.124615 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7"] Jul 22 02:27:19.142897 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.142875 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:27:19.288023 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.287992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/510749b5-a1eb-413d-8c65-8ac02a092d7c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.288189 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.288052 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/510749b5-a1eb-413d-8c65-8ac02a092d7c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.288189 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.288103 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/510749b5-a1eb-413d-8c65-8ac02a092d7c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.288189 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.288120 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/510749b5-a1eb-413d-8c65-8ac02a092d7c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.288301 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.288194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf4qt\" (UniqueName: \"kubernetes.io/projected/510749b5-a1eb-413d-8c65-8ac02a092d7c-kube-api-access-hf4qt\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.288301 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.288252 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/510749b5-a1eb-413d-8c65-8ac02a092d7c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.388939 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.388860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/510749b5-a1eb-413d-8c65-8ac02a092d7c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.388939 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.388913 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/510749b5-a1eb-413d-8c65-8ac02a092d7c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.389143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.388952 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/510749b5-a1eb-413d-8c65-8ac02a092d7c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.389143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.388974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/510749b5-a1eb-413d-8c65-8ac02a092d7c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.389143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.389005 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf4qt\" (UniqueName: \"kubernetes.io/projected/510749b5-a1eb-413d-8c65-8ac02a092d7c-kube-api-access-hf4qt\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.389143 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.389040 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/510749b5-a1eb-413d-8c65-8ac02a092d7c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.389417 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.389388 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/510749b5-a1eb-413d-8c65-8ac02a092d7c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.389555 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.389416 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/510749b5-a1eb-413d-8c65-8ac02a092d7c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.389555 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.389482 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/510749b5-a1eb-413d-8c65-8ac02a092d7c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.391249 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.391227 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/510749b5-a1eb-413d-8c65-8ac02a092d7c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.391534 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.391515 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/510749b5-a1eb-413d-8c65-8ac02a092d7c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.397743 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.397724 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf4qt\" (UniqueName: \"kubernetes.io/projected/510749b5-a1eb-413d-8c65-8ac02a092d7c-kube-api-access-hf4qt\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7\" (UID: \"510749b5-a1eb-413d-8c65-8ac02a092d7c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.425720 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.425696 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:19.569104 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.569079 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7"] Jul 22 02:27:19.570806 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:27:19.570780 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod510749b5_a1eb_413d_8c65_8ac02a092d7c.slice/crio-6b0ff11fa5ed1396f9a955ee3fe7eb89e407e1e39530136b15184e068ddac7da WatchSource:0}: Error finding container 6b0ff11fa5ed1396f9a955ee3fe7eb89e407e1e39530136b15184e068ddac7da: Status 404 returned error can't find the container with id 6b0ff11fa5ed1396f9a955ee3fe7eb89e407e1e39530136b15184e068ddac7da Jul 22 02:27:19.572153 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:19.572132 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 02:27:20.150584 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:20.150542 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" event={"ID":"510749b5-a1eb-413d-8c65-8ac02a092d7c","Type":"ContainerStarted","Data":"f0276edbf4741b9c59e864413f3800bef18f00d275914f7a92cfc428e10b0372"} Jul 22 02:27:20.150584 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:20.150590 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" event={"ID":"510749b5-a1eb-413d-8c65-8ac02a092d7c","Type":"ContainerStarted","Data":"6b0ff11fa5ed1396f9a955ee3fe7eb89e407e1e39530136b15184e068ddac7da"} Jul 22 02:27:20.169521 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:20.169466 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" podStartSLOduration=0.992772499 podStartE2EDuration="1.169450572s" totalImagesPullingTime="176.678073ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:27:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:27:20.167971171 +0000 UTC m=+636.419532664" watchObservedRunningTime="2026-07-22 02:27:20.169450572 +0000 UTC m=+636.421012064" Jul 22 02:27:29.426582 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:29.426523 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:29.427129 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:29.426601 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:29.439091 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:29.439064 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:30.206663 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:30.206634 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7" Jul 22 02:27:46.691181 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:46.691145 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:27:46.793856 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:27:46.793809 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:28:09.691856 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:09.691809 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:28:09.786492 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:09.786415 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:28:10.895817 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:10.895776 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:28:10.979977 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:10.979947 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:28:20.157191 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:20.157157 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:28:20.257869 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:20.257840 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:28:36.078203 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:36.078121 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:28:56.991923 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:56.991889 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bb9586989-lk5qf"] Jul 22 02:28:56.992355 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:56.992093 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6bb9586989-lk5qf" podUID="d586a58f-9801-4191-89b2-842cfe13ece5" containerName="manager" containerID="cri-o://f2d0d7a5c7b97b0e82cf41717fc88235772904e2589d74b67deef5ee6b6c8084" gracePeriod=30 Jul 22 02:28:57.237657 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:57.237633 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb9586989-lk5qf" Jul 22 02:28:57.261085 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:57.260999 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p54s5\" (UniqueName: \"kubernetes.io/projected/d586a58f-9801-4191-89b2-842cfe13ece5-kube-api-access-p54s5\") pod \"d586a58f-9801-4191-89b2-842cfe13ece5\" (UID: \"d586a58f-9801-4191-89b2-842cfe13ece5\") " Jul 22 02:28:57.261242 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:57.261144 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d586a58f-9801-4191-89b2-842cfe13ece5-webhook-cert\") pod \"d586a58f-9801-4191-89b2-842cfe13ece5\" (UID: \"d586a58f-9801-4191-89b2-842cfe13ece5\") " Jul 22 02:28:57.263283 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:57.263252 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d586a58f-9801-4191-89b2-842cfe13ece5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d586a58f-9801-4191-89b2-842cfe13ece5" (UID: "d586a58f-9801-4191-89b2-842cfe13ece5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:28:57.263564 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:57.263542 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d586a58f-9801-4191-89b2-842cfe13ece5-kube-api-access-p54s5" (OuterVolumeSpecName: "kube-api-access-p54s5") pod "d586a58f-9801-4191-89b2-842cfe13ece5" (UID: "d586a58f-9801-4191-89b2-842cfe13ece5"). InnerVolumeSpecName "kube-api-access-p54s5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:28:57.362197 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:57.362161 2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d586a58f-9801-4191-89b2-842cfe13ece5-webhook-cert\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:28:57.362197 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:57.362195 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p54s5\" (UniqueName: \"kubernetes.io/projected/d586a58f-9801-4191-89b2-842cfe13ece5-kube-api-access-p54s5\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:28:57.582364 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:57.582331 2579 generic.go:356] "Generic (PLEG): container finished" podID="d586a58f-9801-4191-89b2-842cfe13ece5" containerID="f2d0d7a5c7b97b0e82cf41717fc88235772904e2589d74b67deef5ee6b6c8084" exitCode=0 Jul 22 02:28:57.582571 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:57.582372 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb9586989-lk5qf" Jul 22 02:28:57.582571 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:57.582385 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb9586989-lk5qf" event={"ID":"d586a58f-9801-4191-89b2-842cfe13ece5","Type":"ContainerDied","Data":"f2d0d7a5c7b97b0e82cf41717fc88235772904e2589d74b67deef5ee6b6c8084"} Jul 22 02:28:57.582571 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:57.582427 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb9586989-lk5qf" event={"ID":"d586a58f-9801-4191-89b2-842cfe13ece5","Type":"ContainerDied","Data":"52cab6b57e054a58b068fbd892fa5b1aaffc7f15efc5f2cff6205d2d91c4a0ec"} Jul 22 02:28:57.582571 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:57.582447 2579 scope.go:117] "RemoveContainer" containerID="f2d0d7a5c7b97b0e82cf41717fc88235772904e2589d74b67deef5ee6b6c8084" Jul 22 02:28:57.592121 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:57.592106 2579 scope.go:117] "RemoveContainer" containerID="f2d0d7a5c7b97b0e82cf41717fc88235772904e2589d74b67deef5ee6b6c8084" Jul 22 02:28:57.592402 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:28:57.592382 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2d0d7a5c7b97b0e82cf41717fc88235772904e2589d74b67deef5ee6b6c8084\": container with ID starting with f2d0d7a5c7b97b0e82cf41717fc88235772904e2589d74b67deef5ee6b6c8084 not found: ID does not exist" containerID="f2d0d7a5c7b97b0e82cf41717fc88235772904e2589d74b67deef5ee6b6c8084" Jul 22 02:28:57.592459 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:57.592411 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2d0d7a5c7b97b0e82cf41717fc88235772904e2589d74b67deef5ee6b6c8084"} err="failed to get container status \"f2d0d7a5c7b97b0e82cf41717fc88235772904e2589d74b67deef5ee6b6c8084\": rpc error: code = NotFound desc = could not find container \"f2d0d7a5c7b97b0e82cf41717fc88235772904e2589d74b67deef5ee6b6c8084\": container with ID starting with f2d0d7a5c7b97b0e82cf41717fc88235772904e2589d74b67deef5ee6b6c8084 not found: ID does not exist" Jul 22 02:28:57.605948 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:57.605918 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bb9586989-lk5qf"] Jul 22 02:28:57.610337 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:57.610310 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bb9586989-lk5qf"] Jul 22 02:28:58.346678 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:28:58.346644 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d586a58f-9801-4191-89b2-842cfe13ece5" path="/var/lib/kubelet/pods/d586a58f-9801-4191-89b2-842cfe13ece5/volumes" Jul 22 02:29:05.751416 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:05.751381 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:29:05.851687 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:05.851649 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:29:58.445327 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:58.445292 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bb9586989-r5nzz"] Jul 22 02:29:58.445847 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:58.445835 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d586a58f-9801-4191-89b2-842cfe13ece5" containerName="manager" Jul 22 02:29:58.445917 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:58.445854 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d586a58f-9801-4191-89b2-842cfe13ece5" containerName="manager" Jul 22 02:29:58.445969 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:58.445953 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d586a58f-9801-4191-89b2-842cfe13ece5" containerName="manager" Jul 22 02:29:58.450264 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:58.450242 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb9586989-r5nzz" Jul 22 02:29:58.452980 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:58.452960 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 02:29:58.454071 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:58.454046 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 22 02:29:58.454071 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:58.454059 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jzlms\"" Jul 22 02:29:58.459123 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:58.459098 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb9586989-r5nzz"] Jul 22 02:29:58.494728 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:58.494694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tk9f\" (UniqueName: \"kubernetes.io/projected/0f17c2b5-4294-4501-b1a0-bad60f1d2ca4-kube-api-access-5tk9f\") pod \"maas-controller-6bb9586989-r5nzz\" (UID: \"0f17c2b5-4294-4501-b1a0-bad60f1d2ca4\") " pod="opendatahub/maas-controller-6bb9586989-r5nzz" Jul 22 02:29:58.494878 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:58.494745 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f17c2b5-4294-4501-b1a0-bad60f1d2ca4-webhook-cert\") pod \"maas-controller-6bb9586989-r5nzz\" (UID: \"0f17c2b5-4294-4501-b1a0-bad60f1d2ca4\") " pod="opendatahub/maas-controller-6bb9586989-r5nzz" Jul 22 02:29:58.595474 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:58.595428 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tk9f\" (UniqueName: \"kubernetes.io/projected/0f17c2b5-4294-4501-b1a0-bad60f1d2ca4-kube-api-access-5tk9f\") pod \"maas-controller-6bb9586989-r5nzz\" (UID: \"0f17c2b5-4294-4501-b1a0-bad60f1d2ca4\") " pod="opendatahub/maas-controller-6bb9586989-r5nzz" Jul 22 02:29:58.595687 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:58.595515 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f17c2b5-4294-4501-b1a0-bad60f1d2ca4-webhook-cert\") pod \"maas-controller-6bb9586989-r5nzz\" (UID: \"0f17c2b5-4294-4501-b1a0-bad60f1d2ca4\") " pod="opendatahub/maas-controller-6bb9586989-r5nzz" Jul 22 02:29:58.597974 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:58.597950 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f17c2b5-4294-4501-b1a0-bad60f1d2ca4-webhook-cert\") pod \"maas-controller-6bb9586989-r5nzz\" (UID: \"0f17c2b5-4294-4501-b1a0-bad60f1d2ca4\") " pod="opendatahub/maas-controller-6bb9586989-r5nzz" Jul 22 02:29:58.605285 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:58.605261 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tk9f\" (UniqueName: \"kubernetes.io/projected/0f17c2b5-4294-4501-b1a0-bad60f1d2ca4-kube-api-access-5tk9f\") pod \"maas-controller-6bb9586989-r5nzz\" (UID: \"0f17c2b5-4294-4501-b1a0-bad60f1d2ca4\") " pod="opendatahub/maas-controller-6bb9586989-r5nzz" Jul 22 02:29:58.760963 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:58.760871 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb9586989-r5nzz" Jul 22 02:29:58.891659 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:58.891631 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb9586989-r5nzz"] Jul 22 02:29:58.894367 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:29:58.894342 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f17c2b5_4294_4501_b1a0_bad60f1d2ca4.slice/crio-421d6273db4a73ed125b6a33b7d69bc45dcf5de2781a976881c34232d3969e1b WatchSource:0}: Error finding container 421d6273db4a73ed125b6a33b7d69bc45dcf5de2781a976881c34232d3969e1b: Status 404 returned error can't find the container with id 421d6273db4a73ed125b6a33b7d69bc45dcf5de2781a976881c34232d3969e1b Jul 22 02:29:59.857319 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:59.857279 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb9586989-r5nzz" event={"ID":"0f17c2b5-4294-4501-b1a0-bad60f1d2ca4","Type":"ContainerStarted","Data":"1ac0bd3abaee1cc07b8405dcd8f9826908c889841a27fd8c6d241cd6161b44a1"} Jul 22 02:29:59.857824 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:59.857356 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb9586989-r5nzz" event={"ID":"0f17c2b5-4294-4501-b1a0-bad60f1d2ca4","Type":"ContainerStarted","Data":"421d6273db4a73ed125b6a33b7d69bc45dcf5de2781a976881c34232d3969e1b"} Jul 22 02:29:59.857824 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:59.857391 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bb9586989-r5nzz" Jul 22 02:29:59.878679 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:29:59.878626 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bb9586989-r5nzz" podStartSLOduration=1.266510039 podStartE2EDuration="1.878607386s" totalImagesPullingTime="612.097347ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:29:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:29:59.876158954 +0000 UTC m=+796.127720446" watchObservedRunningTime="2026-07-22 02:29:59.878607386 +0000 UTC m=+796.130168894" Jul 22 02:30:10.865395 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:10.865313 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bb9586989-r5nzz" Jul 22 02:30:15.415603 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.415569 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:30:15.506190 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.506157 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bb9586989-r5nzz"] Jul 22 02:30:15.506403 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.506377 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6bb9586989-r5nzz" podUID="0f17c2b5-4294-4501-b1a0-bad60f1d2ca4" containerName="manager" containerID="cri-o://1ac0bd3abaee1cc07b8405dcd8f9826908c889841a27fd8c6d241cd6161b44a1" gracePeriod=30 Jul 22 02:30:15.751920 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.751894 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb9586989-r5nzz" Jul 22 02:30:15.851442 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.851411 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tk9f\" (UniqueName: \"kubernetes.io/projected/0f17c2b5-4294-4501-b1a0-bad60f1d2ca4-kube-api-access-5tk9f\") pod \"0f17c2b5-4294-4501-b1a0-bad60f1d2ca4\" (UID: \"0f17c2b5-4294-4501-b1a0-bad60f1d2ca4\") " Jul 22 02:30:15.851628 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.851461 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f17c2b5-4294-4501-b1a0-bad60f1d2ca4-webhook-cert\") pod \"0f17c2b5-4294-4501-b1a0-bad60f1d2ca4\" (UID: \"0f17c2b5-4294-4501-b1a0-bad60f1d2ca4\") " Jul 22 02:30:15.853429 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.853396 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f17c2b5-4294-4501-b1a0-bad60f1d2ca4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0f17c2b5-4294-4501-b1a0-bad60f1d2ca4" (UID: "0f17c2b5-4294-4501-b1a0-bad60f1d2ca4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:30:15.853533 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.853396 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f17c2b5-4294-4501-b1a0-bad60f1d2ca4-kube-api-access-5tk9f" (OuterVolumeSpecName: "kube-api-access-5tk9f") pod "0f17c2b5-4294-4501-b1a0-bad60f1d2ca4" (UID: "0f17c2b5-4294-4501-b1a0-bad60f1d2ca4"). InnerVolumeSpecName "kube-api-access-5tk9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:30:15.930519 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.930451 2579 generic.go:356] "Generic (PLEG): container finished" podID="0f17c2b5-4294-4501-b1a0-bad60f1d2ca4" containerID="1ac0bd3abaee1cc07b8405dcd8f9826908c889841a27fd8c6d241cd6161b44a1" exitCode=0 Jul 22 02:30:15.930519 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.930496 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb9586989-r5nzz" Jul 22 02:30:15.930664 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.930533 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb9586989-r5nzz" event={"ID":"0f17c2b5-4294-4501-b1a0-bad60f1d2ca4","Type":"ContainerDied","Data":"1ac0bd3abaee1cc07b8405dcd8f9826908c889841a27fd8c6d241cd6161b44a1"} Jul 22 02:30:15.930664 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.930588 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb9586989-r5nzz" event={"ID":"0f17c2b5-4294-4501-b1a0-bad60f1d2ca4","Type":"ContainerDied","Data":"421d6273db4a73ed125b6a33b7d69bc45dcf5de2781a976881c34232d3969e1b"} Jul 22 02:30:15.930664 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.930616 2579 scope.go:117] "RemoveContainer" containerID="1ac0bd3abaee1cc07b8405dcd8f9826908c889841a27fd8c6d241cd6161b44a1" Jul 22 02:30:15.938723 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.938704 2579 scope.go:117] "RemoveContainer" containerID="1ac0bd3abaee1cc07b8405dcd8f9826908c889841a27fd8c6d241cd6161b44a1" Jul 22 02:30:15.938992 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:30:15.938971 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ac0bd3abaee1cc07b8405dcd8f9826908c889841a27fd8c6d241cd6161b44a1\": container with ID starting with 1ac0bd3abaee1cc07b8405dcd8f9826908c889841a27fd8c6d241cd6161b44a1 not found: ID does not exist" containerID="1ac0bd3abaee1cc07b8405dcd8f9826908c889841a27fd8c6d241cd6161b44a1" Jul 22 02:30:15.939056 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.938999 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ac0bd3abaee1cc07b8405dcd8f9826908c889841a27fd8c6d241cd6161b44a1"} err="failed to get container status \"1ac0bd3abaee1cc07b8405dcd8f9826908c889841a27fd8c6d241cd6161b44a1\": rpc error: code = NotFound desc = could not find container \"1ac0bd3abaee1cc07b8405dcd8f9826908c889841a27fd8c6d241cd6161b44a1\": container with ID starting with 1ac0bd3abaee1cc07b8405dcd8f9826908c889841a27fd8c6d241cd6161b44a1 not found: ID does not exist" Jul 22 02:30:15.952126 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.952104 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tk9f\" (UniqueName: \"kubernetes.io/projected/0f17c2b5-4294-4501-b1a0-bad60f1d2ca4-kube-api-access-5tk9f\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:30:15.952126 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.952126 2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f17c2b5-4294-4501-b1a0-bad60f1d2ca4-webhook-cert\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:30:15.952638 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.952621 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bb9586989-r5nzz"] Jul 22 02:30:15.955312 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:15.955292 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bb9586989-r5nzz"] Jul 22 02:30:16.347277 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:16.347248 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f17c2b5-4294-4501-b1a0-bad60f1d2ca4" path="/var/lib/kubelet/pods/0f17c2b5-4294-4501-b1a0-bad60f1d2ca4/volumes" Jul 22 02:30:16.636828 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:16.636693 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:30:16.744508 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:16.744474 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bb9586989-zfm85"] Jul 22 02:30:16.744874 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:16.744860 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f17c2b5-4294-4501-b1a0-bad60f1d2ca4" containerName="manager" Jul 22 02:30:16.744929 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:16.744875 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f17c2b5-4294-4501-b1a0-bad60f1d2ca4" containerName="manager" Jul 22 02:30:16.744961 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:16.744946 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f17c2b5-4294-4501-b1a0-bad60f1d2ca4" containerName="manager" Jul 22 02:30:16.749396 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:16.749375 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb9586989-zfm85" Jul 22 02:30:16.753453 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:16.753433 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 22 02:30:16.753563 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:16.753434 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 02:30:16.753563 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:16.753464 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jzlms\"" Jul 22 02:30:16.762199 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:16.762177 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb9586989-zfm85"] Jul 22 02:30:16.859659 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:16.859631 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2h4t\" (UniqueName: \"kubernetes.io/projected/7020bb19-b233-4cfe-8453-2e05916d2499-kube-api-access-c2h4t\") pod \"maas-controller-6bb9586989-zfm85\" (UID: \"7020bb19-b233-4cfe-8453-2e05916d2499\") " pod="opendatahub/maas-controller-6bb9586989-zfm85" Jul 22 02:30:16.859843 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:16.859708 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7020bb19-b233-4cfe-8453-2e05916d2499-webhook-cert\") pod \"maas-controller-6bb9586989-zfm85\" (UID: \"7020bb19-b233-4cfe-8453-2e05916d2499\") " pod="opendatahub/maas-controller-6bb9586989-zfm85" Jul 22 02:30:16.960217 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:16.960134 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7020bb19-b233-4cfe-8453-2e05916d2499-webhook-cert\") pod \"maas-controller-6bb9586989-zfm85\" (UID: \"7020bb19-b233-4cfe-8453-2e05916d2499\") " pod="opendatahub/maas-controller-6bb9586989-zfm85" Jul 22 02:30:16.960217 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:16.960198 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2h4t\" (UniqueName: \"kubernetes.io/projected/7020bb19-b233-4cfe-8453-2e05916d2499-kube-api-access-c2h4t\") pod \"maas-controller-6bb9586989-zfm85\" (UID: \"7020bb19-b233-4cfe-8453-2e05916d2499\") " pod="opendatahub/maas-controller-6bb9586989-zfm85" Jul 22 02:30:16.962486 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:16.962466 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7020bb19-b233-4cfe-8453-2e05916d2499-webhook-cert\") pod \"maas-controller-6bb9586989-zfm85\" (UID: \"7020bb19-b233-4cfe-8453-2e05916d2499\") " pod="opendatahub/maas-controller-6bb9586989-zfm85" Jul 22 02:30:16.969147 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:16.969123 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2h4t\" (UniqueName: \"kubernetes.io/projected/7020bb19-b233-4cfe-8453-2e05916d2499-kube-api-access-c2h4t\") pod \"maas-controller-6bb9586989-zfm85\" (UID: \"7020bb19-b233-4cfe-8453-2e05916d2499\") " pod="opendatahub/maas-controller-6bb9586989-zfm85" Jul 22 02:30:17.060041 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:17.060008 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb9586989-zfm85" Jul 22 02:30:17.221315 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:17.221246 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb9586989-zfm85"] Jul 22 02:30:17.265610 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:30:17.265584 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7020bb19_b233_4cfe_8453_2e05916d2499.slice/crio-0d2d9c6015d305a0bec2fc0de7f7edbec11e23a59eb0958421e3185aec8b5752 WatchSource:0}: Error finding container 0d2d9c6015d305a0bec2fc0de7f7edbec11e23a59eb0958421e3185aec8b5752: Status 404 returned error can't find the container with id 0d2d9c6015d305a0bec2fc0de7f7edbec11e23a59eb0958421e3185aec8b5752 Jul 22 02:30:17.949057 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:17.948968 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb9586989-zfm85" event={"ID":"7020bb19-b233-4cfe-8453-2e05916d2499","Type":"ContainerStarted","Data":"bfd92c030367d9450662e34d610c905654e6b401d13e24ccacdd71534ad6b000"} Jul 22 02:30:17.949057 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:17.949032 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bb9586989-zfm85" Jul 22 02:30:17.949057 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:17.949051 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb9586989-zfm85" event={"ID":"7020bb19-b233-4cfe-8453-2e05916d2499","Type":"ContainerStarted","Data":"0d2d9c6015d305a0bec2fc0de7f7edbec11e23a59eb0958421e3185aec8b5752"} Jul 22 02:30:17.967464 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:17.967418 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bb9586989-zfm85" podStartSLOduration=1.5808789760000002 podStartE2EDuration="1.967403254s" totalImagesPullingTime="386.524278ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:30:17.965059143 +0000 UTC m=+814.216620635" watchObservedRunningTime="2026-07-22 02:30:17.967403254 +0000 UTC m=+814.218964745" Jul 22 02:30:28.956430 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:28.956403 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bb9586989-zfm85" Jul 22 02:30:47.477291 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:47.477248 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:30:47.647311 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:47.647271 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:30:47.785502 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:47.785424 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:30:53.595365 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:53.595329 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:30:53.697467 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:53.697433 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:30:53.804004 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:53.803972 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:30:53.950611 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:30:53.950530 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:31:00.082432 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:31:00.082395 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:31:00.184695 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:31:00.184661 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:31:04.664036 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:31:04.664003 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:31:37.892105 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:31:37.892029 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:32:41.014697 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:32:41.014666 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:35:28.932807 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:35:28.932777 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:36:13.797687 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:36:13.797605 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:37:52.987602 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:37:52.987526 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:38:58.881938 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:38:58.881899 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:39:11.231037 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:39:11.231000 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:39:41.925158 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:39:41.925120 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:39:41.982774 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:39:41.982726 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:39:57.758032 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:39:57.757993 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:39:59.555604 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:39:59.555569 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:40:27.109563 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:40:27.109529 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:42:30.193846 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:42:30.193762 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:43:10.535953 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:10.535917 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:43:31.817604 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:31.817571 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:43:34.863529 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:34.863496 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:43:34.963683 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:34.963640 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:43:35.302229 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:35.302118 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:43:41.047062 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:41.047027 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:43:41.106977 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:41.106944 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:43:41.290835 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:41.290808 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:43:41.649672 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:41.649642 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:43:41.757456 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:41.757422 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:43:43.840044 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:43.840015 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:43:43.998807 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:43.998774 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l"] Jul 22 02:43:44.002152 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.002132 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" Jul 22 02:43:44.005563 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.005542 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e46537b5-serving-cert\"" Jul 22 02:43:44.022832 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.022807 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l"] Jul 22 02:43:44.036424 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.036405 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:43:44.099531 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.099455 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqb9p\" (UniqueName: \"kubernetes.io/projected/fc796dd1-60ca-4385-aad7-9021d1869e0d-kube-api-access-xqb9p\") pod \"maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l\" (UID: \"fc796dd1-60ca-4385-aad7-9021d1869e0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" Jul 22 02:43:44.099531 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.099529 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc796dd1-60ca-4385-aad7-9021d1869e0d-openshift-service-ca\") pod \"maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l\" (UID: \"fc796dd1-60ca-4385-aad7-9021d1869e0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" Jul 22 02:43:44.099694 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.099567 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc796dd1-60ca-4385-aad7-9021d1869e0d-maas-api-tls\") pod \"maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l\" (UID: \"fc796dd1-60ca-4385-aad7-9021d1869e0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" Jul 22 02:43:44.136962 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.136930 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:43:44.200005 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.199971 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc796dd1-60ca-4385-aad7-9021d1869e0d-maas-api-tls\") pod \"maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l\" (UID: \"fc796dd1-60ca-4385-aad7-9021d1869e0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" Jul 22 02:43:44.200198 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.200028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqb9p\" (UniqueName: \"kubernetes.io/projected/fc796dd1-60ca-4385-aad7-9021d1869e0d-kube-api-access-xqb9p\") pod \"maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l\" (UID: \"fc796dd1-60ca-4385-aad7-9021d1869e0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" Jul 22 02:43:44.200198 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.200082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc796dd1-60ca-4385-aad7-9021d1869e0d-openshift-service-ca\") pod \"maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l\" (UID: \"fc796dd1-60ca-4385-aad7-9021d1869e0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" Jul 22 02:43:44.200631 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.200613 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc796dd1-60ca-4385-aad7-9021d1869e0d-openshift-service-ca\") pod \"maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l\" (UID: \"fc796dd1-60ca-4385-aad7-9021d1869e0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" Jul 22 02:43:44.205120 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.205103 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e46537b5-serving-cert\"" Jul 22 02:43:44.212450 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.212424 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc796dd1-60ca-4385-aad7-9021d1869e0d-maas-api-tls\") pod \"maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l\" (UID: \"fc796dd1-60ca-4385-aad7-9021d1869e0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" Jul 22 02:43:44.212793 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.212741 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqb9p\" (UniqueName: \"kubernetes.io/projected/fc796dd1-60ca-4385-aad7-9021d1869e0d-kube-api-access-xqb9p\") pod \"maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l\" (UID: \"fc796dd1-60ca-4385-aad7-9021d1869e0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" Jul 22 02:43:44.238067 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.238042 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:43:44.313002 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.312967 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" Jul 22 02:43:44.657915 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.657890 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l"] Jul 22 02:43:44.659961 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.659921 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:43:44.660358 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:43:44.660335 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc796dd1_60ca_4385_aad7_9021d1869e0d.slice/crio-e497260f8eaacdb6883f2ee27e69cfecd25998ed81ca1e38935aadff53a519ac WatchSource:0}: Error finding container e497260f8eaacdb6883f2ee27e69cfecd25998ed81ca1e38935aadff53a519ac: Status 404 returned error can't find the container with id e497260f8eaacdb6883f2ee27e69cfecd25998ed81ca1e38935aadff53a519ac Jul 22 02:43:44.661468 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.661451 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 02:43:44.755389 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:44.755360 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:43:45.609659 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:45.609619 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" event={"ID":"fc796dd1-60ca-4385-aad7-9021d1869e0d","Type":"ContainerStarted","Data":"3576ab847a1a75b3ae34fd8a5af75b9605947806535e46482b9d3e1d78010ffb"} Jul 22 02:43:45.610077 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:45.609698 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" event={"ID":"fc796dd1-60ca-4385-aad7-9021d1869e0d","Type":"ContainerStarted","Data":"e497260f8eaacdb6883f2ee27e69cfecd25998ed81ca1e38935aadff53a519ac"} Jul 22 02:43:45.610077 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:45.609794 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" Jul 22 02:43:45.633668 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:45.633608 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" podStartSLOduration=2.142745437 podStartE2EDuration="2.633591075s" totalImagesPullingTime="490.845638ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:43:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:43:45.631292378 +0000 UTC m=+1621.882853870" watchObservedRunningTime="2026-07-22 02:43:45.633591075 +0000 UTC m=+1621.885152586" Jul 22 02:43:51.620463 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:43:51.620435 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" Jul 22 02:44:19.879563 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:19.879528 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l"] Jul 22 02:44:19.880191 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:19.879793 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" podUID="fc796dd1-60ca-4385-aad7-9021d1869e0d" containerName="maas-api" containerID="cri-o://3576ab847a1a75b3ae34fd8a5af75b9605947806535e46482b9d3e1d78010ffb" gracePeriod=30 Jul 22 02:44:19.916001 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:19.915971 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:44:20.124996 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.124972 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" Jul 22 02:44:20.217450 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.217357 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc796dd1-60ca-4385-aad7-9021d1869e0d-openshift-service-ca\") pod \"fc796dd1-60ca-4385-aad7-9021d1869e0d\" (UID: \"fc796dd1-60ca-4385-aad7-9021d1869e0d\") " Jul 22 02:44:20.217450 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.217427 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqb9p\" (UniqueName: \"kubernetes.io/projected/fc796dd1-60ca-4385-aad7-9021d1869e0d-kube-api-access-xqb9p\") pod \"fc796dd1-60ca-4385-aad7-9021d1869e0d\" (UID: \"fc796dd1-60ca-4385-aad7-9021d1869e0d\") " Jul 22 02:44:20.217681 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.217459 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc796dd1-60ca-4385-aad7-9021d1869e0d-maas-api-tls\") pod \"fc796dd1-60ca-4385-aad7-9021d1869e0d\" (UID: \"fc796dd1-60ca-4385-aad7-9021d1869e0d\") " Jul 22 02:44:20.217732 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.217710 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc796dd1-60ca-4385-aad7-9021d1869e0d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fc796dd1-60ca-4385-aad7-9021d1869e0d" (UID: "fc796dd1-60ca-4385-aad7-9021d1869e0d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:44:20.219700 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.219660 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc796dd1-60ca-4385-aad7-9021d1869e0d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fc796dd1-60ca-4385-aad7-9021d1869e0d" (UID: "fc796dd1-60ca-4385-aad7-9021d1869e0d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:44:20.219848 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.219743 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc796dd1-60ca-4385-aad7-9021d1869e0d-kube-api-access-xqb9p" (OuterVolumeSpecName: "kube-api-access-xqb9p") pod "fc796dd1-60ca-4385-aad7-9021d1869e0d" (UID: "fc796dd1-60ca-4385-aad7-9021d1869e0d"). InnerVolumeSpecName "kube-api-access-xqb9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:44:20.318701 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.318663 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc796dd1-60ca-4385-aad7-9021d1869e0d-openshift-service-ca\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:44:20.318701 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.318689 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqb9p\" (UniqueName: \"kubernetes.io/projected/fc796dd1-60ca-4385-aad7-9021d1869e0d-kube-api-access-xqb9p\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:44:20.318701 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.318702 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc796dd1-60ca-4385-aad7-9021d1869e0d-maas-api-tls\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:44:20.771670 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.771639 2579 generic.go:356] "Generic (PLEG): container finished" podID="fc796dd1-60ca-4385-aad7-9021d1869e0d" containerID="3576ab847a1a75b3ae34fd8a5af75b9605947806535e46482b9d3e1d78010ffb" exitCode=0 Jul 22 02:44:20.771881 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.771681 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" Jul 22 02:44:20.771881 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.771706 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" event={"ID":"fc796dd1-60ca-4385-aad7-9021d1869e0d","Type":"ContainerDied","Data":"3576ab847a1a75b3ae34fd8a5af75b9605947806535e46482b9d3e1d78010ffb"} Jul 22 02:44:20.771881 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.771778 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l" event={"ID":"fc796dd1-60ca-4385-aad7-9021d1869e0d","Type":"ContainerDied","Data":"e497260f8eaacdb6883f2ee27e69cfecd25998ed81ca1e38935aadff53a519ac"} Jul 22 02:44:20.771881 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.771805 2579 scope.go:117] "RemoveContainer" containerID="3576ab847a1a75b3ae34fd8a5af75b9605947806535e46482b9d3e1d78010ffb" Jul 22 02:44:20.780572 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.780555 2579 scope.go:117] "RemoveContainer" containerID="3576ab847a1a75b3ae34fd8a5af75b9605947806535e46482b9d3e1d78010ffb" Jul 22 02:44:20.780834 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:44:20.780813 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3576ab847a1a75b3ae34fd8a5af75b9605947806535e46482b9d3e1d78010ffb\": container with ID starting with 3576ab847a1a75b3ae34fd8a5af75b9605947806535e46482b9d3e1d78010ffb not found: ID does not exist" containerID="3576ab847a1a75b3ae34fd8a5af75b9605947806535e46482b9d3e1d78010ffb" Jul 22 02:44:20.780895 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.780842 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3576ab847a1a75b3ae34fd8a5af75b9605947806535e46482b9d3e1d78010ffb"} err="failed to get container status \"3576ab847a1a75b3ae34fd8a5af75b9605947806535e46482b9d3e1d78010ffb\": rpc error: code = NotFound desc = could not find container \"3576ab847a1a75b3ae34fd8a5af75b9605947806535e46482b9d3e1d78010ffb\": container with ID starting with 3576ab847a1a75b3ae34fd8a5af75b9605947806535e46482b9d3e1d78010ffb not found: ID does not exist" Jul 22 02:44:20.790420 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.790396 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l"] Jul 22 02:44:20.798897 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:20.798879 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e46537b5-54f54559d9-sqb9l"] Jul 22 02:44:21.191469 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:21.191437 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:44:22.347031 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:22.347000 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc796dd1-60ca-4385-aad7-9021d1869e0d" path="/var/lib/kubelet/pods/fc796dd1-60ca-4385-aad7-9021d1869e0d/volumes" Jul 22 02:44:24.357568 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:24.357534 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:44:24.507845 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:24.507811 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:44:24.751649 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:24.751568 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:44:25.017697 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:25.017611 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:44:25.116474 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:25.116444 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:44:25.221341 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:25.221300 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:44:25.536195 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:25.536158 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:44:25.820488 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:25.820452 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:44:28.045637 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.045603 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:44:28.123477 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.123440 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp"] Jul 22 02:44:28.123849 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.123834 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc796dd1-60ca-4385-aad7-9021d1869e0d" containerName="maas-api" Jul 22 02:44:28.123927 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.123851 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc796dd1-60ca-4385-aad7-9021d1869e0d" containerName="maas-api" Jul 22 02:44:28.123984 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.123945 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc796dd1-60ca-4385-aad7-9021d1869e0d" containerName="maas-api" Jul 22 02:44:28.128540 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.128498 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" Jul 22 02:44:28.131303 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.131281 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-12ff7d8c-serving-cert\"" Jul 22 02:44:28.134612 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.134588 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp"] Jul 22 02:44:28.150677 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.150652 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:44:28.185283 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.185249 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fac2b80-8919-421d-b1a0-da9758db3bd5-maas-api-tls\") pod \"maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp\" (UID: \"0fac2b80-8919-421d-b1a0-da9758db3bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" Jul 22 02:44:28.185439 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.185292 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z254l\" (UniqueName: \"kubernetes.io/projected/0fac2b80-8919-421d-b1a0-da9758db3bd5-kube-api-access-z254l\") pod \"maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp\" (UID: \"0fac2b80-8919-421d-b1a0-da9758db3bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" Jul 22 02:44:28.185439 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.185392 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fac2b80-8919-421d-b1a0-da9758db3bd5-openshift-service-ca\") pod \"maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp\" (UID: \"0fac2b80-8919-421d-b1a0-da9758db3bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" Jul 22 02:44:28.285952 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.285917 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fac2b80-8919-421d-b1a0-da9758db3bd5-openshift-service-ca\") pod \"maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp\" (UID: \"0fac2b80-8919-421d-b1a0-da9758db3bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" Jul 22 02:44:28.286137 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.285971 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fac2b80-8919-421d-b1a0-da9758db3bd5-maas-api-tls\") pod \"maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp\" (UID: \"0fac2b80-8919-421d-b1a0-da9758db3bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" Jul 22 02:44:28.286137 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.286002 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z254l\" (UniqueName: \"kubernetes.io/projected/0fac2b80-8919-421d-b1a0-da9758db3bd5-kube-api-access-z254l\") pod \"maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp\" (UID: \"0fac2b80-8919-421d-b1a0-da9758db3bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" Jul 22 02:44:28.286137 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:44:28.286088 2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-serving-cert: secret "maas-api-e2e-migrate-12ff7d8c-serving-cert" not found Jul 22 02:44:28.286313 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:44:28.286150 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fac2b80-8919-421d-b1a0-da9758db3bd5-maas-api-tls podName:0fac2b80-8919-421d-b1a0-da9758db3bd5 nodeName:}" failed. No retries permitted until 2026-07-22 02:44:28.786129582 +0000 UTC m=+1665.037691053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0fac2b80-8919-421d-b1a0-da9758db3bd5-maas-api-tls") pod "maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" (UID: "0fac2b80-8919-421d-b1a0-da9758db3bd5") : secret "maas-api-e2e-migrate-12ff7d8c-serving-cert" not found Jul 22 02:44:28.286600 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.286580 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fac2b80-8919-421d-b1a0-da9758db3bd5-openshift-service-ca\") pod \"maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp\" (UID: \"0fac2b80-8919-421d-b1a0-da9758db3bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" Jul 22 02:44:28.297964 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.297900 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z254l\" (UniqueName: \"kubernetes.io/projected/0fac2b80-8919-421d-b1a0-da9758db3bd5-kube-api-access-z254l\") pod \"maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp\" (UID: \"0fac2b80-8919-421d-b1a0-da9758db3bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" Jul 22 02:44:28.493963 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.493928 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:44:28.680370 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.680337 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:44:28.785592 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.785563 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:44:28.791248 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.791220 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fac2b80-8919-421d-b1a0-da9758db3bd5-maas-api-tls\") pod \"maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp\" (UID: \"0fac2b80-8919-421d-b1a0-da9758db3bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" Jul 22 02:44:28.793680 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:28.793662 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fac2b80-8919-421d-b1a0-da9758db3bd5-maas-api-tls\") pod \"maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp\" (UID: \"0fac2b80-8919-421d-b1a0-da9758db3bd5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" Jul 22 02:44:29.041370 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:29.041281 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" Jul 22 02:44:29.186844 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:29.182940 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp"] Jul 22 02:44:29.186844 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:44:29.185039 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fac2b80_8919_421d_b1a0_da9758db3bd5.slice/crio-9ad5636b4861c93391793f05b98feb4f075d8f49f20b7e98880460f8b1299ab8 WatchSource:0}: Error finding container 9ad5636b4861c93391793f05b98feb4f075d8f49f20b7e98880460f8b1299ab8: Status 404 returned error can't find the container with id 9ad5636b4861c93391793f05b98feb4f075d8f49f20b7e98880460f8b1299ab8 Jul 22 02:44:29.813943 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:29.813903 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" event={"ID":"0fac2b80-8919-421d-b1a0-da9758db3bd5","Type":"ContainerStarted","Data":"5322a23c7f60a2cec736a7683f6421ee50a1c1ba75f8a66f7d22fefd552ad86b"} Jul 22 02:44:29.814130 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:29.813960 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" event={"ID":"0fac2b80-8919-421d-b1a0-da9758db3bd5","Type":"ContainerStarted","Data":"9ad5636b4861c93391793f05b98feb4f075d8f49f20b7e98880460f8b1299ab8"} Jul 22 02:44:29.814130 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:29.814037 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" Jul 22 02:44:29.834022 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:29.833939 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" podStartSLOduration=1.447785149 podStartE2EDuration="1.833923639s" totalImagesPullingTime="386.13849ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:44:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:44:29.833126885 +0000 UTC m=+1666.084688390" watchObservedRunningTime="2026-07-22 02:44:29.833923639 +0000 UTC m=+1666.085485132" Jul 22 02:44:35.825883 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:44:35.825855 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" Jul 22 02:45:03.713423 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:03.713392 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp"] Jul 22 02:45:03.714027 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:03.713610 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" podUID="0fac2b80-8919-421d-b1a0-da9758db3bd5" containerName="maas-api" containerID="cri-o://5322a23c7f60a2cec736a7683f6421ee50a1c1ba75f8a66f7d22fefd552ad86b" gracePeriod=30 Jul 22 02:45:03.773838 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:03.773809 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:03.964485 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:03.964426 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" Jul 22 02:45:03.971618 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:03.971582 2579 generic.go:356] "Generic (PLEG): container finished" podID="0fac2b80-8919-421d-b1a0-da9758db3bd5" containerID="5322a23c7f60a2cec736a7683f6421ee50a1c1ba75f8a66f7d22fefd552ad86b" exitCode=0 Jul 22 02:45:03.971738 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:03.971622 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" Jul 22 02:45:03.971738 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:03.971659 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" event={"ID":"0fac2b80-8919-421d-b1a0-da9758db3bd5","Type":"ContainerDied","Data":"5322a23c7f60a2cec736a7683f6421ee50a1c1ba75f8a66f7d22fefd552ad86b"} Jul 22 02:45:03.971738 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:03.971712 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp" event={"ID":"0fac2b80-8919-421d-b1a0-da9758db3bd5","Type":"ContainerDied","Data":"9ad5636b4861c93391793f05b98feb4f075d8f49f20b7e98880460f8b1299ab8"} Jul 22 02:45:03.971738 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:03.971736 2579 scope.go:117] "RemoveContainer" containerID="5322a23c7f60a2cec736a7683f6421ee50a1c1ba75f8a66f7d22fefd552ad86b" Jul 22 02:45:03.979634 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:03.979617 2579 scope.go:117] "RemoveContainer" containerID="5322a23c7f60a2cec736a7683f6421ee50a1c1ba75f8a66f7d22fefd552ad86b" Jul 22 02:45:03.979891 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:45:03.979865 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5322a23c7f60a2cec736a7683f6421ee50a1c1ba75f8a66f7d22fefd552ad86b\": container with ID starting with 5322a23c7f60a2cec736a7683f6421ee50a1c1ba75f8a66f7d22fefd552ad86b not found: ID does not exist" containerID="5322a23c7f60a2cec736a7683f6421ee50a1c1ba75f8a66f7d22fefd552ad86b" Jul 22 02:45:03.979958 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:03.979893 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5322a23c7f60a2cec736a7683f6421ee50a1c1ba75f8a66f7d22fefd552ad86b"} err="failed to get container status \"5322a23c7f60a2cec736a7683f6421ee50a1c1ba75f8a66f7d22fefd552ad86b\": rpc error: code = NotFound desc = could not find container \"5322a23c7f60a2cec736a7683f6421ee50a1c1ba75f8a66f7d22fefd552ad86b\": container with ID starting with 5322a23c7f60a2cec736a7683f6421ee50a1c1ba75f8a66f7d22fefd552ad86b not found: ID does not exist" Jul 22 02:45:04.003061 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:04.003034 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fac2b80-8919-421d-b1a0-da9758db3bd5-maas-api-tls\") pod \"0fac2b80-8919-421d-b1a0-da9758db3bd5\" (UID: \"0fac2b80-8919-421d-b1a0-da9758db3bd5\") " Jul 22 02:45:04.003223 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:04.003104 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z254l\" (UniqueName: \"kubernetes.io/projected/0fac2b80-8919-421d-b1a0-da9758db3bd5-kube-api-access-z254l\") pod \"0fac2b80-8919-421d-b1a0-da9758db3bd5\" (UID: \"0fac2b80-8919-421d-b1a0-da9758db3bd5\") " Jul 22 02:45:04.003223 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:04.003152 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fac2b80-8919-421d-b1a0-da9758db3bd5-openshift-service-ca\") pod \"0fac2b80-8919-421d-b1a0-da9758db3bd5\" (UID: \"0fac2b80-8919-421d-b1a0-da9758db3bd5\") " Jul 22 02:45:04.003564 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:04.003533 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fac2b80-8919-421d-b1a0-da9758db3bd5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0fac2b80-8919-421d-b1a0-da9758db3bd5" (UID: "0fac2b80-8919-421d-b1a0-da9758db3bd5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:45:04.005427 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:04.005396 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fac2b80-8919-421d-b1a0-da9758db3bd5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0fac2b80-8919-421d-b1a0-da9758db3bd5" (UID: "0fac2b80-8919-421d-b1a0-da9758db3bd5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:45:04.005427 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:04.005408 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fac2b80-8919-421d-b1a0-da9758db3bd5-kube-api-access-z254l" (OuterVolumeSpecName: "kube-api-access-z254l") pod "0fac2b80-8919-421d-b1a0-da9758db3bd5" (UID: "0fac2b80-8919-421d-b1a0-da9758db3bd5"). InnerVolumeSpecName "kube-api-access-z254l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:45:04.104003 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:04.103962 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fac2b80-8919-421d-b1a0-da9758db3bd5-maas-api-tls\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:45:04.104003 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:04.103997 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z254l\" (UniqueName: \"kubernetes.io/projected/0fac2b80-8919-421d-b1a0-da9758db3bd5-kube-api-access-z254l\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:45:04.104003 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:04.104011 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fac2b80-8919-421d-b1a0-da9758db3bd5-openshift-service-ca\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:45:04.296574 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:04.296532 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp"] Jul 22 02:45:04.302775 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:04.302734 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-12ff7d8c-97fcc76b4-z7wdp"] Jul 22 02:45:04.347357 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:04.347323 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fac2b80-8919-421d-b1a0-da9758db3bd5" path="/var/lib/kubelet/pods/0fac2b80-8919-421d-b1a0-da9758db3bd5/volumes" Jul 22 02:45:08.191303 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:08.191211 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:08.365979 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:08.365946 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:08.591550 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:08.591517 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:08.829777 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:08.829720 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:09.189571 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:09.189542 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:09.331429 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:09.331396 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:11.261103 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.261064 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:11.348261 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.348233 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m"] Jul 22 02:45:11.348615 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.348601 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fac2b80-8919-421d-b1a0-da9758db3bd5" containerName="maas-api" Jul 22 02:45:11.348673 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.348617 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fac2b80-8919-421d-b1a0-da9758db3bd5" containerName="maas-api" Jul 22 02:45:11.348770 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.348740 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fac2b80-8919-421d-b1a0-da9758db3bd5" containerName="maas-api" Jul 22 02:45:11.353009 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.352990 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" Jul 22 02:45:11.354936 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.354901 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:11.359116 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.359096 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e4b39588-serving-cert\"" Jul 22 02:45:11.363080 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.363047 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m"] Jul 22 02:45:11.443531 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.443502 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:11.465924 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.465893 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af392533-2796-4537-b5fb-4fc62406218d-maas-api-tls\") pod \"maas-api-e2e-ait-e4b39588-c796f6458-nlq8m\" (UID: \"af392533-2796-4537-b5fb-4fc62406218d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" Jul 22 02:45:11.466087 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.465991 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af392533-2796-4537-b5fb-4fc62406218d-openshift-service-ca\") pod \"maas-api-e2e-ait-e4b39588-c796f6458-nlq8m\" (UID: \"af392533-2796-4537-b5fb-4fc62406218d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" Jul 22 02:45:11.466087 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.466040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6bh5\" (UniqueName: \"kubernetes.io/projected/af392533-2796-4537-b5fb-4fc62406218d-kube-api-access-f6bh5\") pod \"maas-api-e2e-ait-e4b39588-c796f6458-nlq8m\" (UID: \"af392533-2796-4537-b5fb-4fc62406218d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" Jul 22 02:45:11.566841 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.566808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af392533-2796-4537-b5fb-4fc62406218d-openshift-service-ca\") pod \"maas-api-e2e-ait-e4b39588-c796f6458-nlq8m\" (UID: \"af392533-2796-4537-b5fb-4fc62406218d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" Jul 22 02:45:11.567006 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.566858 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6bh5\" (UniqueName: \"kubernetes.io/projected/af392533-2796-4537-b5fb-4fc62406218d-kube-api-access-f6bh5\") pod \"maas-api-e2e-ait-e4b39588-c796f6458-nlq8m\" (UID: \"af392533-2796-4537-b5fb-4fc62406218d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" Jul 22 02:45:11.567006 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.566913 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af392533-2796-4537-b5fb-4fc62406218d-maas-api-tls\") pod \"maas-api-e2e-ait-e4b39588-c796f6458-nlq8m\" (UID: \"af392533-2796-4537-b5fb-4fc62406218d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" Jul 22 02:45:11.567095 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:45:11.567033 2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-serving-cert: secret "maas-api-e2e-ait-e4b39588-serving-cert" not found Jul 22 02:45:11.567131 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:45:11.567106 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af392533-2796-4537-b5fb-4fc62406218d-maas-api-tls podName:af392533-2796-4537-b5fb-4fc62406218d nodeName:}" failed. No retries permitted until 2026-07-22 02:45:12.067086024 +0000 UTC m=+1708.318647494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/af392533-2796-4537-b5fb-4fc62406218d-maas-api-tls") pod "maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" (UID: "af392533-2796-4537-b5fb-4fc62406218d") : secret "maas-api-e2e-ait-e4b39588-serving-cert" not found Jul 22 02:45:11.567469 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.567451 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af392533-2796-4537-b5fb-4fc62406218d-openshift-service-ca\") pod \"maas-api-e2e-ait-e4b39588-c796f6458-nlq8m\" (UID: \"af392533-2796-4537-b5fb-4fc62406218d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" Jul 22 02:45:11.578054 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.578029 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6bh5\" (UniqueName: \"kubernetes.io/projected/af392533-2796-4537-b5fb-4fc62406218d-kube-api-access-f6bh5\") pod \"maas-api-e2e-ait-e4b39588-c796f6458-nlq8m\" (UID: \"af392533-2796-4537-b5fb-4fc62406218d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" Jul 22 02:45:11.765081 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.765042 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:11.959048 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:11.958968 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:12.072507 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:12.072472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af392533-2796-4537-b5fb-4fc62406218d-maas-api-tls\") pod \"maas-api-e2e-ait-e4b39588-c796f6458-nlq8m\" (UID: \"af392533-2796-4537-b5fb-4fc62406218d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" Jul 22 02:45:12.074912 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:12.074882 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af392533-2796-4537-b5fb-4fc62406218d-maas-api-tls\") pod \"maas-api-e2e-ait-e4b39588-c796f6458-nlq8m\" (UID: \"af392533-2796-4537-b5fb-4fc62406218d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" Jul 22 02:45:12.078100 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:12.078049 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:12.264922 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:12.264828 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" Jul 22 02:45:12.414802 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:12.414777 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m"] Jul 22 02:45:12.416308 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:45:12.416271 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf392533_2796_4537_b5fb_4fc62406218d.slice/crio-49872ba27307d0109f99a9b0a1457f0860184e04a13eb5a8ad1c24840423da9e WatchSource:0}: Error finding container 49872ba27307d0109f99a9b0a1457f0860184e04a13eb5a8ad1c24840423da9e: Status 404 returned error can't find the container with id 49872ba27307d0109f99a9b0a1457f0860184e04a13eb5a8ad1c24840423da9e Jul 22 02:45:13.017151 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:13.017123 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" event={"ID":"af392533-2796-4537-b5fb-4fc62406218d","Type":"ContainerStarted","Data":"5822e30802c44e88a4dc3f07919f06cf3eb1f1b0d1486dd2d2cc56f78fbea25f"} Jul 22 02:45:13.017258 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:13.017173 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" event={"ID":"af392533-2796-4537-b5fb-4fc62406218d","Type":"ContainerStarted","Data":"49872ba27307d0109f99a9b0a1457f0860184e04a13eb5a8ad1c24840423da9e"} Jul 22 02:45:13.017307 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:13.017257 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" Jul 22 02:45:13.041039 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:13.040981 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" podStartSLOduration=1.51147484 podStartE2EDuration="2.040962211s" totalImagesPullingTime="529.487371ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:45:13.040556632 +0000 UTC m=+1709.292118129" watchObservedRunningTime="2026-07-22 02:45:13.040962211 +0000 UTC m=+1709.292523704" Jul 22 02:45:19.027575 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:19.027546 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" Jul 22 02:45:37.629894 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:37.629859 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:37.727657 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:37.727589 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:38.712530 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:38.712494 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:38.813901 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:38.813866 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:47.642884 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:47.642854 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m"] Jul 22 02:45:47.643367 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:47.643070 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" podUID="af392533-2796-4537-b5fb-4fc62406218d" containerName="maas-api" containerID="cri-o://5822e30802c44e88a4dc3f07919f06cf3eb1f1b0d1486dd2d2cc56f78fbea25f" gracePeriod=30 Jul 22 02:45:47.679093 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:47.679066 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:47.887761 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:47.887728 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" Jul 22 02:45:47.897995 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:47.897956 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6bh5\" (UniqueName: \"kubernetes.io/projected/af392533-2796-4537-b5fb-4fc62406218d-kube-api-access-f6bh5\") pod \"af392533-2796-4537-b5fb-4fc62406218d\" (UID: \"af392533-2796-4537-b5fb-4fc62406218d\") " Jul 22 02:45:47.898060 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:47.897998 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af392533-2796-4537-b5fb-4fc62406218d-maas-api-tls\") pod \"af392533-2796-4537-b5fb-4fc62406218d\" (UID: \"af392533-2796-4537-b5fb-4fc62406218d\") " Jul 22 02:45:47.898060 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:47.898033 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af392533-2796-4537-b5fb-4fc62406218d-openshift-service-ca\") pod \"af392533-2796-4537-b5fb-4fc62406218d\" (UID: \"af392533-2796-4537-b5fb-4fc62406218d\") " Jul 22 02:45:47.898418 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:47.898394 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af392533-2796-4537-b5fb-4fc62406218d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "af392533-2796-4537-b5fb-4fc62406218d" (UID: "af392533-2796-4537-b5fb-4fc62406218d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:45:47.900016 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:47.899991 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af392533-2796-4537-b5fb-4fc62406218d-kube-api-access-f6bh5" (OuterVolumeSpecName: "kube-api-access-f6bh5") pod "af392533-2796-4537-b5fb-4fc62406218d" (UID: "af392533-2796-4537-b5fb-4fc62406218d"). InnerVolumeSpecName "kube-api-access-f6bh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:45:47.900114 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:47.899995 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af392533-2796-4537-b5fb-4fc62406218d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "af392533-2796-4537-b5fb-4fc62406218d" (UID: "af392533-2796-4537-b5fb-4fc62406218d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:45:47.998600 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:47.998569 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6bh5\" (UniqueName: \"kubernetes.io/projected/af392533-2796-4537-b5fb-4fc62406218d-kube-api-access-f6bh5\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:45:47.998600 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:47.998598 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af392533-2796-4537-b5fb-4fc62406218d-maas-api-tls\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:45:47.998600 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:47.998608 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af392533-2796-4537-b5fb-4fc62406218d-openshift-service-ca\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:45:48.195151 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:48.195055 2579 generic.go:356] "Generic (PLEG): container finished" podID="af392533-2796-4537-b5fb-4fc62406218d" containerID="5822e30802c44e88a4dc3f07919f06cf3eb1f1b0d1486dd2d2cc56f78fbea25f" exitCode=0 Jul 22 02:45:48.195151 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:48.195105 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" Jul 22 02:45:48.195371 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:48.195105 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" event={"ID":"af392533-2796-4537-b5fb-4fc62406218d","Type":"ContainerDied","Data":"5822e30802c44e88a4dc3f07919f06cf3eb1f1b0d1486dd2d2cc56f78fbea25f"} Jul 22 02:45:48.195371 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:48.195233 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m" event={"ID":"af392533-2796-4537-b5fb-4fc62406218d","Type":"ContainerDied","Data":"49872ba27307d0109f99a9b0a1457f0860184e04a13eb5a8ad1c24840423da9e"} Jul 22 02:45:48.195371 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:48.195259 2579 scope.go:117] "RemoveContainer" containerID="5822e30802c44e88a4dc3f07919f06cf3eb1f1b0d1486dd2d2cc56f78fbea25f" Jul 22 02:45:48.204254 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:48.204237 2579 scope.go:117] "RemoveContainer" containerID="5822e30802c44e88a4dc3f07919f06cf3eb1f1b0d1486dd2d2cc56f78fbea25f" Jul 22 02:45:48.204490 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:45:48.204472 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5822e30802c44e88a4dc3f07919f06cf3eb1f1b0d1486dd2d2cc56f78fbea25f\": container with ID starting with 5822e30802c44e88a4dc3f07919f06cf3eb1f1b0d1486dd2d2cc56f78fbea25f not found: ID does not exist" containerID="5822e30802c44e88a4dc3f07919f06cf3eb1f1b0d1486dd2d2cc56f78fbea25f" Jul 22 02:45:48.204537 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:48.204497 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5822e30802c44e88a4dc3f07919f06cf3eb1f1b0d1486dd2d2cc56f78fbea25f"} err="failed to get container status \"5822e30802c44e88a4dc3f07919f06cf3eb1f1b0d1486dd2d2cc56f78fbea25f\": rpc error: code = NotFound desc = could not find container \"5822e30802c44e88a4dc3f07919f06cf3eb1f1b0d1486dd2d2cc56f78fbea25f\": container with ID starting with 5822e30802c44e88a4dc3f07919f06cf3eb1f1b0d1486dd2d2cc56f78fbea25f not found: ID does not exist" Jul 22 02:45:48.217950 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:48.217924 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m"] Jul 22 02:45:48.222857 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:48.222834 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e4b39588-c796f6458-nlq8m"] Jul 22 02:45:48.347349 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:48.347315 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af392533-2796-4537-b5fb-4fc62406218d" path="/var/lib/kubelet/pods/af392533-2796-4537-b5fb-4fc62406218d/volumes" Jul 22 02:45:52.170530 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:52.170497 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:53.422815 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:53.422784 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:53.638399 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:53.638371 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:53.857147 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:53.857115 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:54.252558 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:54.252480 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:54.594696 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:54.594663 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:56.635696 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.635658 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:56.749160 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.749124 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5"] Jul 22 02:45:56.749592 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.749573 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af392533-2796-4537-b5fb-4fc62406218d" containerName="maas-api" Jul 22 02:45:56.749684 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.749594 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="af392533-2796-4537-b5fb-4fc62406218d" containerName="maas-api" Jul 22 02:45:56.749735 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.749690 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="af392533-2796-4537-b5fb-4fc62406218d" containerName="maas-api" Jul 22 02:45:56.754128 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.754107 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" Jul 22 02:45:56.757068 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.757048 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-fbf4b46e-serving-cert\"" Jul 22 02:45:56.766714 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.766692 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5"] Jul 22 02:45:56.769983 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.769962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7610cc3-f332-4ac0-92a6-8955a00afcae-openshift-service-ca\") pod \"maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5\" (UID: \"b7610cc3-f332-4ac0-92a6-8955a00afcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" Jul 22 02:45:56.770079 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.769993 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x76xx\" (UniqueName: \"kubernetes.io/projected/b7610cc3-f332-4ac0-92a6-8955a00afcae-kube-api-access-x76xx\") pod \"maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5\" (UID: \"b7610cc3-f332-4ac0-92a6-8955a00afcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" Jul 22 02:45:56.770079 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.770037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7610cc3-f332-4ac0-92a6-8955a00afcae-maas-api-tls\") pod \"maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5\" (UID: \"b7610cc3-f332-4ac0-92a6-8955a00afcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" Jul 22 02:45:56.800455 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.800422 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:56.870490 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.870458 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7610cc3-f332-4ac0-92a6-8955a00afcae-maas-api-tls\") pod \"maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5\" (UID: \"b7610cc3-f332-4ac0-92a6-8955a00afcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" Jul 22 02:45:56.870657 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.870525 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7610cc3-f332-4ac0-92a6-8955a00afcae-openshift-service-ca\") pod \"maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5\" (UID: \"b7610cc3-f332-4ac0-92a6-8955a00afcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" Jul 22 02:45:56.870657 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.870554 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x76xx\" (UniqueName: \"kubernetes.io/projected/b7610cc3-f332-4ac0-92a6-8955a00afcae-kube-api-access-x76xx\") pod \"maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5\" (UID: \"b7610cc3-f332-4ac0-92a6-8955a00afcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" Jul 22 02:45:56.870657 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:45:56.870622 2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-serving-cert: secret "maas-api-e2e-derive-fbf4b46e-serving-cert" not found Jul 22 02:45:56.870859 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:45:56.870710 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7610cc3-f332-4ac0-92a6-8955a00afcae-maas-api-tls podName:b7610cc3-f332-4ac0-92a6-8955a00afcae nodeName:}" failed. No retries permitted until 2026-07-22 02:45:57.370687599 +0000 UTC m=+1753.622249086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b7610cc3-f332-4ac0-92a6-8955a00afcae-maas-api-tls") pod "maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" (UID: "b7610cc3-f332-4ac0-92a6-8955a00afcae") : secret "maas-api-e2e-derive-fbf4b46e-serving-cert" not found Jul 22 02:45:56.871251 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.871234 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7610cc3-f332-4ac0-92a6-8955a00afcae-openshift-service-ca\") pod \"maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5\" (UID: \"b7610cc3-f332-4ac0-92a6-8955a00afcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" Jul 22 02:45:56.884985 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.884960 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x76xx\" (UniqueName: \"kubernetes.io/projected/b7610cc3-f332-4ac0-92a6-8955a00afcae-kube-api-access-x76xx\") pod \"maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5\" (UID: \"b7610cc3-f332-4ac0-92a6-8955a00afcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" Jul 22 02:45:56.910111 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:56.910046 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:57.247941 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:57.247860 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:57.373679 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:57.373648 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7610cc3-f332-4ac0-92a6-8955a00afcae-maas-api-tls\") pod \"maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5\" (UID: \"b7610cc3-f332-4ac0-92a6-8955a00afcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" Jul 22 02:45:57.376065 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:57.376045 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7610cc3-f332-4ac0-92a6-8955a00afcae-maas-api-tls\") pod \"maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5\" (UID: \"b7610cc3-f332-4ac0-92a6-8955a00afcae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" Jul 22 02:45:57.530480 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:57.530401 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:57.662256 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:57.662224 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:45:57.664209 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:57.664185 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" Jul 22 02:45:57.813514 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:57.813489 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5"] Jul 22 02:45:57.815660 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:45:57.815639 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7610cc3_f332_4ac0_92a6_8955a00afcae.slice/crio-5809347d03f6639f18eec492c226e375c96d456d81b32d3046e40865ce0f87ab WatchSource:0}: Error finding container 5809347d03f6639f18eec492c226e375c96d456d81b32d3046e40865ce0f87ab: Status 404 returned error can't find the container with id 5809347d03f6639f18eec492c226e375c96d456d81b32d3046e40865ce0f87ab Jul 22 02:45:58.248455 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:58.248374 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" event={"ID":"b7610cc3-f332-4ac0-92a6-8955a00afcae","Type":"ContainerStarted","Data":"5809347d03f6639f18eec492c226e375c96d456d81b32d3046e40865ce0f87ab"} Jul 22 02:45:59.254776 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:59.254724 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" event={"ID":"b7610cc3-f332-4ac0-92a6-8955a00afcae","Type":"ContainerStarted","Data":"6a6e3a69a919999307f36a766ec9716a8adf184a125044c93b161b0026f72eed"} Jul 22 02:45:59.255204 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:45:59.254840 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" Jul 22 02:46:05.264596 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:05.264571 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" Jul 22 02:46:05.295926 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:05.295875 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" podStartSLOduration=8.802683063 podStartE2EDuration="9.295859209s" totalImagesPullingTime="493.176146ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:45:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:45:59.280173223 +0000 UTC m=+1755.531734714" watchObservedRunningTime="2026-07-22 02:46:05.295859209 +0000 UTC m=+1761.547420701" Jul 22 02:46:32.222738 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:32.222702 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5"] Jul 22 02:46:32.223347 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:32.222922 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" podUID="b7610cc3-f332-4ac0-92a6-8955a00afcae" containerName="maas-api" containerID="cri-o://6a6e3a69a919999307f36a766ec9716a8adf184a125044c93b161b0026f72eed" gracePeriod=30 Jul 22 02:46:32.267573 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:32.267541 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:46:32.405233 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:32.405205 2579 generic.go:356] "Generic (PLEG): container finished" podID="b7610cc3-f332-4ac0-92a6-8955a00afcae" containerID="6a6e3a69a919999307f36a766ec9716a8adf184a125044c93b161b0026f72eed" exitCode=0 Jul 22 02:46:32.405381 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:32.405277 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" event={"ID":"b7610cc3-f332-4ac0-92a6-8955a00afcae","Type":"ContainerDied","Data":"6a6e3a69a919999307f36a766ec9716a8adf184a125044c93b161b0026f72eed"} Jul 22 02:46:32.465630 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:32.465608 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" Jul 22 02:46:32.585351 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:32.585326 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7610cc3-f332-4ac0-92a6-8955a00afcae-maas-api-tls\") pod \"b7610cc3-f332-4ac0-92a6-8955a00afcae\" (UID: \"b7610cc3-f332-4ac0-92a6-8955a00afcae\") " Jul 22 02:46:32.585529 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:32.585411 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7610cc3-f332-4ac0-92a6-8955a00afcae-openshift-service-ca\") pod \"b7610cc3-f332-4ac0-92a6-8955a00afcae\" (UID: \"b7610cc3-f332-4ac0-92a6-8955a00afcae\") " Jul 22 02:46:32.585529 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:32.585433 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x76xx\" (UniqueName: \"kubernetes.io/projected/b7610cc3-f332-4ac0-92a6-8955a00afcae-kube-api-access-x76xx\") pod \"b7610cc3-f332-4ac0-92a6-8955a00afcae\" (UID: \"b7610cc3-f332-4ac0-92a6-8955a00afcae\") " Jul 22 02:46:32.585707 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:32.585683 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7610cc3-f332-4ac0-92a6-8955a00afcae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b7610cc3-f332-4ac0-92a6-8955a00afcae" (UID: "b7610cc3-f332-4ac0-92a6-8955a00afcae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:46:32.587424 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:32.587391 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7610cc3-f332-4ac0-92a6-8955a00afcae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b7610cc3-f332-4ac0-92a6-8955a00afcae" (UID: "b7610cc3-f332-4ac0-92a6-8955a00afcae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:46:32.587531 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:32.587440 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7610cc3-f332-4ac0-92a6-8955a00afcae-kube-api-access-x76xx" (OuterVolumeSpecName: "kube-api-access-x76xx") pod "b7610cc3-f332-4ac0-92a6-8955a00afcae" (UID: "b7610cc3-f332-4ac0-92a6-8955a00afcae"). InnerVolumeSpecName "kube-api-access-x76xx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:46:32.686675 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:32.686646 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7610cc3-f332-4ac0-92a6-8955a00afcae-maas-api-tls\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:46:32.686675 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:32.686674 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7610cc3-f332-4ac0-92a6-8955a00afcae-openshift-service-ca\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:46:32.686868 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:32.686684 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x76xx\" (UniqueName: \"kubernetes.io/projected/b7610cc3-f332-4ac0-92a6-8955a00afcae-kube-api-access-x76xx\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:46:33.410907 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:33.410874 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" Jul 22 02:46:33.410907 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:33.410903 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5" event={"ID":"b7610cc3-f332-4ac0-92a6-8955a00afcae","Type":"ContainerDied","Data":"5809347d03f6639f18eec492c226e375c96d456d81b32d3046e40865ce0f87ab"} Jul 22 02:46:33.411343 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:33.410956 2579 scope.go:117] "RemoveContainer" containerID="6a6e3a69a919999307f36a766ec9716a8adf184a125044c93b161b0026f72eed" Jul 22 02:46:33.437544 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:33.437519 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5"] Jul 22 02:46:33.441818 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:33.441791 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fbf4b46e-5c5499c78b-nb7d5"] Jul 22 02:46:34.347621 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:34.347589 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7610cc3-f332-4ac0-92a6-8955a00afcae" path="/var/lib/kubelet/pods/b7610cc3-f332-4ac0-92a6-8955a00afcae/volumes" Jul 22 02:46:36.544859 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:36.544791 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:46:36.709800 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:36.709772 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:46:36.935264 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:36.935232 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:46:37.446038 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:37.446005 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:46:37.557406 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:37.557375 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:46:39.136841 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:39.136808 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:46:45.323809 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:45.323745 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:46:45.440986 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:45.440953 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:46:45.589150 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:45.589068 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:46:45.802481 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:45.802452 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:46:46.126134 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:46:46.126102 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:47:12.123128 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:47:12.123098 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:47:19.846506 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:47:19.846469 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:47:19.955110 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:47:19.955072 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:47:20.062392 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:47:20.062356 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:47:35.952481 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:47:35.952446 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:47:42.213020 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:47:42.212980 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:47:42.327610 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:47:42.327575 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:47:42.449850 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:47:42.449815 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:47:52.971058 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:47:52.971019 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:47:53.769950 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:47:53.769914 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:01.945974 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:01.945941 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:02.344830 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:02.344799 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:02.758524 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:02.758437 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:08.464154 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:08.464072 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:08.636980 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:08.636922 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:10.409124 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:10.409087 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:17.210662 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:17.210626 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:18.426740 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:18.426702 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:23.856160 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:23.856123 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:23.930974 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:23.930940 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:24.093973 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:24.093940 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:24.490539 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:24.490508 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:25.228160 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:25.228129 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:27.974508 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:27.974472 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:28.091234 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.091199 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7"] Jul 22 02:48:28.091564 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.091553 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7610cc3-f332-4ac0-92a6-8955a00afcae" containerName="maas-api" Jul 22 02:48:28.091612 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.091567 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7610cc3-f332-4ac0-92a6-8955a00afcae" containerName="maas-api" Jul 22 02:48:28.091650 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.091635 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7610cc3-f332-4ac0-92a6-8955a00afcae" containerName="maas-api" Jul 22 02:48:28.094442 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.094426 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" Jul 22 02:48:28.097076 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.097055 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-699fd371-serving-cert\"" Jul 22 02:48:28.100618 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.100590 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:28.107471 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.107447 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7"] Jul 22 02:48:28.192158 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.192117 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36ecc75-36e8-4bbe-963d-ad508c7382c7-maas-api-tls\") pod \"maas-api-e2e-mt-699fd371-b6465599d-w87j7\" (UID: \"d36ecc75-36e8-4bbe-963d-ad508c7382c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" Jul 22 02:48:28.192353 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.192202 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq7n4\" (UniqueName: \"kubernetes.io/projected/d36ecc75-36e8-4bbe-963d-ad508c7382c7-kube-api-access-kq7n4\") pod \"maas-api-e2e-mt-699fd371-b6465599d-w87j7\" (UID: \"d36ecc75-36e8-4bbe-963d-ad508c7382c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" Jul 22 02:48:28.192353 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.192252 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d36ecc75-36e8-4bbe-963d-ad508c7382c7-openshift-service-ca\") pod \"maas-api-e2e-mt-699fd371-b6465599d-w87j7\" (UID: \"d36ecc75-36e8-4bbe-963d-ad508c7382c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" Jul 22 02:48:28.214343 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.214312 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:28.292774 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.292663 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36ecc75-36e8-4bbe-963d-ad508c7382c7-maas-api-tls\") pod \"maas-api-e2e-mt-699fd371-b6465599d-w87j7\" (UID: \"d36ecc75-36e8-4bbe-963d-ad508c7382c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" Jul 22 02:48:28.292774 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.292729 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq7n4\" (UniqueName: \"kubernetes.io/projected/d36ecc75-36e8-4bbe-963d-ad508c7382c7-kube-api-access-kq7n4\") pod \"maas-api-e2e-mt-699fd371-b6465599d-w87j7\" (UID: \"d36ecc75-36e8-4bbe-963d-ad508c7382c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" Jul 22 02:48:28.292968 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.292797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d36ecc75-36e8-4bbe-963d-ad508c7382c7-openshift-service-ca\") pod \"maas-api-e2e-mt-699fd371-b6465599d-w87j7\" (UID: \"d36ecc75-36e8-4bbe-963d-ad508c7382c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" Jul 22 02:48:28.292968 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:48:28.292851 2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-serving-cert: secret "maas-api-e2e-mt-699fd371-serving-cert" not found Jul 22 02:48:28.292968 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:48:28.292919 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d36ecc75-36e8-4bbe-963d-ad508c7382c7-maas-api-tls podName:d36ecc75-36e8-4bbe-963d-ad508c7382c7 nodeName:}" failed. No retries permitted until 2026-07-22 02:48:28.792904463 +0000 UTC m=+1905.044465934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d36ecc75-36e8-4bbe-963d-ad508c7382c7-maas-api-tls") pod "maas-api-e2e-mt-699fd371-b6465599d-w87j7" (UID: "d36ecc75-36e8-4bbe-963d-ad508c7382c7") : secret "maas-api-e2e-mt-699fd371-serving-cert" not found Jul 22 02:48:28.293368 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.293351 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d36ecc75-36e8-4bbe-963d-ad508c7382c7-openshift-service-ca\") pod \"maas-api-e2e-mt-699fd371-b6465599d-w87j7\" (UID: \"d36ecc75-36e8-4bbe-963d-ad508c7382c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" Jul 22 02:48:28.303442 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.303418 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq7n4\" (UniqueName: \"kubernetes.io/projected/d36ecc75-36e8-4bbe-963d-ad508c7382c7-kube-api-access-kq7n4\") pod \"maas-api-e2e-mt-699fd371-b6465599d-w87j7\" (UID: \"d36ecc75-36e8-4bbe-963d-ad508c7382c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" Jul 22 02:48:28.632092 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.632063 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:28.796523 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.796493 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36ecc75-36e8-4bbe-963d-ad508c7382c7-maas-api-tls\") pod \"maas-api-e2e-mt-699fd371-b6465599d-w87j7\" (UID: \"d36ecc75-36e8-4bbe-963d-ad508c7382c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" Jul 22 02:48:28.798911 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.798887 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36ecc75-36e8-4bbe-963d-ad508c7382c7-maas-api-tls\") pod \"maas-api-e2e-mt-699fd371-b6465599d-w87j7\" (UID: \"d36ecc75-36e8-4bbe-963d-ad508c7382c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" Jul 22 02:48:28.860968 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.860936 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:28.984325 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:28.984235 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:29.004553 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:29.004516 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" Jul 22 02:48:29.143270 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:29.143241 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7"] Jul 22 02:48:29.145570 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:48:29.145534 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd36ecc75_36e8_4bbe_963d_ad508c7382c7.slice/crio-285047e4baea658a4d34fad85653226d8f172917026e3d79ed905cb391c7815b WatchSource:0}: Error finding container 285047e4baea658a4d34fad85653226d8f172917026e3d79ed905cb391c7815b: Status 404 returned error can't find the container with id 285047e4baea658a4d34fad85653226d8f172917026e3d79ed905cb391c7815b Jul 22 02:48:29.933229 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:29.933196 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" event={"ID":"d36ecc75-36e8-4bbe-963d-ad508c7382c7","Type":"ContainerStarted","Data":"93adc2f9b209f72e66e181896a79e4ee65d29e293395de8db992dfe09433910a"} Jul 22 02:48:29.933415 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:29.933246 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" event={"ID":"d36ecc75-36e8-4bbe-963d-ad508c7382c7","Type":"ContainerStarted","Data":"285047e4baea658a4d34fad85653226d8f172917026e3d79ed905cb391c7815b"} Jul 22 02:48:29.933415 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:29.933295 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" Jul 22 02:48:29.952326 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:29.952281 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" podStartSLOduration=1.58916328 podStartE2EDuration="1.952267232s" totalImagesPullingTime="363.103952ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:48:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:48:29.951395406 +0000 UTC m=+1906.202956901" watchObservedRunningTime="2026-07-22 02:48:29.952267232 +0000 UTC m=+1906.203828723" Jul 22 02:48:32.465355 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:32.465324 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:33.212196 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:33.212161 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:33.392177 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:33.392142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:33.634900 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:33.634866 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:35.944049 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:35.944019 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" Jul 22 02:48:40.039156 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:40.039118 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:40.142077 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:40.142045 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:51.075874 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:51.075832 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7"] Jul 22 02:48:51.076385 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:51.076050 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" podUID="d36ecc75-36e8-4bbe-963d-ad508c7382c7" containerName="maas-api" containerID="cri-o://93adc2f9b209f72e66e181896a79e4ee65d29e293395de8db992dfe09433910a" gracePeriod=30 Jul 22 02:48:51.110567 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:51.110536 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:51.327872 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:51.327813 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" Jul 22 02:48:51.405247 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:51.405216 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq7n4\" (UniqueName: \"kubernetes.io/projected/d36ecc75-36e8-4bbe-963d-ad508c7382c7-kube-api-access-kq7n4\") pod \"d36ecc75-36e8-4bbe-963d-ad508c7382c7\" (UID: \"d36ecc75-36e8-4bbe-963d-ad508c7382c7\") " Jul 22 02:48:51.405409 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:51.405263 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36ecc75-36e8-4bbe-963d-ad508c7382c7-maas-api-tls\") pod \"d36ecc75-36e8-4bbe-963d-ad508c7382c7\" (UID: \"d36ecc75-36e8-4bbe-963d-ad508c7382c7\") " Jul 22 02:48:51.405409 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:51.405300 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d36ecc75-36e8-4bbe-963d-ad508c7382c7-openshift-service-ca\") pod \"d36ecc75-36e8-4bbe-963d-ad508c7382c7\" (UID: \"d36ecc75-36e8-4bbe-963d-ad508c7382c7\") " Jul 22 02:48:51.405738 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:51.405713 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d36ecc75-36e8-4bbe-963d-ad508c7382c7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d36ecc75-36e8-4bbe-963d-ad508c7382c7" (UID: "d36ecc75-36e8-4bbe-963d-ad508c7382c7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:48:51.407362 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:51.407343 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d36ecc75-36e8-4bbe-963d-ad508c7382c7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d36ecc75-36e8-4bbe-963d-ad508c7382c7" (UID: "d36ecc75-36e8-4bbe-963d-ad508c7382c7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:48:51.407447 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:51.407433 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d36ecc75-36e8-4bbe-963d-ad508c7382c7-kube-api-access-kq7n4" (OuterVolumeSpecName: "kube-api-access-kq7n4") pod "d36ecc75-36e8-4bbe-963d-ad508c7382c7" (UID: "d36ecc75-36e8-4bbe-963d-ad508c7382c7"). InnerVolumeSpecName "kube-api-access-kq7n4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:48:51.506609 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:51.506581 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d36ecc75-36e8-4bbe-963d-ad508c7382c7-maas-api-tls\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:48:51.506609 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:51.506608 2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d36ecc75-36e8-4bbe-963d-ad508c7382c7-openshift-service-ca\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:48:51.506839 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:51.506618 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq7n4\" (UniqueName: \"kubernetes.io/projected/d36ecc75-36e8-4bbe-963d-ad508c7382c7-kube-api-access-kq7n4\") on node \"ip-10-0-132-37.ec2.internal\" DevicePath \"\"" Jul 22 02:48:52.031816 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:52.031774 2579 generic.go:356] "Generic (PLEG): container finished" podID="d36ecc75-36e8-4bbe-963d-ad508c7382c7" containerID="93adc2f9b209f72e66e181896a79e4ee65d29e293395de8db992dfe09433910a" exitCode=0 Jul 22 02:48:52.032014 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:52.031822 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" Jul 22 02:48:52.032014 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:52.031868 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" event={"ID":"d36ecc75-36e8-4bbe-963d-ad508c7382c7","Type":"ContainerDied","Data":"93adc2f9b209f72e66e181896a79e4ee65d29e293395de8db992dfe09433910a"} Jul 22 02:48:52.032014 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:52.031923 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7" event={"ID":"d36ecc75-36e8-4bbe-963d-ad508c7382c7","Type":"ContainerDied","Data":"285047e4baea658a4d34fad85653226d8f172917026e3d79ed905cb391c7815b"} Jul 22 02:48:52.032014 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:52.031946 2579 scope.go:117] "RemoveContainer" containerID="93adc2f9b209f72e66e181896a79e4ee65d29e293395de8db992dfe09433910a" Jul 22 02:48:52.041644 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:52.041625 2579 scope.go:117] "RemoveContainer" containerID="93adc2f9b209f72e66e181896a79e4ee65d29e293395de8db992dfe09433910a" Jul 22 02:48:52.041892 ip-10-0-132-37 kubenswrapper[2579]: E0722 02:48:52.041874 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93adc2f9b209f72e66e181896a79e4ee65d29e293395de8db992dfe09433910a\": container with ID starting with 93adc2f9b209f72e66e181896a79e4ee65d29e293395de8db992dfe09433910a not found: ID does not exist" containerID="93adc2f9b209f72e66e181896a79e4ee65d29e293395de8db992dfe09433910a" Jul 22 02:48:52.041953 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:52.041899 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93adc2f9b209f72e66e181896a79e4ee65d29e293395de8db992dfe09433910a"} err="failed to get container status \"93adc2f9b209f72e66e181896a79e4ee65d29e293395de8db992dfe09433910a\": rpc error: code = NotFound desc = could not find container \"93adc2f9b209f72e66e181896a79e4ee65d29e293395de8db992dfe09433910a\": container with ID starting with 93adc2f9b209f72e66e181896a79e4ee65d29e293395de8db992dfe09433910a not found: ID does not exist" Jul 22 02:48:52.053827 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:52.053805 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7"] Jul 22 02:48:52.058587 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:52.058565 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-699fd371-b6465599d-w87j7"] Jul 22 02:48:52.346414 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:52.346382 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d36ecc75-36e8-4bbe-963d-ad508c7382c7" path="/var/lib/kubelet/pods/d36ecc75-36e8-4bbe-963d-ad508c7382c7/volumes" Jul 22 02:48:55.554491 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:55.554457 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:48:55.940331 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:48:55.940295 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:01.889332 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:01.889283 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:01.951716 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:01.951681 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:02.155171 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:02.155087 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:02.395793 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:02.395738 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:02.542553 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:02.542471 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:02.628925 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:02.628888 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:02.734560 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:02.734527 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:08.573246 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:08.573213 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:08.652386 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:08.652354 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:08.739655 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:08.739622 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:08.838494 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:08.838406 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:08.939455 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:08.939424 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:14.729905 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:14.729877 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:14.831252 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:14.831226 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:21.438164 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:21.438133 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dt2dh_268efab0-5430-4ebe-ab40-1987b4e0220a/manager/0.log" Jul 22 02:49:21.682196 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:21.682166 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bb9586989-zfm85_7020bb19-b233-4cfe-8453-2e05916d2499/manager/0.log" Jul 22 02:49:22.018461 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:22.018428 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57f477d5fd-4nkms_442c25fa-c730-4b9f-abed-8e4cc9474e89/copy-manifests/0.log" Jul 22 02:49:22.030739 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:22.030707 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57f477d5fd-4nkms_442c25fa-c730-4b9f-abed-8e4cc9474e89/manager/0.log" Jul 22 02:49:22.621013 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:22.620987 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5b77f8c7b9-kr5tk_04f13303-264a-4cd2-af1c-ce3da0c1567b/maas-api/0.log" Jul 22 02:49:22.956097 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:22.956020 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-h2tld_0a36f808-24d7-429c-8813-cf6072cb3398/postgres/0.log" Jul 22 02:49:24.532747 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:24.532716 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7228x_aa4b1f55-cc0e-4851-8f28-50ec6b9897e6/manager/0.log" Jul 22 02:49:24.642636 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:24.642609 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-27zh7_2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2/kuadrant-console-plugin/0.log" Jul 22 02:49:25.719746 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:25.719716 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7756896c6-8zqcw_2a445730-a4dc-4b9d-a71b-c5b657ae201d/kube-auth-proxy/0.log" Jul 22 02:49:26.208595 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:26.208561 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-fjh96_5813a3d5-719d-4cbb-8437-067923ab504d/payload-processing/0.log" Jul 22 02:49:26.814623 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:26.814593 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-xkz56_52160973-04e8-49b4-86bd-600fe5581930/main/0.log" Jul 22 02:49:27.050222 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:27.050196 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdqcnz_ca8b100c-2fb1-4616-87fa-d9940a847fa5/main/0.log" Jul 22 02:49:27.280591 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:27.280521 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-lvvl7_510749b5-a1eb-413d-8c65-8ac02a092d7c/main/0.log" Jul 22 02:49:27.695145 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:27.695099 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:32.346383 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:32.346330 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:32.449724 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:32.449685 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:49:35.224219 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:35.224146 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5x227_00c60860-7a47-4782-9bc3-35d8a634cd22/global-pull-secret-syncer/0.log" Jul 22 02:49:35.359566 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:35.359534 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" Jul 22 02:49:35.451946 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:35.451918 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-37.ec2.internal_cb3cb116ed8a362c1b5ea2fe16379342/haproxy/0.log" Jul 22 02:49:40.955191 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:40.955159 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7228x_aa4b1f55-cc0e-4851-8f28-50ec6b9897e6/manager/0.log" Jul 22 02:49:41.012240 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:41.012217 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-27zh7_2754e8e6-b04c-46ac-ad67-a1c61ea5dcb2/kuadrant-console-plugin/0.log" Jul 22 02:49:43.502692 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:43.502609 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-5mshl_40aa0309-b8b4-4ef4-a101-2eab224d8109/kube-state-metrics/0.log" Jul 22 02:49:43.569653 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:43.569625 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-5mshl_40aa0309-b8b4-4ef4-a101-2eab224d8109/kube-rbac-proxy-main/0.log" Jul 22 02:49:43.638918 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:43.638893 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-5mshl_40aa0309-b8b4-4ef4-a101-2eab224d8109/kube-rbac-proxy-self/0.log" Jul 22 02:49:43.726225 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:43.726201 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-645645cc5f-gk29n_28f51ddc-0ee9-433e-975f-062415fb6633/metrics-server/0.log" Jul 22 02:49:43.794041 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:43.793965 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-hstgx_407d5dae-eeae-4036-9e7b-c2b746c77b54/monitoring-plugin/0.log" Jul 22 02:49:44.104984 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.104955 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fb5pc_f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29/node-exporter/0.log" Jul 22 02:49:44.153553 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.153526 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fb5pc_f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29/kube-rbac-proxy/0.log" Jul 22 02:49:44.181288 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.181259 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fb5pc_f1bee5fa-dda5-4654-8d5b-c6a81c5fcf29/init-textfile/0.log" Jul 22 02:49:44.215066 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.215036 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-28v75_40203506-f9ca-4153-acfb-8bc7e16a9750/kube-rbac-proxy-main/0.log" Jul 22 02:49:44.245258 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.245228 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-28v75_40203506-f9ca-4153-acfb-8bc7e16a9750/kube-rbac-proxy-self/0.log" Jul 22 02:49:44.273271 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.273243 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-28v75_40203506-f9ca-4153-acfb-8bc7e16a9750/openshift-state-metrics/0.log" Jul 22 02:49:44.315120 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.315091 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c/prometheus/0.log" Jul 22 02:49:44.345284 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.345258 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c/config-reloader/0.log" Jul 22 02:49:44.381112 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.381051 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c/thanos-sidecar/0.log" Jul 22 02:49:44.414819 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.414789 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c/kube-rbac-proxy-web/0.log" Jul 22 02:49:44.446608 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.446586 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c/kube-rbac-proxy/0.log" Jul 22 02:49:44.478004 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.477980 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c/kube-rbac-proxy-thanos/0.log" Jul 22 02:49:44.509726 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.509704 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2ef18c3-ff7d-48b9-a05a-ab496ee4af6c/init-config-reloader/0.log" Jul 22 02:49:44.540920 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.540897 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-f28dl_af0578c0-9fbc-4d87-93d5-80df8b0ce521/prometheus-operator/0.log" Jul 22 02:49:44.566537 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.566515 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-f28dl_af0578c0-9fbc-4d87-93d5-80df8b0ce521/kube-rbac-proxy/0.log" Jul 22 02:49:44.596146 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.596124 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-vpt6g_290eddc4-9e4e-42b3-9a6f-a7d8f38cf48b/prometheus-operator-admission-webhook/0.log" Jul 22 02:49:44.961550 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.961518 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2"] Jul 22 02:49:44.962038 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.962018 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d36ecc75-36e8-4bbe-963d-ad508c7382c7" containerName="maas-api" Jul 22 02:49:44.962038 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.962039 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d36ecc75-36e8-4bbe-963d-ad508c7382c7" containerName="maas-api" Jul 22 02:49:44.962195 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.962128 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d36ecc75-36e8-4bbe-963d-ad508c7382c7" containerName="maas-api" Jul 22 02:49:44.966414 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.966391 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:44.969554 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.969533 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j9wvl\"/\"kube-root-ca.crt\"" Jul 22 02:49:44.970516 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.970497 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j9wvl\"/\"default-dockercfg-sp5qx\"" Jul 22 02:49:44.970633 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.970496 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j9wvl\"/\"openshift-service-ca.crt\"" Jul 22 02:49:44.978423 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.978402 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2"] Jul 22 02:49:44.988708 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.988683 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52750478-8e29-4fad-83ca-2f2475ea7ec2-lib-modules\") pod \"perf-node-gather-daemonset-w5kd2\" (UID: \"52750478-8e29-4fad-83ca-2f2475ea7ec2\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:44.988847 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.988734 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52750478-8e29-4fad-83ca-2f2475ea7ec2-sys\") pod \"perf-node-gather-daemonset-w5kd2\" (UID: \"52750478-8e29-4fad-83ca-2f2475ea7ec2\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:44.988847 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.988816 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/52750478-8e29-4fad-83ca-2f2475ea7ec2-podres\") pod \"perf-node-gather-daemonset-w5kd2\" (UID: \"52750478-8e29-4fad-83ca-2f2475ea7ec2\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:44.988953 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.988869 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jtkx\" (UniqueName: \"kubernetes.io/projected/52750478-8e29-4fad-83ca-2f2475ea7ec2-kube-api-access-6jtkx\") pod \"perf-node-gather-daemonset-w5kd2\" (UID: \"52750478-8e29-4fad-83ca-2f2475ea7ec2\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:44.988953 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:44.988904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/52750478-8e29-4fad-83ca-2f2475ea7ec2-proc\") pod \"perf-node-gather-daemonset-w5kd2\" (UID: \"52750478-8e29-4fad-83ca-2f2475ea7ec2\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:45.089883 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:45.089844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/52750478-8e29-4fad-83ca-2f2475ea7ec2-podres\") pod \"perf-node-gather-daemonset-w5kd2\" (UID: \"52750478-8e29-4fad-83ca-2f2475ea7ec2\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:45.089883 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:45.089888 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jtkx\" (UniqueName: \"kubernetes.io/projected/52750478-8e29-4fad-83ca-2f2475ea7ec2-kube-api-access-6jtkx\") pod \"perf-node-gather-daemonset-w5kd2\" (UID: \"52750478-8e29-4fad-83ca-2f2475ea7ec2\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:45.090082 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:45.090001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/52750478-8e29-4fad-83ca-2f2475ea7ec2-proc\") pod \"perf-node-gather-daemonset-w5kd2\" (UID: \"52750478-8e29-4fad-83ca-2f2475ea7ec2\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:45.090082 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:45.090041 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/52750478-8e29-4fad-83ca-2f2475ea7ec2-proc\") pod \"perf-node-gather-daemonset-w5kd2\" (UID: \"52750478-8e29-4fad-83ca-2f2475ea7ec2\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:45.090082 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:45.090008 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/52750478-8e29-4fad-83ca-2f2475ea7ec2-podres\") pod \"perf-node-gather-daemonset-w5kd2\" (UID: \"52750478-8e29-4fad-83ca-2f2475ea7ec2\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:45.090082 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:45.090070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52750478-8e29-4fad-83ca-2f2475ea7ec2-lib-modules\") pod \"perf-node-gather-daemonset-w5kd2\" (UID: \"52750478-8e29-4fad-83ca-2f2475ea7ec2\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:45.090218 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:45.090107 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52750478-8e29-4fad-83ca-2f2475ea7ec2-sys\") pod \"perf-node-gather-daemonset-w5kd2\" (UID: \"52750478-8e29-4fad-83ca-2f2475ea7ec2\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:45.090218 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:45.090183 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52750478-8e29-4fad-83ca-2f2475ea7ec2-sys\") pod \"perf-node-gather-daemonset-w5kd2\" (UID: \"52750478-8e29-4fad-83ca-2f2475ea7ec2\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:45.090218 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:45.090189 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/52750478-8e29-4fad-83ca-2f2475ea7ec2-lib-modules\") pod \"perf-node-gather-daemonset-w5kd2\" (UID: \"52750478-8e29-4fad-83ca-2f2475ea7ec2\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:45.099384 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:45.099360 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jtkx\" (UniqueName: \"kubernetes.io/projected/52750478-8e29-4fad-83ca-2f2475ea7ec2-kube-api-access-6jtkx\") pod \"perf-node-gather-daemonset-w5kd2\" (UID: \"52750478-8e29-4fad-83ca-2f2475ea7ec2\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:45.276672 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:45.276578 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:45.412083 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:45.412057 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2"] Jul 22 02:49:45.415362 ip-10-0-132-37 kubenswrapper[2579]: W0722 02:49:45.415336 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod52750478_8e29_4fad_83ca_2f2475ea7ec2.slice/crio-c5d9561e982d82575e7ccc5cb5097757f31566b0905f3e378fbe621e5951cd7a WatchSource:0}: Error finding container c5d9561e982d82575e7ccc5cb5097757f31566b0905f3e378fbe621e5951cd7a: Status 404 returned error can't find the container with id c5d9561e982d82575e7ccc5cb5097757f31566b0905f3e378fbe621e5951cd7a Jul 22 02:49:46.286614 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:46.286571 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" event={"ID":"52750478-8e29-4fad-83ca-2f2475ea7ec2","Type":"ContainerStarted","Data":"6b4fe7e823ca35a099cc07e744df4e64fdd987a4af9f2a97ca5fd0a1d38eba7c"} Jul 22 02:49:46.287014 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:46.286632 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" event={"ID":"52750478-8e29-4fad-83ca-2f2475ea7ec2","Type":"ContainerStarted","Data":"c5d9561e982d82575e7ccc5cb5097757f31566b0905f3e378fbe621e5951cd7a"} Jul 22 02:49:46.287014 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:46.286705 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:46.303410 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:46.303360 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" podStartSLOduration=2.303343881 podStartE2EDuration="2.303343881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:49:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:49:46.302613102 +0000 UTC m=+1982.554174619" watchObservedRunningTime="2026-07-22 02:49:46.303343881 +0000 UTC m=+1982.554905367" Jul 22 02:49:48.753397 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:48.753370 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-brjtc_a39eaba3-240b-488d-a279-ed0c1c8409b5/dns/0.log" Jul 22 02:49:48.780338 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:48.780312 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-brjtc_a39eaba3-240b-488d-a279-ed0c1c8409b5/kube-rbac-proxy/0.log" Jul 22 02:49:48.975707 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:48.975679 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wm4hz_0fb28c76-bbb2-4d94-ae75-98525afea6dc/dns-node-resolver/0.log" Jul 22 02:49:49.582397 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:49.582366 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qmrkw_13620db1-75d1-4148-a52a-bcef93df1676/node-ca/0.log" Jul 22 02:49:50.643950 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:50.643919 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7756896c6-8zqcw_2a445730-a4dc-4b9d-a71b-c5b657ae201d/kube-auth-proxy/0.log" Jul 22 02:49:50.811282 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:50.811250 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-fjh96_5813a3d5-719d-4cbb-8437-067923ab504d/payload-processing/0.log" Jul 22 02:49:51.501635 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:51.501610 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qsw69_827dc975-54a6-4e48-a6e2-44d6e1afaf63/serve-healthcheck-canary/0.log" Jul 22 02:49:52.154541 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:52.154514 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wqfnz_6d8a5fb2-e0a1-469c-9d25-90ae7e60f184/kube-rbac-proxy/0.log" Jul 22 02:49:52.177139 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:52.177111 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wqfnz_6d8a5fb2-e0a1-469c-9d25-90ae7e60f184/exporter/0.log" Jul 22 02:49:52.203771 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:52.203731 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wqfnz_6d8a5fb2-e0a1-469c-9d25-90ae7e60f184/extractor/0.log" Jul 22 02:49:52.300851 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:52.300825 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-w5kd2" Jul 22 02:49:54.656763 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:54.656718 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dt2dh_268efab0-5430-4ebe-ab40-1987b4e0220a/manager/0.log" Jul 22 02:49:54.887892 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:54.887835 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bb9586989-zfm85_7020bb19-b233-4cfe-8453-2e05916d2499/manager/0.log" Jul 22 02:49:55.036217 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:55.036136 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57f477d5fd-4nkms_442c25fa-c730-4b9f-abed-8e4cc9474e89/manager/0.log" Jul 22 02:49:55.054820 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:55.054798 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57f477d5fd-4nkms_442c25fa-c730-4b9f-abed-8e4cc9474e89/copy-manifests/0.log" Jul 22 02:49:55.580229 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:55.580195 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7756896c6-8zqcw_2a445730-a4dc-4b9d-a71b-c5b657ae201d/kube-auth-proxy/0.log" Jul 22 02:49:55.725455 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:55.725428 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-fjh96_5813a3d5-719d-4cbb-8437-067923ab504d/payload-processing/0.log" Jul 22 02:49:56.533722 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:56.533680 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c9bd579-2rd4d_198bb068-511a-4a0c-a9da-534dc47c26b9/manager/0.log" Jul 22 02:49:57.029482 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:57.029457 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7756896c6-8zqcw_2a445730-a4dc-4b9d-a71b-c5b657ae201d/kube-auth-proxy/0.log" Jul 22 02:49:57.162315 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:49:57.162279 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-fjh96_5813a3d5-719d-4cbb-8437-067923ab504d/payload-processing/0.log" Jul 22 02:50:02.391251 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:50:02.391211 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:50:02.463945 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:50:02.463857 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hnk2n_d702e61a-96f1-4db2-bdcc-8301df7cb325/konnectivity-agent/0.log" limit=1024 Jul 22 02:50:02.906696 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:50:02.906662 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-22g6m_c42e8544-729e-4248-a570-b30816bd8b23/kube-multus/0.log" Jul 22 02:50:03.361940 ip-10-0-132-37 kubenswrapper[2579]: I0722 02:50:03.361908 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9hdr_88c4dd7c-e350-4b18-b811-580ceb2f0e3a/kube-multus-additional-cni-plugins/0.log"