Jul 20 18:58:28.360185 ip-10-0-140-250 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 20 18:58:28.360313 ip-10-0-140-250 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 20 18:58:28.360324 ip-10-0-140-250 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 20 18:58:28.360628 ip-10-0-140-250 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 20 18:58:39.545277 ip-10-0-140-250 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 20 18:58:39.545292 ip-10-0-140-250 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot bc04b482fde845e6b8d838ef3092e898 --
Jul 20 19:00:37.069372 ip-10-0-140-250 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 19:00:37.530630 ip-10-0-140-250 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:00:37.530630 ip-10-0-140-250 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 19:00:37.530630 ip-10-0-140-250 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:00:37.530630 ip-10-0-140-250 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 19:00:37.530630 ip-10-0-140-250 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 19:00:37.530630 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.498020    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 19:00:37.530630 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505805    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:37.530630 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505817    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:37.530630 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505820    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:37.530630 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505825    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:37.530630 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505829    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:37.530630 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505832    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:37.530630 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505835    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:37.530630 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505838    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505840    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505843    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505847    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505850    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505853    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505856    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505858    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505861    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505864    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505866    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505869    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505872    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505874    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505884    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505887    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505890    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505893    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505895    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505898    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:37.544528 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505901    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505904    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505907    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505909    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505912    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505914    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505917    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505919    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505922    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505925    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505927    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505930    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505932    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505935    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505937    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505940    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505943    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505945    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505947    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505950    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:37.546705 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505952    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505955    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505957    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505960    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505962    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505964    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505967    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505970    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505972    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505975    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505978    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505980    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505983    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505985    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505988    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505991    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505994    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505996    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.505999    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506003    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:37.548746 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506006    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506008    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506011    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506013    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506016    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506018    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506021    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506023    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506025    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506028    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506030    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506033    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506037    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506039    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506042    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506044    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506047    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506049    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506052    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:37.550680 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506054    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506060    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506065    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506068    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506071    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506075    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506078    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506082    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506086    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506089    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506092    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506095    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506098    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506834    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506845    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506848    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506852    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506855    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506859    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:37.551280 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506861    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506864    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506868    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506871    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506874    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506878    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506880    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506883    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506885    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506888    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506891    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506893    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506896    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506898    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506900    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506903    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506906    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506909    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506911    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:37.553324 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506914    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506919    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506925    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506928    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506931    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506934    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506937    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506941    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506944    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506947    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506949    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506952    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506955    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506957    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506960    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506963    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506965    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506968    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506970    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:37.555143 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506973    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506976    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506978    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506981    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506983    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506987    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506989    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506991    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506994    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506997    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.506999    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507002    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507005    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507008    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507010    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507013    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507016    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507019    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507021    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507024    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:37.556149 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507026    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507029    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507032    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507034    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507037    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507040    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507043    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507049    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507052    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507055    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507058    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507061    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507064    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507067    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507070    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507073    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507076    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507080    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507082    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507085    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:37.557049 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507087    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507090    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507093    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507095    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507098    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507100    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507103    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507105    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507108    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507111    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507114    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507132    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507136    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507138    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507141    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507530    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507536    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507539    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507542    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507548    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:37.557996 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507551    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507555    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507559    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507562    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507565    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507568    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507571    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507574    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507576    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507579    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507581    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507584    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507586    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507589    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507591    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507594    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507598    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507600    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507603    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:37.558887 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507606    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507609    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507612    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507614    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507617    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507619    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507622    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507624    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507627    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507629    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507632    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507634    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507640    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507643    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507646    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507649    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507651    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507654    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507656    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507659    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:37.559766 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507661    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507663    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507667    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507670    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507673    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507676    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507678    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507681    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507683    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507687    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507690    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507692    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507695    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507698    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507700    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507703    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507705    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507708    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507712    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:37.560678 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507714    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507717    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507719    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507722    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507724    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507728    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507730    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507733    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507735    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507738    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507746    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507749    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507751    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507754    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507756    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507759    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507761    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507764    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507766    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507769    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:37.561569 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507771    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507773    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507777    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507779    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507782    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507784    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507787    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507789    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507799    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507802    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507804    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507807    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507809    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507812    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507814    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.507817    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507879    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507887    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507893    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507897    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507901    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 19:00:37.562458 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507904    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507908    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507912    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507915    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507918    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507921    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507924    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507927    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507930    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507933    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507936    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507938    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507941    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507949    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507952    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507955    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507958    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507962    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507965    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507968    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507977    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507980    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507984    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507987    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 19:00:37.563340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507989    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507992    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507995    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.507999    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508003    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508006    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508009    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508012    2560 flags.go:64] FLAG: --enable-server="true"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508014    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508021    2560 flags.go:64] FLAG: --event-burst="100"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508024    2560 flags.go:64] FLAG: --event-qps="50"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508027    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508029    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508032    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508036    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508039    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508042    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508045    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508048    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508051    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508054    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508058    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508061    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508064    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508067    2560 flags.go:64] FLAG: --feature-gates=""
Jul 20 19:00:37.564478 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508070    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508073    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508076    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508079    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508088    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508091    2560 flags.go:64] FLAG: --help="false"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508094    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-140-250.ec2.internal"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508097    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508100    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508103    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508106    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508111    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508114    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508131    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508134    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508137    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508139    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508143    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508145    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508148    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508151    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508154    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508157    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508159    2560 flags.go:64] FLAG: --lock-file=""
Jul 20 19:00:37.565592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508162    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508165    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508168    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508173    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508177    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508180    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508183    2560 flags.go:64] FLAG: --logging-format="text"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508186    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508189    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508192    2560 flags.go:64] FLAG: --manifest-url=""
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508195    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508199    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508202    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508211    2560 flags.go:64] FLAG: --max-pods="110"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508214    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508218    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508220    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508223    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508226    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508230    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508233    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508252    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508256    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508259    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 19:00:37.566706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508262    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508265    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508270    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508273    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508276    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508278    2560 flags.go:64] FLAG: --port="10250"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508281    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508284    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06295b2e7f0c6ea31"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508287    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508290    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508293    2560 flags.go:64] FLAG: --register-node="true"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508296    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508299    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508303    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508306    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508308    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508312    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508315    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508318    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508321    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508323    2560 flags.go:64] FLAG: --runonce="false"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508326    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508334    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508338    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508341    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 19:00:37.567832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508343    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508346    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508350    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508353    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508356    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508359    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508361    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508364    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508367    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508370    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508373    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508378    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508380    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508383    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508389    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508392    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508395    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508397    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508406    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508411    2560 flags.go:64] FLAG: --v="2"
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508416    2560 flags.go:64] FLAG: --version="false"
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508420    2560 flags.go:64] FLAG: --vmodule=""
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508423    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508426    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508562    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:37.571612 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508566    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508569    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508572    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508575    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508578    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508586    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508589    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508592    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508594    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508598    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508600    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508603    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508605    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508608    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508611    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508613    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508616    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508619    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508622    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508624    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:37.572747 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508627    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508629    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508632    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508635    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508639    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508642    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508644    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508649    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508652    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508655    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508657    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508660    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508663    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508668    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508671    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508673    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508676    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508678    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508687    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:37.632856 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508690    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:37.611383 ip-10-0-140-250 systemd[1]: Started Kubernetes Kubelet.
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508693    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508697    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508699    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508701    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508704    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508706    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508709    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508711    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508714    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508718    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508721    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508724    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508727    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508729    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508732    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508734    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508736    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508739    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:37.634068 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508741    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508745    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508748    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508750    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508753    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508756    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508758    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508760    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508763    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508765    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508768    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508771    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508773    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508781    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508784    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508787    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508790    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508792    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508795    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508797    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:37.634958 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508801    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508805    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508807    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508810    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508813    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508816    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508819    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508821    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508824    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508826    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508829    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508831    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508834    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508837    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508840    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508842    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508845    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508847    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508850    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:37.636246 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.508853    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:37.637503 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.508858    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:00:37.637503 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.516493    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 19:00:37.637503 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.516510    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 19:00:37.637503 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.517357    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 19:00:37.637503 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.517370    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 19:00:37.637503 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517425    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:37.637503 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517431    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:37.637503 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517434    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:37.637503 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517438    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:37.637503 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517440    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:37.637503 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517443    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:37.637503 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517446    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:37.637503 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517449    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:37.637503 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517451    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:37.637503 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517454    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517457    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517460    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517462    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517466    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517469    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517471    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517474    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517477    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517480    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517483    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517485    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517488    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517491    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517494    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517497    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517500    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517503    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517505    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:37.638519 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517508    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517511    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517514    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517516    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517519    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517521    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517524    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517526    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517530    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517533    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517535    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517537    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517540    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517543    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517545    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517548    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517550    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517553    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517556    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517559    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:37.639146 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517563    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517567    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517570    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517573    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517576    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517579    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517582    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517585    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517588    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517591    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517593    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517596    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517598    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517601    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517603    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517606    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517608    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517611    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517614    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517616    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:37.639789 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517621    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517624    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517626    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517631    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517634    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517636    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517640    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517644    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517647    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517649    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517652    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517655    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517658    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517660    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517663    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517665    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517668    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517671    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517674    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:37.640719 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517676    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:37.641627 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517679    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:37.641627 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517681    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:37.641627 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517684    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:37.641627 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517686    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:37.641627 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517689    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:37.641627 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517692    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:37.641627 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517694    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:37.641627 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517697    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:37.641627 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517699    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:37.641627 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517703    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:37.641627 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517706    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:37.641627 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.517711    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:00:37.641627 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517819    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 19:00:37.641627 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517825    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 19:00:37.641627 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517828    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517832    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517836    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517839    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517842    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517845    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517848    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517850    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517853    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517856    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517859    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517862    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517864    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517867    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517869    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517872    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517875    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517877    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517880    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517882    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 19:00:37.642468 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517885    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517887    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517890    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517892    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517895    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517897    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517900    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517904    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517907    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517909    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517912    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517916    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517918    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517921    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517925    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517928    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517931    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517934    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517936    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 19:00:37.643137 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517939    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517942    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517944    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517946    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517950    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517952    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517955    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517957    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517960    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517963    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517965    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517967    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517970    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517972    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517975    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517977    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517980    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517982    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517985    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517987    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 19:00:37.643988 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517991    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517994    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517996    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.517998    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518002    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518005    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518008    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518011    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518013    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518015    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518019    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518023    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518026    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518028    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518031    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518033    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518036    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518039    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518042    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518044    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 19:00:37.644852 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518047    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 19:00:37.645483 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518049    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 19:00:37.645483 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518052    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 19:00:37.645483 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518054    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 19:00:37.645483 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518057    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 19:00:37.645483 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518059    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 19:00:37.645483 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518062    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 19:00:37.645483 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518064    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 19:00:37.645483 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518067    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 19:00:37.645483 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518069    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 19:00:37.645483 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518071    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 19:00:37.645483 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518074    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 19:00:37.645483 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518078    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 19:00:37.645483 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518080    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 19:00:37.645483 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518083    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 19:00:37.645483 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518085    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 19:00:37.645483 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518089    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 19:00:37.645483 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:37.518091    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 19:00:37.646141 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.518096    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 19:00:37.646141 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.518213    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 19:00:37.646141 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.520099    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 19:00:37.646141 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.521471    2560 server.go:1019] "Starting client certificate rotation"
Jul 20 19:00:37.646141 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.521590    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 19:00:37.646141 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.521625    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 19:00:37.646141 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.523814    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 19:00:37.646141 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.526515    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 19:00:37.646141 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.536753    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 20 19:00:37.646141 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.542394    2560 log.go:25] "Validated CRI v1 image API"
Jul 20 19:00:37.646141 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.544782    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 19:00:37.646141 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.547670    2560 fs.go:135] Filesystem UUIDs: map[6d4b671b-b802-43de-a411-d29ce0fada39:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f32930ff-a9a9-4da2-9424-a497205470aa:/dev/nvme0n1p4]
Jul 20 19:00:37.646809 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.547684    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 19:00:37.646958 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.552729    2560 manager.go:216] Machine: {Timestamp:2026-07-20 19:00:37.551330972 +0000 UTC m=+0.347338296 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098831 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ed0b4b7d156f9bd4f0bfa40d6c8db SystemUUID:ec2ed0b4-b7d1-56f9-bd4f-0bfa40d6c8db BootID:bc04b482-fde8-45e6-b8d8-38ef3092e898 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1f:59:13:da:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1f:59:13:da:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:bb:b4:ac:50:b8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 19:00:37.646958 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.552827    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 19:00:37.646958 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.552892    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 19:00:37.646958 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.557487    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 19:00:37.646958 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.557522    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-250.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 19:00:37.646958 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.558624    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 19:00:37.646958 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.558984    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.558999    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.559006    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.559016    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.560025    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.562567    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.562702    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.562728    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.562738    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.562751    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.562761    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.562769    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.563705    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.563723    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.566158    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.604697    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.604726    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.605877    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.605891    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.605897    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.605902    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.605910    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.605916    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.605923    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.605928    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.605934    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.605940    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.605948    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.605953    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.606779    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rvb8g"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.607150    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.607163    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:37.608531    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:37.608546    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.608912    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-250.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.610599    2560 server.go:1268] "Started kubelet"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.610664    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.610766    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.610763    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.612100    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 19:00:37.647400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.612850    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.614583    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rvb8g"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:37.617140    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.618541    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.618562    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:37.618632    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.619260    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.619276    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.619361    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.619860    2560 factory.go:153] Registering CRI-O factory
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.619873    2560 factory.go:223] Registration of the crio container factory successfully
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.619924    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.619932    2560 factory.go:55] Registering systemd factory
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.619937    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.619952    2560 factory.go:103] Registering Raw factory
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.619962    2560 manager.go:1196] Started watching for new ooms in manager
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.620055    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.620064    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.620428    2560 manager.go:349] Starting recovery of all containers
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.631031    2560 manager.go:354] Recovery completed
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.638204    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.639946    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.639971    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.639984    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.640477    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.640485    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.640503    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.640535    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.641316    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.641335    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.641346    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.641570    2560 policy_none.go:49] "None policy: Start"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.641581    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.641592    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 19:00:37.648689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.642507    2560 policy_none.go:47] "Start"
Jul 20 19:00:37.776647 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:37.718869    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:37.836840 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:37.819213    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:37.972866 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:37.919645    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:37.972866 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:37.945610    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-250.ec2.internal.18c414a1d329a82d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-250.ec2.internal,UID:ip-10-0-140-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-250.ec2.internal,},FirstTimestamp:2026-07-20 19:00:37.610571821 +0000 UTC m=+0.406579145,LastTimestamp:2026-07-20 19:00:37.610571821 +0000 UTC m=+0.406579145,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-250.ec2.internal,}"
Jul 20 19:00:37.972866 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:37.958844    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:37.972866 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:37.962061    2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-250.ec2.internal\" not found" node="ip-10-0-140-250.ec2.internal"
Jul 20 19:00:38.116944 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:38.110550    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:38.261223 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:38.211061    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:38.261223 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.238065    2560 manager.go:337] "Starting Device Plugin manager"
Jul 20 19:00:38.261223 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:38.238107    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 19:00:38.261223 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.238118    2560 server.go:87] "Starting device plugin registration server"
Jul 20 19:00:38.261223 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.238449    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 19:00:38.261223 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.238460    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 19:00:38.261223 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.238787    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 19:00:38.261223 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.238847    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 19:00:38.261223 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.238853    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 19:00:38.261223 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:38.240109    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 19:00:38.261223 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:38.240154    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:38.575069 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.575047    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:38.581506 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.581483    2560 apiserver.go:52] "Watching apiserver"
Jul 20 19:00:38.581604 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.581516    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 19:00:38.581604 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.581518    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.581725 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.581688    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 19:00:38.581725 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.581697    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 19:00:38.582630 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.582611    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.582706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.582646    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.582706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.582662    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.582706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.582696    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-250.ec2.internal"
Jul 20 19:00:38.593273 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.593221    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 19:00:38.598748 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.598730    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-250.ec2.internal"
Jul 20 19:00:38.598824 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:38.598755    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-250.ec2.internal\": node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:38.618601 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.618576    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 18:55:38 +0000 UTC" deadline="2027-12-26 23:15:56.347362394 +0000 UTC"
Jul 20 19:00:38.618601 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.618599    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12580h15m17.728766787s"
Jul 20 19:00:38.627946 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:38.627927    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:38.728574 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:38.728540    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:38.732025 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.732003    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 19:00:38.733237 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.733212    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 19:00:38.733331 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.733261    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 19:00:38.733331 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.733291    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 19:00:38.733434 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:38.733333    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 19:00:38.737689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.737673    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:38.829199 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:38.829165    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:38.833604 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.833583    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-250.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal"]
Jul 20 19:00:38.833658 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.833646    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.834559 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.834544    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.834623 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.834575    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.834623 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.834590    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.836943 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.836929    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.837074 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.837052    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-250.ec2.internal"
Jul 20 19:00:38.837178 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.837094    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.840503 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.840486    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.840503 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.840498    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.840649 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.840521    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.840649 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.840522    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.840649 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.840547    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.840649 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.840533    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.842810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.842795    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=[]
Jul 20 19:00:38.842870 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.842812    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-87ghh"]
Jul 20 19:00:38.842870 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.842864    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.842974 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.842923    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal"
Jul 20 19:00:38.842974 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.842956    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.843756 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.843695    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.843756 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.843721    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.843756 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.843695    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.843909 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.843763    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.843909 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.843777    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.843909 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.843735    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.846640 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.846618    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-g85p9"]
Jul 20 19:00:38.846721 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.846705    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-87ghh"
Jul 20 19:00:38.846770 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.846734    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.846891 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.846869    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.848027 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.847619    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.848027 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.847648    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.848027 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.847665    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.848220 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.848139    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.848220 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.848171    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.848220 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.848211    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.849914 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.849893    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-ksnwk"]
Jul 20 19:00:38.850004 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.849962    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.850045 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.850034    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:38.850080 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.850066    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.850729 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.850714    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 19:00:38.850771 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.850739    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 19:00:38.851258 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.851236    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8pwtb\""
Jul 20 19:00:38.851570 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.851550    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.851635 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.851562    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.851635 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.851585    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 19:00:38.851635 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.851611    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.851635 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.851626    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.851635 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.851582    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.851786 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.851660    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.853973 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.853955    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-c82bl"]
Jul 20 19:00:38.854039 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.854033    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.854075 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.854047    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:38.854075 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.854071    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.855711 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.855121    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 19:00:38.855711 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.855402    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2bw5c\""
Jul 20 19:00:38.855711 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.855473    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 19:00:38.855711 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.855617    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.855711 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.855654    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.855711 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.855670    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.856068 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:38.855772    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:00:38.856068 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.855781    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 19:00:38.856068 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.856044    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 19:00:38.856259 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.856046    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 19:00:38.856618 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.856552    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.856618 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.856582    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.856618 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.856606    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.857499 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:38.857477    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-250.ec2.internal\" not found" node="ip-10-0-140-250.ec2.internal"
Jul 20 19:00:38.859209 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.859173    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-n47zz"]
Jul 20 19:00:38.859316 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.859273    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:38.859316 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.859294    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.859316 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.859300    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.861394 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.861376    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.861490 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.861402    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.861490 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.861400    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.861490 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.861419    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.861490 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.861433    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.861490 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.861444    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.863705 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.863685    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-dndtw"]
Jul 20 19:00:38.863802 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.863729    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 19:00:38.863802 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.863760    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:00:38.863802 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.863798    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.863977 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.863817    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vvbg9\""
Jul 20 19:00:38.863977 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.863799    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.863977 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.863885    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.864532 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.864513    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.864532 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.864527    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.864689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.864544    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.864689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.864550    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.864689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.864560    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.864689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.864563    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.866545 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.866529    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6pnl4\""
Jul 20 19:00:38.866749 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.866735    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 19:00:38.866868 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.866852    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"]
Jul 20 19:00:38.866926 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.866910    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dndtw"
Jul 20 19:00:38.866971 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.866934    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.867028 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.867000    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.867686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.867669    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.867770 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.867704    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.867770 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.867706    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.867770 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.867727    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.867770 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.867734    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.867770 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.867740    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.869824 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.869808    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cpss2\""
Jul 20 19:00:38.869962 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.869947    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 19:00:38.870050 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.870036    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:38.870082 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.870069    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.870182 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.870168    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:00:38.870310 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.870297    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 19:00:38.872155 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.871175    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.872155 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.871209    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.872155 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.871224    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.872388 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:38.872342    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-250.ec2.internal\" not found" node="ip-10-0-140-250.ec2.internal"
Jul 20 19:00:38.873550 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.873532    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 19:00:38.873693 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.873674    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 19:00:38.873693 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.873686    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tbrrq\""
Jul 20 19:00:38.873693 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.873679    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 19:00:38.894544 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.894526    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:38.920519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.920503    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 19:00:38.929255 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:38.929235    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:38.945708 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.945689    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-vt7z5"]
Jul 20 19:00:38.945805 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.945794    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.946612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.946590    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.946688 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.946626    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.946688 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.946636    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.949325 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.949310    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vt7z5"
Jul 20 19:00:38.949369 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.949347    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.950029 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.950014    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.950091 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.950039    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.950091 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.950048    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.952771 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.952749    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 19:00:38.952865 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.952756    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 19:00:38.953618 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.953601    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l84n7\""
Jul 20 19:00:38.961757 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.961738    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-7jhvx"]
Jul 20 19:00:38.962145 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.962134    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.962858 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.962842    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.962937 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.962866    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.962937 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.962877    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.965430 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.965412    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:38.965490 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.965456    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.966231 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.966215    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.966290 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.966238    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.966290 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.966247    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.968801 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.968768    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 19:00:38.968801 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.968776    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-84j7c\""
Jul 20 19:00:38.968952 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.968900    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 19:00:38.969018 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.969004    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 19:00:38.969499 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.969484    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 19:00:38.969641 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.969623    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 19:00:38.969717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.969703    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 19:00:38.973702 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.973686    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-2rwr8"]
Jul 20 19:00:38.973850 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.973840    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.977134 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.977094    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.977226 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.977125    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.977226 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.977172    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.979817 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.979781    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:38.979917 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.979832    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:38.980560 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.980544    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:38.980642 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.980568    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:38.980642 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.980578    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:38.980642 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:38.980637    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:00:38.985451 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-host\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:38.985548 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985461    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0848dc8-f613-4656-aa5e-c122e5b2650a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:38.985548 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985479    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-multus-cni-dir\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.985548 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-var-lib-cni-bin\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.985548 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985509    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-hostroot\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.985678 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b834d003-a3cf-401e-a040-3800e5a5a153-multus-daemon-config\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.985678 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985588    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpk4m\" (UniqueName: \"kubernetes.io/projected/5778dd59-96b2-41f8-85cd-c3918ec2a57f-kube-api-access-kpk4m\") pod \"iptables-alerter-dndtw\" (UID: \"5778dd59-96b2-41f8-85cd-c3918ec2a57f\") " pod="openshift-network-operator/iptables-alerter-dndtw"
Jul 20 19:00:38.985678 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985617    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-socket-dir\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:38.985678 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985636    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-sys\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:38.985678 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985652    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-var-lib-kubelet\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:38.985826 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0848dc8-f613-4656-aa5e-c122e5b2650a-cnibin\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:38.985826 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985703    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-cnibin\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.985826 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-multus-socket-dir-parent\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.985826 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985754    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-var-lib-cni-multus\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.985826 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985769    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-multus-conf-dir\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.985826 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985785    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-registration-dir\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:38.985826 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985812    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mttgk\" (UniqueName: \"kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk\") pod \"network-check-target-ksnwk\" (UID: \"9ee86025-4e97-450b-84cf-9930112292e6\") " pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:38.986031 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ab7c893c06d445ef68c950db0992258-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal\" (UID: \"4ab7c893c06d445ef68c950db0992258\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal"
Jul 20 19:00:38.986031 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985861    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ab7c893c06d445ef68c950db0992258-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal\" (UID: \"4ab7c893c06d445ef68c950db0992258\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal"
Jul 20 19:00:38.986031 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985879    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26a71b04-6976-4a2d-9d29-679411061462-tmp\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:38.986031 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985896    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/510bef60-8698-405f-a2bd-7200700ecb52-serviceca\") pod \"node-ca-87ghh\" (UID: \"510bef60-8698-405f-a2bd-7200700ecb52\") " pod="openshift-image-registry/node-ca-87ghh"
Jul 20 19:00:38.986031 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985910    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b834d003-a3cf-401e-a040-3800e5a5a153-cni-binary-copy\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.986031 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985927    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wc69\" (UniqueName: \"kubernetes.io/projected/b834d003-a3cf-401e-a040-3800e5a5a153-kube-api-access-2wc69\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.986031 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985942    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-kubernetes\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:38.986031 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985956    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-systemd\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:38.986031 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-run-k8s-cni-cncf-io\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.986031 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985985    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-etc-kubernetes\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.986031 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.985999    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-device-dir\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:38.986031 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-lib-modules\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:38.986449 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986046    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/510bef60-8698-405f-a2bd-7200700ecb52-host\") pod \"node-ca-87ghh\" (UID: \"510bef60-8698-405f-a2bd-7200700ecb52\") " pod="openshift-image-registry/node-ca-87ghh"
Jul 20 19:00:38.986449 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986070    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0848dc8-f613-4656-aa5e-c122e5b2650a-system-cni-dir\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:38.986449 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0848dc8-f613-4656-aa5e-c122e5b2650a-cni-binary-copy\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:38.986449 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986117    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-run-netns\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.986449 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5778dd59-96b2-41f8-85cd-c3918ec2a57f-host-slash\") pod \"iptables-alerter-dndtw\" (UID: \"5778dd59-96b2-41f8-85cd-c3918ec2a57f\") " pod="openshift-network-operator/iptables-alerter-dndtw"
Jul 20 19:00:38.986449 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-etc-selinux\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:38.986449 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986173    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-sys-fs\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:38.986449 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-modprobe-d\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:38.986449 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-sysconfig\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:38.986449 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986255    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-sysctl-conf\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:38.986449 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986275    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmcc2\" (UniqueName: \"kubernetes.io/projected/26a71b04-6976-4a2d-9d29-679411061462-kube-api-access-jmcc2\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:38.986449 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986290    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0848dc8-f613-4656-aa5e-c122e5b2650a-os-release\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:38.986449 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986310    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0848dc8-f613-4656-aa5e-c122e5b2650a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:38.986820 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-os-release\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.986820 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986345    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f25f41b37a59fc0cc578a7d81793a28f-config\") pod \"kube-apiserver-proxy-ip-10-0-140-250.ec2.internal\" (UID: \"f25f41b37a59fc0cc578a7d81793a28f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-250.ec2.internal"
Jul 20 19:00:38.986820 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986359    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-run\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:38.986820 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzppp\" (UniqueName: \"kubernetes.io/projected/510bef60-8698-405f-a2bd-7200700ecb52-kube-api-access-zzppp\") pod \"node-ca-87ghh\" (UID: \"510bef60-8698-405f-a2bd-7200700ecb52\") " pod="openshift-image-registry/node-ca-87ghh"
Jul 20 19:00:38.986820 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986412    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0848dc8-f613-4656-aa5e-c122e5b2650a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:38.986820 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986439    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-var-lib-kubelet\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.986820 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfxz2\" (UniqueName: \"kubernetes.io/projected/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-kube-api-access-rfxz2\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:38.986820 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986480    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-sysctl-d\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:38.986820 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986500    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26a71b04-6976-4a2d-9d29-679411061462-etc-tuned\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:38.986820 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986519    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs5rl\" (UniqueName: \"kubernetes.io/projected/e0848dc8-f613-4656-aa5e-c122e5b2650a-kube-api-access-bs5rl\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:38.986820 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-system-cni-dir\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.986820 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986567    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-run-multus-certs\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:38.986820 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986582    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5778dd59-96b2-41f8-85cd-c3918ec2a57f-iptables-alerter-script\") pod \"iptables-alerter-dndtw\" (UID: \"5778dd59-96b2-41f8-85cd-c3918ec2a57f\") " pod="openshift-network-operator/iptables-alerter-dndtw"
Jul 20 19:00:38.987221 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:38.986602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:39.029428 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.029405    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:39.052532 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.052513    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-slv78"]
Jul 20 19:00:39.052658 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.052647    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.053398 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.053384    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.053462 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.053411    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.053462 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.053427    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.053698 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.053683    2560 predicate.go:218] "Predicate failed on Pod" pod="kube-system/global-pull-secret-syncer-slv78" err="Predicate NodeAffinity failed: node(s) didn't match Pod's node affinity/selector"
Jul 20 19:00:39.053732 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.053701    2560 allocation_manager.go:702] "Pod admission denied" podUID="5e688748-9c0c-4e8b-9bae-93c81177f8a8" pod="kube-system/global-pull-secret-syncer-slv78" reason="NodeAffinity" message="Predicate NodeAffinity failed: node(s) didn't match Pod's node affinity/selector"
Jul 20 19:00:39.055805 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.055787    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-xrmsp"]
Jul 20 19:00:39.055967 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.055954    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.056714 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.056696    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.056776 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.056726    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.056776 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.056742    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.059266 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.059252    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xrmsp"
Jul 20 19:00:39.059340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.059280    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.060017 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.060002    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.060061 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.060027    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.060061 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.060040    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.062870 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.062830    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zq2z5\""
Jul 20 19:00:39.065017 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.062963    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 19:00:39.065017 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.063096    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 19:00:39.087451 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0848dc8-f613-4656-aa5e-c122e5b2650a-cni-binary-copy\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:39.087552 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087459    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5778dd59-96b2-41f8-85cd-c3918ec2a57f-host-slash\") pod \"iptables-alerter-dndtw\" (UID: \"5778dd59-96b2-41f8-85cd-c3918ec2a57f\") " pod="openshift-network-operator/iptables-alerter-dndtw"
Jul 20 19:00:39.087552 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087484    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-etc-selinux\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:39.087552 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-sys-fs\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:39.087692 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087551    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5778dd59-96b2-41f8-85cd-c3918ec2a57f-host-slash\") pod \"iptables-alerter-dndtw\" (UID: \"5778dd59-96b2-41f8-85cd-c3918ec2a57f\") " pod="openshift-network-operator/iptables-alerter-dndtw"
Jul 20 19:00:39.087692 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-etc-selinux\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:39.087692 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087572    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-sys-fs\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:39.087692 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087619    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f25f41b37a59fc0cc578a7d81793a28f-config\") pod \"kube-apiserver-proxy-ip-10-0-140-250.ec2.internal\" (UID: \"f25f41b37a59fc0cc578a7d81793a28f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-250.ec2.internal"
Jul 20 19:00:39.087692 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087647    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctvrv\" (UniqueName: \"kubernetes.io/projected/7a05c4ac-04f4-4ff5-adc2-411cffcb815c-kube-api-access-ctvrv\") pod \"node-resolver-vt7z5\" (UID: \"7a05c4ac-04f4-4ff5-adc2-411cffcb815c\") " pod="openshift-dns/node-resolver-vt7z5"
Jul 20 19:00:39.087692 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087685    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-run-openvswitch\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.087692 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087691    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f25f41b37a59fc0cc578a7d81793a28f-config\") pod \"kube-apiserver-proxy-ip-10-0-140-250.ec2.internal\" (UID: \"f25f41b37a59fc0cc578a7d81793a28f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-250.ec2.internal"
Jul 20 19:00:39.088049 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087704    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-ovnkube-script-lib\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.088049 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-modprobe-d\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.088049 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087740    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmcc2\" (UniqueName: \"kubernetes.io/projected/26a71b04-6976-4a2d-9d29-679411061462-kube-api-access-jmcc2\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.088049 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087776    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0848dc8-f613-4656-aa5e-c122e5b2650a-os-release\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:39.088049 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087803    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.088049 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-os-release\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.088049 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087828    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-run\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.088049 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087852    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzppp\" (UniqueName: \"kubernetes.io/projected/510bef60-8698-405f-a2bd-7200700ecb52-kube-api-access-zzppp\") pod \"node-ca-87ghh\" (UID: \"510bef60-8698-405f-a2bd-7200700ecb52\") " pod="openshift-image-registry/node-ca-87ghh"
Jul 20 19:00:39.088049 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087858    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-modprobe-d\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.088049 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0848dc8-f613-4656-aa5e-c122e5b2650a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:39.088049 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087887    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0848dc8-f613-4656-aa5e-c122e5b2650a-os-release\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:39.088049 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087941    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.088049 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087958    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-os-release\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.088049 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.087988    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-run-systemd\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.088049 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0848dc8-f613-4656-aa5e-c122e5b2650a-cni-binary-copy\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:39.088049 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088019    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26a71b04-6976-4a2d-9d29-679411061462-etc-tuned\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.088810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088039    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0848dc8-f613-4656-aa5e-c122e5b2650a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:39.088810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-system-cni-dir\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.088810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088067    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-run\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.088810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088097    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.088810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088177    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-system-cni-dir\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.088810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088189    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-run-multus-certs\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.088810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-ovn-node-metrics-cert\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.088810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088254    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-device-dir\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:39.088810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088273    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b834d003-a3cf-401e-a040-3800e5a5a153-multus-daemon-config\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.088810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088284    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-run-multus-certs\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.088810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088296    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a05c4ac-04f4-4ff5-adc2-411cffcb815c-hosts-file\") pod \"node-resolver-vt7z5\" (UID: \"7a05c4ac-04f4-4ff5-adc2-411cffcb815c\") " pod="openshift-dns/node-resolver-vt7z5"
Jul 20 19:00:39.088810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088314    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-device-dir\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:39.088810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088321    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-etc-openvswitch\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.088810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088374    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0848dc8-f613-4656-aa5e-c122e5b2650a-cnibin\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:39.088810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088400    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-cnibin\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.089519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088440    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0848dc8-f613-4656-aa5e-c122e5b2650a-cnibin\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:39.089519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088456    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-registration-dir\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:39.089519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088501    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mttgk\" (UniqueName: \"kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk\") pod \"network-check-target-ksnwk\" (UID: \"9ee86025-4e97-450b-84cf-9930112292e6\") " pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:39.089519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088510    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-registration-dir\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:39.089519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088528    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ab7c893c06d445ef68c950db0992258-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal\" (UID: \"4ab7c893c06d445ef68c950db0992258\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal"
Jul 20 19:00:39.089519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088549    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-cnibin\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.089519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088560    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26a71b04-6976-4a2d-9d29-679411061462-tmp\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.089519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088576    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/510bef60-8698-405f-a2bd-7200700ecb52-serviceca\") pod \"node-ca-87ghh\" (UID: \"510bef60-8698-405f-a2bd-7200700ecb52\") " pod="openshift-image-registry/node-ca-87ghh"
Jul 20 19:00:39.089519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088579    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.089519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088594    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wc69\" (UniqueName: \"kubernetes.io/projected/b834d003-a3cf-401e-a040-3800e5a5a153-kube-api-access-2wc69\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.089519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088609    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.089519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088621    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-slash\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.089519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088647    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-kubernetes\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.089519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088658    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.089519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088671    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-systemd\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.089519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-etc-kubernetes\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.090370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088721    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-node-log\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.090370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088736    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-kubernetes\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.090370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088746    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-222b7\" (UniqueName: \"kubernetes.io/projected/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-kube-api-access-222b7\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.090370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088776    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-lib-modules\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.090370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088781    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.090370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088799    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.090370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/510bef60-8698-405f-a2bd-7200700ecb52-host\") pod \"node-ca-87ghh\" (UID: \"510bef60-8698-405f-a2bd-7200700ecb52\") " pod="openshift-image-registry/node-ca-87ghh"
Jul 20 19:00:39.090370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b834d003-a3cf-401e-a040-3800e5a5a153-multus-daemon-config\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.090370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0848dc8-f613-4656-aa5e-c122e5b2650a-system-cni-dir\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:39.090370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088894    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-systemd\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.090370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-run-netns\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.090370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088933    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-run-netns\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.090370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088940    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-etc-kubernetes\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.090370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-sysconfig\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.090370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-sysctl-conf\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089015    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0848dc8-f613-4656-aa5e-c122e5b2650a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089043    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0848dc8-f613-4656-aa5e-c122e5b2650a-system-cni-dir\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088853    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ab7c893c06d445ef68c950db0992258-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal\" (UID: \"4ab7c893c06d445ef68c950db0992258\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088650    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089080    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089115    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-run-netns\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-lib-modules\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088988    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089201    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089220    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089044    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-var-lib-openvswitch\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.088851    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/510bef60-8698-405f-a2bd-7200700ecb52-host\") pod \"node-ca-87ghh\" (UID: \"510bef60-8698-405f-a2bd-7200700ecb52\") " pod="openshift-image-registry/node-ca-87ghh"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089269    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/510bef60-8698-405f-a2bd-7200700ecb52-serviceca\") pod \"node-ca-87ghh\" (UID: \"510bef60-8698-405f-a2bd-7200700ecb52\") " pod="openshift-image-registry/node-ca-87ghh"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089312    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-cni-bin\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089339    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089350    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-sysconfig\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089359    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-var-lib-kubelet\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089365    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.091153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089416    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.092161 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089430    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.092161 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089449    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfxz2\" (UniqueName: \"kubernetes.io/projected/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-kube-api-access-rfxz2\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:39.092161 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-log-socket\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.092161 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089509    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-sysctl-d\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.092161 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089486    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.092161 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-var-lib-kubelet\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.092161 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089586    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs5rl\" (UniqueName: \"kubernetes.io/projected/e0848dc8-f613-4656-aa5e-c122e5b2650a-kube-api-access-bs5rl\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:39.092161 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089600    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-sysctl-conf\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.092161 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089612    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5778dd59-96b2-41f8-85cd-c3918ec2a57f-iptables-alerter-script\") pod \"iptables-alerter-dndtw\" (UID: \"5778dd59-96b2-41f8-85cd-c3918ec2a57f\") " pod="openshift-network-operator/iptables-alerter-dndtw"
Jul 20 19:00:39.092161 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089670    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:39.092161 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089677    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-etc-sysctl-d\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.092161 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089733    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.092161 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089730    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-run-ovn-kubernetes\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.092161 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.092161 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089776    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 19:00:39.092161 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089789    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0848dc8-f613-4656-aa5e-c122e5b2650a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:39.092710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089813    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-env-overrides\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.092710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089827    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.092710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-host\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.092710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0848dc8-f613-4656-aa5e-c122e5b2650a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:39.092710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089912    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-multus-cni-dir\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.092710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089940    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-var-lib-cni-bin\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.092710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089964    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-hostroot\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.092710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090004    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpk4m\" (UniqueName: \"kubernetes.io/projected/5778dd59-96b2-41f8-85cd-c3918ec2a57f-kube-api-access-kpk4m\") pod \"iptables-alerter-dndtw\" (UID: \"5778dd59-96b2-41f8-85cd-c3918ec2a57f\") " pod="openshift-network-operator/iptables-alerter-dndtw"
Jul 20 19:00:39.092710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090014    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-var-lib-cni-bin\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.092710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-socket-dir\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:39.092710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs\") pod \"network-metrics-daemon-2rwr8\" (UID: \"1a2c26c6-d757-4ddc-af69-e9fa0515a076\") " pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:39.092710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090074    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-multus-cni-dir\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.092710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090084    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-hostroot\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.092710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090151    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5778dd59-96b2-41f8-85cd-c3918ec2a57f-iptables-alerter-script\") pod \"iptables-alerter-dndtw\" (UID: \"5778dd59-96b2-41f8-85cd-c3918ec2a57f\") " pod="openshift-network-operator/iptables-alerter-dndtw"
Jul 20 19:00:39.092710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090226    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-socket-dir\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:39.092710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090294    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.093249 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090299    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-sys\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.093249 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090293    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-host\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.093249 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090348    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-var-lib-kubelet\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.093249 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-sys\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.093249 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-multus-socket-dir-parent\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.093249 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090456    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26a71b04-6976-4a2d-9d29-679411061462-var-lib-kubelet\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.093249 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.089777    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:39.093249 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090486    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-var-lib-cni-multus\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.093249 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-multus-conf-dir\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.093249 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090535    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-multus-socket-dir-parent\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.093249 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090547    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fsz6\" (UniqueName: \"kubernetes.io/projected/1a2c26c6-d757-4ddc-af69-e9fa0515a076-kube-api-access-7fsz6\") pod \"network-metrics-daemon-2rwr8\" (UID: \"1a2c26c6-d757-4ddc-af69-e9fa0515a076\") " pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:39.093249 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090558    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0848dc8-f613-4656-aa5e-c122e5b2650a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:39.093249 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090596    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-cni-netd\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.093249 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090610    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-var-lib-cni-multus\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.093249 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090617    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.093249 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090603    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090641    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090646    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-multus-conf-dir\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090656    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090641    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-ovnkube-config\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090657    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090671    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090689    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ab7c893c06d445ef68c950db0992258-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal\" (UID: \"4ab7c893c06d445ef68c950db0992258\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090721    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b834d003-a3cf-401e-a040-3800e5a5a153-cni-binary-copy\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090659    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090810    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090825    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.090887    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ab7c893c06d445ef68c950db0992258-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal\" (UID: \"4ab7c893c06d445ef68c950db0992258\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.091009    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.091034    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.091067    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.091123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a05c4ac-04f4-4ff5-adc2-411cffcb815c-tmp-dir\") pod \"node-resolver-vt7z5\" (UID: \"7a05c4ac-04f4-4ff5-adc2-411cffcb815c\") " pod="openshift-dns/node-resolver-vt7z5"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.091196    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.091207    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-run-k8s-cni-cncf-io\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.091222    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.091236    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.093717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.091427    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b834d003-a3cf-401e-a040-3800e5a5a153-host-run-k8s-cni-cncf-io\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.094362 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.091466    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b834d003-a3cf-401e-a040-3800e5a5a153-cni-binary-copy\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.094362 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.091479    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-kubelet\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.094362 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.091517    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-systemd-units\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.094362 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.091572    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-run-ovn\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.094362 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.093227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26a71b04-6976-4a2d-9d29-679411061462-etc-tuned\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.094362 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.093308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26a71b04-6976-4a2d-9d29-679411061462-tmp\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.096145 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.096116    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:39.096264 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.096156    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:39.096264 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.096169    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mttgk for pod openshift-network-diagnostics/network-check-target-ksnwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:39.096264 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.096236    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk podName:9ee86025-4e97-450b-84cf-9930112292e6 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:39.596215246 +0000 UTC m=+2.392222591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mttgk" (UniqueName: "kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk") pod "network-check-target-ksnwk" (UID: "9ee86025-4e97-450b-84cf-9930112292e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:39.097471 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.097450    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzppp\" (UniqueName: \"kubernetes.io/projected/510bef60-8698-405f-a2bd-7200700ecb52-kube-api-access-zzppp\") pod \"node-ca-87ghh\" (UID: \"510bef60-8698-405f-a2bd-7200700ecb52\") " pod="openshift-image-registry/node-ca-87ghh"
Jul 20 19:00:39.098346 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.098329    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmcc2\" (UniqueName: \"kubernetes.io/projected/26a71b04-6976-4a2d-9d29-679411061462-kube-api-access-jmcc2\") pod \"tuned-c82bl\" (UID: \"26a71b04-6976-4a2d-9d29-679411061462\") " pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.099342 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.099309    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wc69\" (UniqueName: \"kubernetes.io/projected/b834d003-a3cf-401e-a040-3800e5a5a153-kube-api-access-2wc69\") pod \"multus-n47zz\" (UID: \"b834d003-a3cf-401e-a040-3800e5a5a153\") " pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.100596 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.100576    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs5rl\" (UniqueName: \"kubernetes.io/projected/e0848dc8-f613-4656-aa5e-c122e5b2650a-kube-api-access-bs5rl\") pod \"multus-additional-cni-plugins-g85p9\" (UID: \"e0848dc8-f613-4656-aa5e-c122e5b2650a\") " pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:39.100975 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.100958    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpk4m\" (UniqueName: \"kubernetes.io/projected/5778dd59-96b2-41f8-85cd-c3918ec2a57f-kube-api-access-kpk4m\") pod \"iptables-alerter-dndtw\" (UID: \"5778dd59-96b2-41f8-85cd-c3918ec2a57f\") " pod="openshift-network-operator/iptables-alerter-dndtw"
Jul 20 19:00:39.101211 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.101176    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfxz2\" (UniqueName: \"kubernetes.io/projected/e99c9580-7e37-4a4f-91f3-7c7ac9874f28-kube-api-access-rfxz2\") pod \"aws-ebs-csi-driver-node-bbzvj\" (UID: \"e99c9580-7e37-4a4f-91f3-7c7ac9874f28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:39.119976 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.119930    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-slv78" podStartSLOduration=0.119918662 podStartE2EDuration="119.918662ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:00:39.119534035 +0000 UTC m=+1.915541371" watchObservedRunningTime="2026-07-20 19:00:39.119918662 +0000 UTC m=+1.915925999"
Jul 20 19:00:39.130210 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.130183    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:39.161295 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.161273    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-250.ec2.internal"
Jul 20 19:00:39.175820 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.175803    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal"
Jul 20 19:00:39.187911 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.187887    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-87ghh"
Jul 20 19:00:39.192888 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.192865    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-slash\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.192992 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.192902    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-node-log\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.192992 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.192928    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-222b7\" (UniqueName: \"kubernetes.io/projected/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-kube-api-access-222b7\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.192992 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.192955    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-run-netns\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.192992 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.192985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-var-lib-openvswitch\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.193233 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193006    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-cni-bin\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.193233 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193029    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-log-socket\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.193233 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193064    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-run-ovn-kubernetes\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.193233 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193086    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.193233 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-env-overrides\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.193233 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193139    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs\") pod \"network-metrics-daemon-2rwr8\" (UID: \"1a2c26c6-d757-4ddc-af69-e9fa0515a076\") " pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:39.193233 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fsz6\" (UniqueName: \"kubernetes.io/projected/1a2c26c6-d757-4ddc-af69-e9fa0515a076-kube-api-access-7fsz6\") pod \"network-metrics-daemon-2rwr8\" (UID: \"1a2c26c6-d757-4ddc-af69-e9fa0515a076\") " pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:39.193233 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-cni-netd\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.193233 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-ovnkube-config\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.193646 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a05c4ac-04f4-4ff5-adc2-411cffcb815c-tmp-dir\") pod \"node-resolver-vt7z5\" (UID: \"7a05c4ac-04f4-4ff5-adc2-411cffcb815c\") " pod="openshift-dns/node-resolver-vt7z5"
Jul 20 19:00:39.193646 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193298    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e688748-9c0c-4e8b-9bae-93c81177f8a8-kubelet-config\") pod \"global-pull-secret-syncer-slv78\" (UID: \"5e688748-9c0c-4e8b-9bae-93c81177f8a8\") " pod="kube-system/global-pull-secret-syncer-slv78"
Jul 20 19:00:39.193646 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193328    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6cd4b6e1-8b4f-4960-b455-af290cb08b9b-konnectivity-ca\") pod \"konnectivity-agent-xrmsp\" (UID: \"6cd4b6e1-8b4f-4960-b455-af290cb08b9b\") " pod="kube-system/konnectivity-agent-xrmsp"
Jul 20 19:00:39.193646 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193361    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-kubelet\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.193646 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193385    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-systemd-units\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.193646 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193408    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-run-ovn\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.193646 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctvrv\" (UniqueName: \"kubernetes.io/projected/7a05c4ac-04f4-4ff5-adc2-411cffcb815c-kube-api-access-ctvrv\") pod \"node-resolver-vt7z5\" (UID: \"7a05c4ac-04f4-4ff5-adc2-411cffcb815c\") " pod="openshift-dns/node-resolver-vt7z5"
Jul 20 19:00:39.193646 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193489    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-cni-netd\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.193646 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-run-openvswitch\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.193646 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193511    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.193646 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193525    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-ovnkube-script-lib\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.193646 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193535    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-run-ovn\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.193646 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e688748-9c0c-4e8b-9bae-93c81177f8a8-original-pull-secret\") pod \"global-pull-secret-syncer-slv78\" (UID: \"5e688748-9c0c-4e8b-9bae-93c81177f8a8\") " pod="kube-system/global-pull-secret-syncer-slv78"
Jul 20 19:00:39.194314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193694    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-kubelet\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.194314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193742    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-systemd-units\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.194314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193769    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-run-systemd\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.194314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-ovn-node-metrics-cert\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.194314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193842    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a05c4ac-04f4-4ff5-adc2-411cffcb815c-tmp-dir\") pod \"node-resolver-vt7z5\" (UID: \"7a05c4ac-04f4-4ff5-adc2-411cffcb815c\") " pod="openshift-dns/node-resolver-vt7z5"
Jul 20 19:00:39.194314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193883    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-run-systemd\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.194314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193930    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a05c4ac-04f4-4ff5-adc2-411cffcb815c-hosts-file\") pod \"node-resolver-vt7z5\" (UID: \"7a05c4ac-04f4-4ff5-adc2-411cffcb815c\") " pod="openshift-dns/node-resolver-vt7z5"
Jul 20 19:00:39.194314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.193959    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.194314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194029    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.194314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194105    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g85p9"
Jul 20 19:00:39.194314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-etc-openvswitch\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.194314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194138    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-ovnkube-script-lib\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.194314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194175    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a05c4ac-04f4-4ff5-adc2-411cffcb815c-hosts-file\") pod \"node-resolver-vt7z5\" (UID: \"7a05c4ac-04f4-4ff5-adc2-411cffcb815c\") " pod="openshift-dns/node-resolver-vt7z5"
Jul 20 19:00:39.194314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194235    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-log-socket\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.194314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194243    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.194314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194156    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-run-openvswitch\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.194314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194264    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.195075 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-run-netns\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.195075 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194302    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e688748-9c0c-4e8b-9bae-93c81177f8a8-dbus\") pod \"global-pull-secret-syncer-slv78\" (UID: \"5e688748-9c0c-4e8b-9bae-93c81177f8a8\") " pod="kube-system/global-pull-secret-syncer-slv78"
Jul 20 19:00:39.195075 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194320    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-slash\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.195075 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194336    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6cd4b6e1-8b4f-4960-b455-af290cb08b9b-agent-certs\") pod \"konnectivity-agent-xrmsp\" (UID: \"6cd4b6e1-8b4f-4960-b455-af290cb08b9b\") " pod="kube-system/konnectivity-agent-xrmsp"
Jul 20 19:00:39.195075 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194328    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-cni-bin\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.195075 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194350    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-ovnkube-config\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.195075 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194375    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-node-log\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.195075 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-var-lib-openvswitch\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.195075 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194412    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-host-run-ovn-kubernetes\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.195075 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194433    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.195075 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194448    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-etc-openvswitch\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.195075 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.194718    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-env-overrides\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.195075 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.195071    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.195075 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.195080    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.195686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.195095    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.195686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.195102    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.195686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.195159    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.195686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.195170    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.195686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.195176    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.195686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.195191    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.195686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.195125    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.195686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.195252    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.195686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.195124    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.195686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.195312    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.195686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.195326    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.195686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.195102    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.195686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.195400    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.195686 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.195507    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:39.195686 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.195560    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs podName:1a2c26c6-d757-4ddc-af69-e9fa0515a076 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:39.695545995 +0000 UTC m=+2.491553330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs") pod "network-metrics-daemon-2rwr8" (UID: "1a2c26c6-d757-4ddc-af69-e9fa0515a076") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:39.197574 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.197555    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-ovn-node-metrics-cert\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.200616 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.200599    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c82bl"
Jul 20 19:00:39.205583 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.205560    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fsz6\" (UniqueName: \"kubernetes.io/projected/1a2c26c6-d757-4ddc-af69-e9fa0515a076-kube-api-access-7fsz6\") pod \"network-metrics-daemon-2rwr8\" (UID: \"1a2c26c6-d757-4ddc-af69-e9fa0515a076\") " pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:39.206248 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.206229    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-222b7\" (UniqueName: \"kubernetes.io/projected/4a7f0781-9683-42bb-bdb2-f6bf03f313e3-kube-api-access-222b7\") pod \"ovnkube-node-7jhvx\" (UID: \"4a7f0781-9683-42bb-bdb2-f6bf03f313e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.206560 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.206543    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctvrv\" (UniqueName: \"kubernetes.io/projected/7a05c4ac-04f4-4ff5-adc2-411cffcb815c-kube-api-access-ctvrv\") pod \"node-resolver-vt7z5\" (UID: \"7a05c4ac-04f4-4ff5-adc2-411cffcb815c\") " pod="openshift-dns/node-resolver-vt7z5"
Jul 20 19:00:39.214487 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.214470    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n47zz"
Jul 20 19:00:39.228129 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.228094    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dndtw"
Jul 20 19:00:39.230268 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.230246    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:39.232831 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.232815    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj"
Jul 20 19:00:39.271877 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.271856    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vt7z5"
Jul 20 19:00:39.281843 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.281827    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:00:39.294849 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.294825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e688748-9c0c-4e8b-9bae-93c81177f8a8-kubelet-config\") pod \"global-pull-secret-syncer-slv78\" (UID: \"5e688748-9c0c-4e8b-9bae-93c81177f8a8\") " pod="kube-system/global-pull-secret-syncer-slv78"
Jul 20 19:00:39.294935 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.294855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6cd4b6e1-8b4f-4960-b455-af290cb08b9b-konnectivity-ca\") pod \"konnectivity-agent-xrmsp\" (UID: \"6cd4b6e1-8b4f-4960-b455-af290cb08b9b\") " pod="kube-system/konnectivity-agent-xrmsp"
Jul 20 19:00:39.294935 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.294876    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e688748-9c0c-4e8b-9bae-93c81177f8a8-original-pull-secret\") pod \"global-pull-secret-syncer-slv78\" (UID: \"5e688748-9c0c-4e8b-9bae-93c81177f8a8\") " pod="kube-system/global-pull-secret-syncer-slv78"
Jul 20 19:00:39.294935 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.294896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e688748-9c0c-4e8b-9bae-93c81177f8a8-dbus\") pod \"global-pull-secret-syncer-slv78\" (UID: \"5e688748-9c0c-4e8b-9bae-93c81177f8a8\") " pod="kube-system/global-pull-secret-syncer-slv78"
Jul 20 19:00:39.294935 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.294911    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6cd4b6e1-8b4f-4960-b455-af290cb08b9b-agent-certs\") pod \"konnectivity-agent-xrmsp\" (UID: \"6cd4b6e1-8b4f-4960-b455-af290cb08b9b\") " pod="kube-system/konnectivity-agent-xrmsp"
Jul 20 19:00:39.295118 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.294952    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e688748-9c0c-4e8b-9bae-93c81177f8a8-kubelet-config\") pod \"global-pull-secret-syncer-slv78\" (UID: \"5e688748-9c0c-4e8b-9bae-93c81177f8a8\") " pod="kube-system/global-pull-secret-syncer-slv78"
Jul 20 19:00:39.295118 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.294971    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.295118 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.294994    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.295241 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.295147    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e688748-9c0c-4e8b-9bae-93c81177f8a8-dbus\") pod \"global-pull-secret-syncer-slv78\" (UID: \"5e688748-9c0c-4e8b-9bae-93c81177f8a8\") " pod="kube-system/global-pull-secret-syncer-slv78"
Jul 20 19:00:39.295400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.295383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6cd4b6e1-8b4f-4960-b455-af290cb08b9b-konnectivity-ca\") pod \"konnectivity-agent-xrmsp\" (UID: \"6cd4b6e1-8b4f-4960-b455-af290cb08b9b\") " pod="kube-system/konnectivity-agent-xrmsp"
Jul 20 19:00:39.295767 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.295750    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.295819 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.295783    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.295819 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.295793    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.295890 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.295751    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.295890 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.295861    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.295890 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.295872    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.296002 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.295961    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:39.296042 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.296007    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e688748-9c0c-4e8b-9bae-93c81177f8a8-original-pull-secret podName:5e688748-9c0c-4e8b-9bae-93c81177f8a8 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:39.795987913 +0000 UTC m=+2.591995229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e688748-9c0c-4e8b-9bae-93c81177f8a8-original-pull-secret") pod "global-pull-secret-syncer-slv78" (UID: "5e688748-9c0c-4e8b-9bae-93c81177f8a8") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:39.297875 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.297858    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6cd4b6e1-8b4f-4960-b455-af290cb08b9b-agent-certs\") pod \"konnectivity-agent-xrmsp\" (UID: \"6cd4b6e1-8b4f-4960-b455-af290cb08b9b\") " pod="kube-system/konnectivity-agent-xrmsp"
Jul 20 19:00:39.330360 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.330339    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:39.371267 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.371219    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xrmsp"
Jul 20 19:00:39.430454 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.430427    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:39.530894 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.530864    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:39.597545 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.597523    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mttgk\" (UniqueName: \"kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk\") pod \"network-check-target-ksnwk\" (UID: \"9ee86025-4e97-450b-84cf-9930112292e6\") " pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:39.597974 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.597623    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.598508 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.598486    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.598580 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.598524    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.598580 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.598538    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.598645 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.598626    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:39.598645 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.598638    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:39.598710 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.598647    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mttgk for pod openshift-network-diagnostics/network-check-target-ksnwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:39.598710 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.598702    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk podName:9ee86025-4e97-450b-84cf-9930112292e6 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:40.598689056 +0000 UTC m=+3.394696369 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mttgk" (UniqueName: "kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk") pod "network-check-target-ksnwk" (UID: "9ee86025-4e97-450b-84cf-9930112292e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:39.631295 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.631237    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:39.698549 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.698528    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs\") pod \"network-metrics-daemon-2rwr8\" (UID: \"1a2c26c6-d757-4ddc-af69-e9fa0515a076\") " pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:39.698659 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.698646    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.700253 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.700234    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.700338 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.700267    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.700338 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.700281    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.700423 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.700387    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:39.700474 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.700456    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs podName:1a2c26c6-d757-4ddc-af69-e9fa0515a076 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:40.700430886 +0000 UTC m=+3.496438203 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs") pod "network-metrics-daemon-2rwr8" (UID: "1a2c26c6-d757-4ddc-af69-e9fa0515a076") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:39.732279 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.732253    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:39.773956 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.773933    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:39.799432 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.799409    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e688748-9c0c-4e8b-9bae-93c81177f8a8-original-pull-secret\") pod \"global-pull-secret-syncer-slv78\" (UID: \"5e688748-9c0c-4e8b-9bae-93c81177f8a8\") " pod="kube-system/global-pull-secret-syncer-slv78"
Jul 20 19:00:39.799537 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.799504    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:39.802588 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.802563    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:39.802698 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.802604    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:39.802698 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.802616    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:39.802802 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.802722    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:39.802802 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.802774    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e688748-9c0c-4e8b-9bae-93c81177f8a8-original-pull-secret podName:5e688748-9c0c-4e8b-9bae-93c81177f8a8 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:40.802754008 +0000 UTC m=+3.598761321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e688748-9c0c-4e8b-9bae-93c81177f8a8-original-pull-secret") pod "global-pull-secret-syncer-slv78" (UID: "5e688748-9c0c-4e8b-9bae-93c81177f8a8") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:39.833302 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.833278    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:39.858543 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:39.858511    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf25f41b37a59fc0cc578a7d81793a28f.slice/crio-0c54aa49e87d78e62b0141b24ccfd4f95032fb8d179915eb88cf621528c34e0a WatchSource:0}: Error finding container 0c54aa49e87d78e62b0141b24ccfd4f95032fb8d179915eb88cf621528c34e0a: Status 404 returned error can't find the container with id 0c54aa49e87d78e62b0141b24ccfd4f95032fb8d179915eb88cf621528c34e0a
Jul 20 19:00:39.864801 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:39.864783    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:00:39.886061 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:39.886037    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a05c4ac_04f4_4ff5_adc2_411cffcb815c.slice/crio-5849db9f956fd7e81c7e9647098f590e8f227a9f99a4e4609254c0b39e852de0 WatchSource:0}: Error finding container 5849db9f956fd7e81c7e9647098f590e8f227a9f99a4e4609254c0b39e852de0: Status 404 returned error can't find the container with id 5849db9f956fd7e81c7e9647098f590e8f227a9f99a4e4609254c0b39e852de0
Jul 20 19:00:39.910527 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:39.910505    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod510bef60_8698_405f_a2bd_7200700ecb52.slice/crio-9cd556383bcb758309066a346229e7e681873007a655c8d8665bef5bb86c30b4 WatchSource:0}: Error finding container 9cd556383bcb758309066a346229e7e681873007a655c8d8665bef5bb86c30b4: Status 404 returned error can't find the container with id 9cd556383bcb758309066a346229e7e681873007a655c8d8665bef5bb86c30b4
Jul 20 19:00:39.934303 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:39.934282    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:39.935960 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:39.935943    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0848dc8_f613_4656_aa5e_c122e5b2650a.slice/crio-e1e47b01fb021458452b5a3c5115e401dcc584d4f61d3b9536c1935a75baac28 WatchSource:0}: Error finding container e1e47b01fb021458452b5a3c5115e401dcc584d4f61d3b9536c1935a75baac28: Status 404 returned error can't find the container with id e1e47b01fb021458452b5a3c5115e401dcc584d4f61d3b9536c1935a75baac28
Jul 20 19:00:39.961444 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:39.961419    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb834d003_a3cf_401e_a040_3800e5a5a153.slice/crio-d40b34b60541a74c4906901de156e4a603a7880c714068c6e70ac0eb9e65f658 WatchSource:0}: Error finding container d40b34b60541a74c4906901de156e4a603a7880c714068c6e70ac0eb9e65f658: Status 404 returned error can't find the container with id d40b34b60541a74c4906901de156e4a603a7880c714068c6e70ac0eb9e65f658
Jul 20 19:00:39.989377 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:39.989358    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode99c9580_7e37_4a4f_91f3_7c7ac9874f28.slice/crio-709cb03162f4db2645e16fada282947a22f675e1135707ddc3e7a3eba822a7e8 WatchSource:0}: Error finding container 709cb03162f4db2645e16fada282947a22f675e1135707ddc3e7a3eba822a7e8: Status 404 returned error can't find the container with id 709cb03162f4db2645e16fada282947a22f675e1135707ddc3e7a3eba822a7e8
Jul 20 19:00:40.010639 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:40.010623    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5778dd59_96b2_41f8_85cd_c3918ec2a57f.slice/crio-843b99ef94a8d968a2cb29a4db266f0ae72f12a885d3cfb2d3b9f89ab4168c03 WatchSource:0}: Error finding container 843b99ef94a8d968a2cb29a4db266f0ae72f12a885d3cfb2d3b9f89ab4168c03: Status 404 returned error can't find the container with id 843b99ef94a8d968a2cb29a4db266f0ae72f12a885d3cfb2d3b9f89ab4168c03
Jul 20 19:00:40.034543 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.034520    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:40.056083 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:40.056064    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab7c893c06d445ef68c950db0992258.slice/crio-ff3625a07e658485762b98e643e69c1e1a83b19e9fb05a510a7c11c95bdf99bd WatchSource:0}: Error finding container ff3625a07e658485762b98e643e69c1e1a83b19e9fb05a510a7c11c95bdf99bd: Status 404 returned error can't find the container with id ff3625a07e658485762b98e643e69c1e1a83b19e9fb05a510a7c11c95bdf99bd
Jul 20 19:00:40.135189 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.135136    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:40.236259 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.236237    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:40.241837 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:40.241816    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26a71b04_6976_4a2d_9d29_679411061462.slice/crio-26a7ff2d31d1018ccfdf663c79484733c75abf5b53b3c7a69fbefb71eff68cea WatchSource:0}: Error finding container 26a7ff2d31d1018ccfdf663c79484733c75abf5b53b3c7a69fbefb71eff68cea: Status 404 returned error can't find the container with id 26a7ff2d31d1018ccfdf663c79484733c75abf5b53b3c7a69fbefb71eff68cea
Jul 20 19:00:40.331382 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:00:40.331350    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd4b6e1_8b4f_4960_b455_af290cb08b9b.slice/crio-6e1b3fe22a20f02f56cca932d0db0affe5069a3d1b4139a97c200815e5de3825 WatchSource:0}: Error finding container 6e1b3fe22a20f02f56cca932d0db0affe5069a3d1b4139a97c200815e5de3825: Status 404 returned error can't find the container with id 6e1b3fe22a20f02f56cca932d0db0affe5069a3d1b4139a97c200815e5de3825
Jul 20 19:00:40.336529 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.336511    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:40.437211 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.437153    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:40.538176 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.538151    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:40.606774 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.606748    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mttgk\" (UniqueName: \"kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk\") pod \"network-check-target-ksnwk\" (UID: \"9ee86025-4e97-450b-84cf-9930112292e6\") " pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:40.607259 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.606863    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:40.608479 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.608464    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:40.608557 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.608498    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:40.608557 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.608513    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:40.608673 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.608662    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:40.608710 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.608679    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:40.608710 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.608689    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mttgk for pod openshift-network-diagnostics/network-check-target-ksnwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:40.608779 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.608732    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk podName:9ee86025-4e97-450b-84cf-9930112292e6 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:42.60871715 +0000 UTC m=+5.404724462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mttgk" (UniqueName: "kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk") pod "network-check-target-ksnwk" (UID: "9ee86025-4e97-450b-84cf-9930112292e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:40.638229 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.638202    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:40.707606 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.707580    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs\") pod \"network-metrics-daemon-2rwr8\" (UID: \"1a2c26c6-d757-4ddc-af69-e9fa0515a076\") " pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:40.707706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.707678    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:40.708767 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.708748    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:40.708885 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.708781    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:40.708885 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.708793    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:40.708998 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.708921    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:40.708998 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.708969    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs podName:1a2c26c6-d757-4ddc-af69-e9fa0515a076 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:42.708953743 +0000 UTC m=+5.504961061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs") pod "network-metrics-daemon-2rwr8" (UID: "1a2c26c6-d757-4ddc-af69-e9fa0515a076") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:40.734270 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.734247    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:40.734394 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.734288    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:40.734394 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.734289    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:40.734493 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.734399    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:40.735341 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.735321    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:40.735456 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.735358    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:40.735456 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.735372    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:40.735456 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.735321    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:40.735456 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.735416    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:40.735456 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.735435    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:40.735707 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.735583    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:00:40.735707 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.735693    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:00:40.738292 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.738269    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:40.738704 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.738646    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vt7z5" event={"ID":"7a05c4ac-04f4-4ff5-adc2-411cffcb815c","Type":"ContainerStarted","Data":"5849db9f956fd7e81c7e9647098f590e8f227a9f99a4e4609254c0b39e852de0"}
Jul 20 19:00:40.740294 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.740259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-250.ec2.internal" event={"ID":"f25f41b37a59fc0cc578a7d81793a28f","Type":"ContainerStarted","Data":"0c54aa49e87d78e62b0141b24ccfd4f95032fb8d179915eb88cf621528c34e0a"}
Jul 20 19:00:40.741790 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.741729    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal" event={"ID":"4ab7c893c06d445ef68c950db0992258","Type":"ContainerStarted","Data":"ff3625a07e658485762b98e643e69c1e1a83b19e9fb05a510a7c11c95bdf99bd"}
Jul 20 19:00:40.743176 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.743150    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dndtw" event={"ID":"5778dd59-96b2-41f8-85cd-c3918ec2a57f","Type":"ContainerStarted","Data":"843b99ef94a8d968a2cb29a4db266f0ae72f12a885d3cfb2d3b9f89ab4168c03"}
Jul 20 19:00:40.744725 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.744699    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n47zz" event={"ID":"b834d003-a3cf-401e-a040-3800e5a5a153","Type":"ContainerStarted","Data":"d40b34b60541a74c4906901de156e4a603a7880c714068c6e70ac0eb9e65f658"}
Jul 20 19:00:40.746244 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.746117    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g85p9" event={"ID":"e0848dc8-f613-4656-aa5e-c122e5b2650a","Type":"ContainerStarted","Data":"e1e47b01fb021458452b5a3c5115e401dcc584d4f61d3b9536c1935a75baac28"}
Jul 20 19:00:40.747422 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.747398    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xrmsp" event={"ID":"6cd4b6e1-8b4f-4960-b455-af290cb08b9b","Type":"ContainerStarted","Data":"6e1b3fe22a20f02f56cca932d0db0affe5069a3d1b4139a97c200815e5de3825"}
Jul 20 19:00:40.749185 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.749143    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c82bl" event={"ID":"26a71b04-6976-4a2d-9d29-679411061462","Type":"ContainerStarted","Data":"26a7ff2d31d1018ccfdf663c79484733c75abf5b53b3c7a69fbefb71eff68cea"}
Jul 20 19:00:40.750504 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.750477    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj" event={"ID":"e99c9580-7e37-4a4f-91f3-7c7ac9874f28","Type":"ContainerStarted","Data":"709cb03162f4db2645e16fada282947a22f675e1135707ddc3e7a3eba822a7e8"}
Jul 20 19:00:40.751864 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.751814    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-87ghh" event={"ID":"510bef60-8698-405f-a2bd-7200700ecb52","Type":"ContainerStarted","Data":"9cd556383bcb758309066a346229e7e681873007a655c8d8665bef5bb86c30b4"}
Jul 20 19:00:40.807994 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.807934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e688748-9c0c-4e8b-9bae-93c81177f8a8-original-pull-secret\") pod \"global-pull-secret-syncer-slv78\" (UID: \"5e688748-9c0c-4e8b-9bae-93c81177f8a8\") " pod="kube-system/global-pull-secret-syncer-slv78"
Jul 20 19:00:40.808110 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.808046    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 19:00:40.809005 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.808983    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 19:00:40.809101 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.809019    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 19:00:40.809101 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.809034    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeHasSufficientPID"
Jul 20 19:00:40.809237 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.809169    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:40.809237 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.809223    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e688748-9c0c-4e8b-9bae-93c81177f8a8-original-pull-secret podName:5e688748-9c0c-4e8b-9bae-93c81177f8a8 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:42.809202877 +0000 UTC m=+5.605210192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e688748-9c0c-4e8b-9bae-93c81177f8a8-original-pull-secret") pod "global-pull-secret-syncer-slv78" (UID: "5e688748-9c0c-4e8b-9bae-93c81177f8a8") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:40.839218 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.839191    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:40.908476 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.908437    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e688748-9c0c-4e8b-9bae-93c81177f8a8-dbus\") pod \"5e688748-9c0c-4e8b-9bae-93c81177f8a8\" (UID: \"5e688748-9c0c-4e8b-9bae-93c81177f8a8\") "
Jul 20 19:00:40.908611 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.908501    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e688748-9c0c-4e8b-9bae-93c81177f8a8-kubelet-config\") pod \"5e688748-9c0c-4e8b-9bae-93c81177f8a8\" (UID: \"5e688748-9c0c-4e8b-9bae-93c81177f8a8\") "
Jul 20 19:00:40.908611 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.908547    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/5e688748-9c0c-4e8b-9bae-93c81177f8a8-dbus" (OuterVolumeSpecName: "dbus") pod "5e688748-9c0c-4e8b-9bae-93c81177f8a8" (UID: "5e688748-9c0c-4e8b-9bae-93c81177f8a8"). InnerVolumeSpecName "dbus". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 20 19:00:40.908745 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.908624    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/5e688748-9c0c-4e8b-9bae-93c81177f8a8-kubelet-config" (OuterVolumeSpecName: "kubelet-config") pod "5e688748-9c0c-4e8b-9bae-93c81177f8a8" (UID: "5e688748-9c0c-4e8b-9bae-93c81177f8a8"). InnerVolumeSpecName "kubelet-config". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 20 19:00:40.908745 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:40.908670    2560 reconciler_common.go:299] "Volume detached for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e688748-9c0c-4e8b-9bae-93c81177f8a8-dbus\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:00:40.940019 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:40.939971    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:41.009636 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:41.009551    2560 reconciler_common.go:299] "Volume detached for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e688748-9c0c-4e8b-9bae-93c81177f8a8-kubelet-config\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:00:41.040432 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:41.040362    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:41.140517 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:41.140489    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:41.240805 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:41.240774    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:41.342271 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:41.342111    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:41.442506 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:41.442469    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-250.ec2.internal\" not found"
Jul 20 19:00:41.490531 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:41.490483    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 19:00:41.519164 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:41.519141    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-250.ec2.internal"
Jul 20 19:00:41.529845 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:41.529819    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 19:00:41.529959 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:41.529904    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal"
Jul 20 19:00:41.530635 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:41.530614    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-250.ec2.internal"]
Jul 20 19:00:41.541812 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:41.541517    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal"]
Jul 20 19:00:41.541812 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:41.541632    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 19:00:41.621649 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:41.620876    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 19:00:41.634689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:41.634487    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 19:00:41.655557 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:41.655518    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7vqnz"
Jul 20 19:00:41.664301 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:41.664279    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7vqnz"
Jul 20 19:00:41.772396 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:41.772359    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx" event={"ID":"4a7f0781-9683-42bb-bdb2-f6bf03f313e3","Type":"ContainerStarted","Data":"c7aa61884d79e137b631fa54bb510698c9c0035a6a6f058d719e01f635ffe119"}
Jul 20 19:00:42.625016 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:42.624979    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mttgk\" (UniqueName: \"kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk\") pod \"network-check-target-ksnwk\" (UID: \"9ee86025-4e97-450b-84cf-9930112292e6\") " pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:42.625558 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:42.625171    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:42.625558 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:42.625194    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:42.625558 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:42.625209    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mttgk for pod openshift-network-diagnostics/network-check-target-ksnwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:42.625558 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:42.625282    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk podName:9ee86025-4e97-450b-84cf-9930112292e6 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:46.625249741 +0000 UTC m=+9.421257056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mttgk" (UniqueName: "kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk") pod "network-check-target-ksnwk" (UID: "9ee86025-4e97-450b-84cf-9930112292e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:42.667678 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:42.667640    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 18:55:41 +0000 UTC" deadline="2028-04-08 16:13:40.90308076 +0000 UTC"
Jul 20 19:00:42.667678 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:42.667679    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15069h12m58.235407211s"
Jul 20 19:00:42.726884 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:42.726325    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs\") pod \"network-metrics-daemon-2rwr8\" (UID: \"1a2c26c6-d757-4ddc-af69-e9fa0515a076\") " pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:42.726884 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:42.726460    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:42.726884 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:42.726521    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs podName:1a2c26c6-d757-4ddc-af69-e9fa0515a076 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:46.726501294 +0000 UTC m=+9.522508608 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs") pod "network-metrics-daemon-2rwr8" (UID: "1a2c26c6-d757-4ddc-af69-e9fa0515a076") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:42.735739 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:42.735284    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:42.735739 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:42.735405    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:00:42.735739 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:42.735583    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:42.735977 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:42.735759    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:00:42.828066 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:42.827452    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e688748-9c0c-4e8b-9bae-93c81177f8a8-original-pull-secret\") pod \"global-pull-secret-syncer-slv78\" (UID: \"5e688748-9c0c-4e8b-9bae-93c81177f8a8\") " pod="kube-system/global-pull-secret-syncer-slv78"
Jul 20 19:00:42.828066 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:42.827629    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:42.828066 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:42.827732    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e688748-9c0c-4e8b-9bae-93c81177f8a8-original-pull-secret podName:5e688748-9c0c-4e8b-9bae-93c81177f8a8 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:46.827711661 +0000 UTC m=+9.623718976 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e688748-9c0c-4e8b-9bae-93c81177f8a8-original-pull-secret") pod "global-pull-secret-syncer-slv78" (UID: "5e688748-9c0c-4e8b-9bae-93c81177f8a8") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:43.668897 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:43.668814    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 18:55:41 +0000 UTC" deadline="2028-04-13 14:10:52.894626546 +0000 UTC"
Jul 20 19:00:43.668897 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:43.668851    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15187h10m9.225780179s"
Jul 20 19:00:44.735034 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:44.734501    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:44.735034 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:44.734642    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:00:44.735890 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:44.735711    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:44.735890 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:44.735838    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:00:46.662661 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:46.662622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mttgk\" (UniqueName: \"kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk\") pod \"network-check-target-ksnwk\" (UID: \"9ee86025-4e97-450b-84cf-9930112292e6\") " pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:46.663062 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:46.662790    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:46.663062 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:46.662822    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:46.663062 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:46.662835    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mttgk for pod openshift-network-diagnostics/network-check-target-ksnwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:46.663062 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:46.662896    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk podName:9ee86025-4e97-450b-84cf-9930112292e6 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:54.662876636 +0000 UTC m=+17.458883950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mttgk" (UniqueName: "kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk") pod "network-check-target-ksnwk" (UID: "9ee86025-4e97-450b-84cf-9930112292e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:46.734749 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:46.734363    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:46.734749 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:46.734482    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:00:46.734749 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:46.734522    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:46.734749 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:46.734615    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:00:46.763769 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:46.763739    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs\") pod \"network-metrics-daemon-2rwr8\" (UID: \"1a2c26c6-d757-4ddc-af69-e9fa0515a076\") " pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:46.763911 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:46.763879    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:46.763984 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:46.763939    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs podName:1a2c26c6-d757-4ddc-af69-e9fa0515a076 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:54.763921671 +0000 UTC m=+17.559929006 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs") pod "network-metrics-daemon-2rwr8" (UID: "1a2c26c6-d757-4ddc-af69-e9fa0515a076") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:46.864681 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:46.864648    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e688748-9c0c-4e8b-9bae-93c81177f8a8-original-pull-secret\") pod \"global-pull-secret-syncer-slv78\" (UID: \"5e688748-9c0c-4e8b-9bae-93c81177f8a8\") " pod="kube-system/global-pull-secret-syncer-slv78"
Jul 20 19:00:46.864841 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:46.864821    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:46.864926 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:46.864890    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e688748-9c0c-4e8b-9bae-93c81177f8a8-original-pull-secret podName:5e688748-9c0c-4e8b-9bae-93c81177f8a8 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:54.864868805 +0000 UTC m=+17.660876136 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e688748-9c0c-4e8b-9bae-93c81177f8a8-original-pull-secret") pod "global-pull-secret-syncer-slv78" (UID: "5e688748-9c0c-4e8b-9bae-93c81177f8a8") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:48.735325 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:48.735289    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:48.735794 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:48.735400    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:00:48.735794 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:48.735501    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:48.735794 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:48.735617    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:00:48.757243 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:48.757101    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kube-system/global-pull-secret-syncer-slv78"]
Jul 20 19:00:48.757243 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:48.757207    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slv78"
Jul 20 19:00:48.760243 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:48.760208    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kube-system/global-pull-secret-syncer-slv78"]
Jul 20 19:00:48.780312 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:48.780282    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"global-pull-secret-syncer-slv78\" is forbidden: User \"system:node:ip-10-0-140-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-140-250.ec2.internal' and this object" podUID="5e688748-9c0c-4e8b-9bae-93c81177f8a8" pod="kube-system/global-pull-secret-syncer-slv78"
Jul 20 19:00:48.788958 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:48.788915    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-gtmfg"]
Jul 20 19:00:48.792003 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:48.791980    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:48.792135 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:48.792059    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtmfg" podUID="bd4662d5-a409-4422-a2a5-47356519bf53"
Jul 20 19:00:48.793851 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:48.793810    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"global-pull-secret-syncer-slv78\" is forbidden: User \"system:node:ip-10-0-140-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-140-250.ec2.internal' and this object" podUID="5e688748-9c0c-4e8b-9bae-93c81177f8a8" pod="kube-system/global-pull-secret-syncer-slv78"
Jul 20 19:00:48.881634 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:48.881591    2560 reconciler_common.go:299] "Volume detached for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e688748-9c0c-4e8b-9bae-93c81177f8a8-original-pull-secret\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:00:48.982131 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:48.982082    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bd4662d5-a409-4422-a2a5-47356519bf53-dbus\") pod \"global-pull-secret-syncer-gtmfg\" (UID: \"bd4662d5-a409-4422-a2a5-47356519bf53\") " pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:48.982293 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:48.982181    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bd4662d5-a409-4422-a2a5-47356519bf53-kubelet-config\") pod \"global-pull-secret-syncer-gtmfg\" (UID: \"bd4662d5-a409-4422-a2a5-47356519bf53\") " pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:48.982293 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:48.982243    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret\") pod \"global-pull-secret-syncer-gtmfg\" (UID: \"bd4662d5-a409-4422-a2a5-47356519bf53\") " pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:49.083404 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:49.082981    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret\") pod \"global-pull-secret-syncer-gtmfg\" (UID: \"bd4662d5-a409-4422-a2a5-47356519bf53\") " pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:49.083404 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:49.083030    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bd4662d5-a409-4422-a2a5-47356519bf53-dbus\") pod \"global-pull-secret-syncer-gtmfg\" (UID: \"bd4662d5-a409-4422-a2a5-47356519bf53\") " pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:49.083404 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:49.083089    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bd4662d5-a409-4422-a2a5-47356519bf53-kubelet-config\") pod \"global-pull-secret-syncer-gtmfg\" (UID: \"bd4662d5-a409-4422-a2a5-47356519bf53\") " pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:49.083404 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:49.083109    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:49.083404 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:49.083186    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret podName:bd4662d5-a409-4422-a2a5-47356519bf53 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:49.583166657 +0000 UTC m=+12.379173985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret") pod "global-pull-secret-syncer-gtmfg" (UID: "bd4662d5-a409-4422-a2a5-47356519bf53") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:49.083404 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:49.083186    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bd4662d5-a409-4422-a2a5-47356519bf53-kubelet-config\") pod \"global-pull-secret-syncer-gtmfg\" (UID: \"bd4662d5-a409-4422-a2a5-47356519bf53\") " pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:49.083404 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:49.083326    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bd4662d5-a409-4422-a2a5-47356519bf53-dbus\") pod \"global-pull-secret-syncer-gtmfg\" (UID: \"bd4662d5-a409-4422-a2a5-47356519bf53\") " pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:49.586904 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:49.586857    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret\") pod \"global-pull-secret-syncer-gtmfg\" (UID: \"bd4662d5-a409-4422-a2a5-47356519bf53\") " pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:49.587080 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:49.587030    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:49.587157 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:49.587098    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret podName:bd4662d5-a409-4422-a2a5-47356519bf53 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:50.587079266 +0000 UTC m=+13.383086589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret") pod "global-pull-secret-syncer-gtmfg" (UID: "bd4662d5-a409-4422-a2a5-47356519bf53") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:50.595188 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:50.594620    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret\") pod \"global-pull-secret-syncer-gtmfg\" (UID: \"bd4662d5-a409-4422-a2a5-47356519bf53\") " pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:50.595188 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:50.594793    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:50.595188 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:50.594854    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret podName:bd4662d5-a409-4422-a2a5-47356519bf53 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:52.59483619 +0000 UTC m=+15.390843521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret") pod "global-pull-secret-syncer-gtmfg" (UID: "bd4662d5-a409-4422-a2a5-47356519bf53") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:50.737314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:50.737220    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:50.737314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:50.737253    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:50.737314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:50.737261    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:50.737704 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:50.737395    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:00:50.737704 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:50.737454    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtmfg" podUID="bd4662d5-a409-4422-a2a5-47356519bf53"
Jul 20 19:00:50.737704 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:50.737537    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:00:52.609913 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:52.609880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret\") pod \"global-pull-secret-syncer-gtmfg\" (UID: \"bd4662d5-a409-4422-a2a5-47356519bf53\") " pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:52.610388 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:52.610046    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:52.610388 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:52.610111    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret podName:bd4662d5-a409-4422-a2a5-47356519bf53 nodeName:}" failed. No retries permitted until 2026-07-20 19:00:56.610093093 +0000 UTC m=+19.406100404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret") pod "global-pull-secret-syncer-gtmfg" (UID: "bd4662d5-a409-4422-a2a5-47356519bf53") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:52.734200 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:52.734168    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:52.734378 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:52.734168    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:52.734378 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:52.734296    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:00:52.734378 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:52.734335    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:52.734535 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:52.734426    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:00:52.734535 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:52.734520    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtmfg" podUID="bd4662d5-a409-4422-a2a5-47356519bf53"
Jul 20 19:00:54.729431 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:54.729390    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mttgk\" (UniqueName: \"kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk\") pod \"network-check-target-ksnwk\" (UID: \"9ee86025-4e97-450b-84cf-9930112292e6\") " pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:54.729809 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:54.729550    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:00:54.729809 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:54.729572    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:00:54.729809 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:54.729585    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mttgk for pod openshift-network-diagnostics/network-check-target-ksnwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:54.729809 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:54.729640    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk podName:9ee86025-4e97-450b-84cf-9930112292e6 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:10.729626571 +0000 UTC m=+33.525633886 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mttgk" (UniqueName: "kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk") pod "network-check-target-ksnwk" (UID: "9ee86025-4e97-450b-84cf-9930112292e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:00:54.734428 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:54.734406    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:54.734428 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:54.734427    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:54.734602 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:54.734406    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:54.734602 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:54.734539    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:00:54.734698 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:54.734647    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtmfg" podUID="bd4662d5-a409-4422-a2a5-47356519bf53"
Jul 20 19:00:54.734758 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:54.734733    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:00:54.830516 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:54.830481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs\") pod \"network-metrics-daemon-2rwr8\" (UID: \"1a2c26c6-d757-4ddc-af69-e9fa0515a076\") " pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:54.830685 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:54.830620    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:54.830752 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:54.830690    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs podName:1a2c26c6-d757-4ddc-af69-e9fa0515a076 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:10.830672513 +0000 UTC m=+33.626679824 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs") pod "network-metrics-daemon-2rwr8" (UID: "1a2c26c6-d757-4ddc-af69-e9fa0515a076") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:00:56.643081 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:56.642958    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret\") pod \"global-pull-secret-syncer-gtmfg\" (UID: \"bd4662d5-a409-4422-a2a5-47356519bf53\") " pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:56.643472 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:56.643094    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:56.643472 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:56.643196    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret podName:bd4662d5-a409-4422-a2a5-47356519bf53 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:04.643166376 +0000 UTC m=+27.439173713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret") pod "global-pull-secret-syncer-gtmfg" (UID: "bd4662d5-a409-4422-a2a5-47356519bf53") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:00:56.733810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:56.733769    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:56.733810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:56.733800    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:56.734040 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:56.733769    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:56.734040 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:56.733883    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:00:56.734040 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:56.733955    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:00:56.734219 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:56.734106    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtmfg" podUID="bd4662d5-a409-4422-a2a5-47356519bf53"
Jul 20 19:00:58.734467 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:58.734432    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:00:58.734895 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:58.734549    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:00:58.734895 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:58.734628    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:00:58.734895 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:00:58.734756    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:00:58.734895 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:58.734797    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:00:58.734895 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:00:58.734860    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtmfg" podUID="bd4662d5-a409-4422-a2a5-47356519bf53"
Jul 20 19:01:00.734229 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:00.733985    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:01:00.734733 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:00.734035    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:01:00.734733 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:00.734350    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:01:00.734733 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:00.734073    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:01:00.734733 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:00.734391    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtmfg" podUID="bd4662d5-a409-4422-a2a5-47356519bf53"
Jul 20 19:01:00.734733 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:00.734468    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:01:00.808107 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:00.808080    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c82bl" event={"ID":"26a71b04-6976-4a2d-9d29-679411061462","Type":"ContainerStarted","Data":"4b56701db022d60d2fa3613412a9ada19abbee83b4617669e3f0208b343a087a"}
Jul 20 19:01:00.809578 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:00.809555    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-250.ec2.internal" event={"ID":"f25f41b37a59fc0cc578a7d81793a28f","Type":"ContainerStarted","Data":"9cf640f6fc34444ff566d92c50ff72776fc4d8d5df5a5a2527c5070335b8e162"}
Jul 20 19:01:00.812643 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:00.812612    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n47zz" event={"ID":"b834d003-a3cf-401e-a040-3800e5a5a153","Type":"ContainerStarted","Data":"f3b3029b9c5895b27911c4a274aaa8703ca2da75abad75f9b8863ba9160e701f"}
Jul 20 19:01:00.814516 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:00.814496    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx" event={"ID":"4a7f0781-9683-42bb-bdb2-f6bf03f313e3","Type":"ContainerStarted","Data":"6409ff99393c0c13d2b998054350a80a283942bb7959b2a1f4aec164ad243b08"}
Jul 20 19:01:00.814603 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:00.814554    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx" event={"ID":"4a7f0781-9683-42bb-bdb2-f6bf03f313e3","Type":"ContainerStarted","Data":"701e171de8796020da6ed59b4dc2795b41ac5cb44d5de3b54f92ad9a5d64f2a4"}
Jul 20 19:01:00.841561 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:00.841519    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-250.ec2.internal" podStartSLOduration=19.841504342 podStartE2EDuration="19.841504342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:00.841107038 +0000 UTC m=+23.637114370" watchObservedRunningTime="2026-07-20 19:01:00.841504342 +0000 UTC m=+23.637511674"
Jul 20 19:01:00.841729 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:00.841702    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c82bl" podStartSLOduration=1.629780259 podStartE2EDuration="21.841696394s" totalImagesPullingTime="20.211916135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:00.826897683 +0000 UTC m=+23.622905015" watchObservedRunningTime="2026-07-20 19:01:00.841696394 +0000 UTC m=+23.637703747"
Jul 20 19:01:01.817852 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.817789    2560 generic.go:356] "Generic (PLEG): container finished" podID="e0848dc8-f613-4656-aa5e-c122e5b2650a" containerID="ac94dab865eb2044fe1f21d649fba3c2d34379779b2e4c2c3fbc01ca0004305c" exitCode=0
Jul 20 19:01:01.818551 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.817877    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g85p9" event={"ID":"e0848dc8-f613-4656-aa5e-c122e5b2650a","Type":"ContainerDied","Data":"ac94dab865eb2044fe1f21d649fba3c2d34379779b2e4c2c3fbc01ca0004305c"}
Jul 20 19:01:01.820719 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.820693    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:01:01.821089 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.821070    2560 generic.go:356] "Generic (PLEG): container finished" podID="4a7f0781-9683-42bb-bdb2-f6bf03f313e3" containerID="6409ff99393c0c13d2b998054350a80a283942bb7959b2a1f4aec164ad243b08" exitCode=1
Jul 20 19:01:01.821193 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.821142    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx" event={"ID":"4a7f0781-9683-42bb-bdb2-f6bf03f313e3","Type":"ContainerDied","Data":"6409ff99393c0c13d2b998054350a80a283942bb7959b2a1f4aec164ad243b08"}
Jul 20 19:01:01.821248 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.821212    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx" event={"ID":"4a7f0781-9683-42bb-bdb2-f6bf03f313e3","Type":"ContainerStarted","Data":"781f1414397bd96e67c3d651055f9abb1fbd59da82a8ddf52bb74c5e2733fd44"}
Jul 20 19:01:01.821287 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.821259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx" event={"ID":"4a7f0781-9683-42bb-bdb2-f6bf03f313e3","Type":"ContainerStarted","Data":"c823cc9e0db3eb2c1a010440b5517d5505b990f6a8acbc517e6ad933e650030f"}
Jul 20 19:01:01.821326 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.821289    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx" event={"ID":"4a7f0781-9683-42bb-bdb2-f6bf03f313e3","Type":"ContainerStarted","Data":"83161a24657b92892dee8e2e68b1f44b1f4f5f6ba5a9074ba86927cdd2e477bf"}
Jul 20 19:01:01.821326 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.821315    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx" event={"ID":"4a7f0781-9683-42bb-bdb2-f6bf03f313e3","Type":"ContainerStarted","Data":"d5f34d540f27a204a969432dbd4b6e267ecb510d0f684429fe0d510d8e5b13b8"}
Jul 20 19:01:01.822851 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.822829    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xrmsp" event={"ID":"6cd4b6e1-8b4f-4960-b455-af290cb08b9b","Type":"ContainerStarted","Data":"0da83fe428f8d0f4a0cc9d1e16997dc04635e61fee45cb74a1d05fcf1f3c2104"}
Jul 20 19:01:01.824228 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.824210    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj" event={"ID":"e99c9580-7e37-4a4f-91f3-7c7ac9874f28","Type":"ContainerStarted","Data":"7574e70411b828d4f53d421fcb6c5654de4a76727c361416b8275cb860702731"}
Jul 20 19:01:01.825569 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.825546    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-87ghh" event={"ID":"510bef60-8698-405f-a2bd-7200700ecb52","Type":"ContainerStarted","Data":"664b65ddfbde8444d81e6dde9313325f7525a160cad20ff026631e641a10ba93"}
Jul 20 19:01:01.826790 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.826772    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vt7z5" event={"ID":"7a05c4ac-04f4-4ff5-adc2-411cffcb815c","Type":"ContainerStarted","Data":"2222cb4051e5a87152ec2d6374810cbaa6ea4ba971dfa1b97a1c63960c5f49b3"}
Jul 20 19:01:01.827980 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.827960    2560 generic.go:356] "Generic (PLEG): container finished" podID="4ab7c893c06d445ef68c950db0992258" containerID="40a6f1d87f61ece415457dc79164db35bcce2c25efa469284bee80da83a6d40b" exitCode=0
Jul 20 19:01:01.828074 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.828020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal" event={"ID":"4ab7c893c06d445ef68c950db0992258","Type":"ContainerDied","Data":"40a6f1d87f61ece415457dc79164db35bcce2c25efa469284bee80da83a6d40b"}
Jul 20 19:01:01.829375 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.829348    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dndtw" event={"ID":"5778dd59-96b2-41f8-85cd-c3918ec2a57f","Type":"ContainerStarted","Data":"5180acd992872bb6e118734914cdc7ab2d71937883eeb53153f9402c94ea16a7"}
Jul 20 19:01:01.842204 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.842171    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-n47zz" podStartSLOduration=2.294893915 podStartE2EDuration="22.842158879s" totalImagesPullingTime="20.547264964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:00.86803086 +0000 UTC m=+23.664038193" watchObservedRunningTime="2026-07-20 19:01:01.842158879 +0000 UTC m=+24.638166212"
Jul 20 19:01:01.872617 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.872574    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vt7z5" podStartSLOduration=2.280862776 podStartE2EDuration="22.872558953s" totalImagesPullingTime="20.591696177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:01.872443981 +0000 UTC m=+24.668451314" watchObservedRunningTime="2026-07-20 19:01:01.872558953 +0000 UTC m=+24.668566287"
Jul 20 19:01:01.898965 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.898931    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dndtw" podStartSLOduration=2.456017035 podStartE2EDuration="22.898919758s" totalImagesPullingTime="20.442902723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:01.898871787 +0000 UTC m=+24.694879121" watchObservedRunningTime="2026-07-20 19:01:01.898919758 +0000 UTC m=+24.694927091"
Jul 20 19:01:01.899187 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.899166    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-87ghh" podStartSLOduration=2.355694198 podStartE2EDuration="22.899159479s" totalImagesPullingTime="20.543465281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:01.885688828 +0000 UTC m=+24.681696163" watchObservedRunningTime="2026-07-20 19:01:01.899159479 +0000 UTC m=+24.695166817"
Jul 20 19:01:01.913147 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:01.913098    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xrmsp" podStartSLOduration=2.790530976 podStartE2EDuration="22.913087688s" totalImagesPullingTime="20.122556712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:01.912883725 +0000 UTC m=+24.708891058" watchObservedRunningTime="2026-07-20 19:01:01.913087688 +0000 UTC m=+24.709095021"
Jul 20 19:01:02.533817 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:02.533786    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xrmsp"
Jul 20 19:01:02.534396 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:02.534377    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xrmsp"
Jul 20 19:01:02.734543 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:02.734518    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:01:02.734642 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:02.734522    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:01:02.734698 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:02.734645    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:01:02.734698 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:02.734522    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:01:02.734796 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:02.734687    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:01:02.734796 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:02.734751    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtmfg" podUID="bd4662d5-a409-4422-a2a5-47356519bf53"
Jul 20 19:01:02.763346 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:02.763327    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 19:01:02.832452 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:02.832406    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj" event={"ID":"e99c9580-7e37-4a4f-91f3-7c7ac9874f28","Type":"ContainerStarted","Data":"34fb3d65640a34d1e8b0467b439bb3804adecfd8cd19c9a570bb2696eb68c178"}
Jul 20 19:01:02.834134 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:02.834089    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal" event={"ID":"4ab7c893c06d445ef68c950db0992258","Type":"ContainerStarted","Data":"5f52fc31e9fc96f6c465dd951f35ada26da9b66f6f374717ced2c26e8f24d34a"}
Jul 20 19:01:02.834676 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:02.834654    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xrmsp"
Jul 20 19:01:02.834926 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:02.834908    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xrmsp"
Jul 20 19:01:02.848966 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:02.848927    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-250.ec2.internal" podStartSLOduration=21.848915233 podStartE2EDuration="21.848915233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:02.848311536 +0000 UTC m=+25.644318869" watchObservedRunningTime="2026-07-20 19:01:02.848915233 +0000 UTC m=+25.644922566"
Jul 20 19:01:03.252360 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:03.252285    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T19:01:02.763341084Z","UUID":"48512d71-f1e0-41f4-87d0-ef01277fc2a0","Handler":null,"Name":"","Endpoint":""}
Jul 20 19:01:03.253608 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:03.253584    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 19:01:03.253718 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:03.253623    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 19:01:03.840283 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:03.840255    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:01:03.841002 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:03.840911    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx" event={"ID":"4a7f0781-9683-42bb-bdb2-f6bf03f313e3","Type":"ContainerStarted","Data":"83785dc974e338e4d5c999dc6f941d3fc1bba4b62299211153d8e07f5f0af707"}
Jul 20 19:01:04.701909 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:04.701879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret\") pod \"global-pull-secret-syncer-gtmfg\" (UID: \"bd4662d5-a409-4422-a2a5-47356519bf53\") " pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:01:04.702054 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:04.702016    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 19:01:04.702101 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:04.702078    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret podName:bd4662d5-a409-4422-a2a5-47356519bf53 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:20.702059787 +0000 UTC m=+43.498067101 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret") pod "global-pull-secret-syncer-gtmfg" (UID: "bd4662d5-a409-4422-a2a5-47356519bf53") : object "kube-system"/"original-pull-secret" not registered
Jul 20 19:01:04.736907 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:04.736878    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:01:04.736907 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:04.736893    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:01:04.737082 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:04.736911    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:01:04.737082 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:04.736999    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtmfg" podUID="bd4662d5-a409-4422-a2a5-47356519bf53"
Jul 20 19:01:04.737082 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:04.737062    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:01:04.737334 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:04.737166    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:01:04.844841 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:04.844766    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj" event={"ID":"e99c9580-7e37-4a4f-91f3-7c7ac9874f28","Type":"ContainerStarted","Data":"0b38f46540755c7c956f0050001e11c27dd944f88e4998f0b5d4768412b39610"}
Jul 20 19:01:04.861827 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:04.861785    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbzvj" podStartSLOduration=2.280781694 podStartE2EDuration="25.861773345s" totalImagesPullingTime="23.580991651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:04.86166877 +0000 UTC m=+27.657676124" watchObservedRunningTime="2026-07-20 19:01:04.861773345 +0000 UTC m=+27.657780705"
Jul 20 19:01:05.851636 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:05.851424    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:01:05.852371 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:05.851966    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx" event={"ID":"4a7f0781-9683-42bb-bdb2-f6bf03f313e3","Type":"ContainerStarted","Data":"94ce75e81fd9dafc7dd8478d5c01128fb019c70f3e0445de48fbecbbfa87f52d"}
Jul 20 19:01:05.852585 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:05.852551    2560 scope.go:117] "RemoveContainer" containerID="6409ff99393c0c13d2b998054350a80a283942bb7959b2a1f4aec164ad243b08"
Jul 20 19:01:06.737076 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:06.737036    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:01:06.737076 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:06.737064    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:01:06.737422 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:06.737036    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:01:06.737422 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:06.737186    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:01:06.737422 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:06.737261    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtmfg" podUID="bd4662d5-a409-4422-a2a5-47356519bf53"
Jul 20 19:01:06.737422 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:06.737348    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:01:06.884141 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:06.879354    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:01:06.884141 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:06.883298    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx" event={"ID":"4a7f0781-9683-42bb-bdb2-f6bf03f313e3","Type":"ContainerStarted","Data":"4980e88a6909a246abfe29b798b54aa60045d2450d010ee6bbb19b14e779492c"}
Jul 20 19:01:06.884788 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:06.884582    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:01:06.884788 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:06.884662    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:01:06.884788 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:06.884761    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:01:06.903852 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:06.903825    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:01:06.906329 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:06.905299    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:01:06.913723 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:06.913644    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx" podStartSLOduration=8.171485964 podStartE2EDuration="27.913625887s" totalImagesPullingTime="19.742139923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:06.912838729 +0000 UTC m=+29.708846220" watchObservedRunningTime="2026-07-20 19:01:06.913625887 +0000 UTC m=+29.709633221"
Jul 20 19:01:07.537928 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:07.537720    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gtmfg"]
Jul 20 19:01:07.538101 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:07.538012    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:01:07.538197 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:07.538138    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtmfg" podUID="bd4662d5-a409-4422-a2a5-47356519bf53"
Jul 20 19:01:07.542081 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:07.542057    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ksnwk"]
Jul 20 19:01:07.542220 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:07.542157    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:01:07.542282 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:07.542255    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:01:07.542904 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:07.542878    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2rwr8"]
Jul 20 19:01:07.543028 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:07.542981    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:01:07.543100 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:07.543085    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:01:08.735219 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:08.735194    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:01:08.735543 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:08.735273    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtmfg" podUID="bd4662d5-a409-4422-a2a5-47356519bf53"
Jul 20 19:01:08.890712 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:08.890683    2560 generic.go:356] "Generic (PLEG): container finished" podID="e0848dc8-f613-4656-aa5e-c122e5b2650a" containerID="d4bf42ea5fbb3cc3478f3f5148986ebfdd2bd4a68cf7ff2b9cb0bbee30a458d6" exitCode=0
Jul 20 19:01:08.890844 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:08.890759    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g85p9" event={"ID":"e0848dc8-f613-4656-aa5e-c122e5b2650a","Type":"ContainerDied","Data":"d4bf42ea5fbb3cc3478f3f5148986ebfdd2bd4a68cf7ff2b9cb0bbee30a458d6"}
Jul 20 19:01:09.733602 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:09.733561    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:01:09.733771 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:09.733610    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:01:09.733771 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:09.733721    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:01:09.733862 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:09.733813    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:01:10.734131 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:10.734092    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:01:10.734431 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:10.734205    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtmfg" podUID="bd4662d5-a409-4422-a2a5-47356519bf53"
Jul 20 19:01:10.747195 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:10.747168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mttgk\" (UniqueName: \"kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk\") pod \"network-check-target-ksnwk\" (UID: \"9ee86025-4e97-450b-84cf-9930112292e6\") " pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:01:10.747300 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:10.747276    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 19:01:10.747300 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:10.747288    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 19:01:10.747300 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:10.747297    2560 projected.go:196] Error preparing data for projected volume kube-api-access-mttgk for pod openshift-network-diagnostics/network-check-target-ksnwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:01:10.747399 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:10.747337    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk podName:9ee86025-4e97-450b-84cf-9930112292e6 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:42.747324268 +0000 UTC m=+65.543331579 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mttgk" (UniqueName: "kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk") pod "network-check-target-ksnwk" (UID: "9ee86025-4e97-450b-84cf-9930112292e6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 19:01:10.848226 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:10.848177    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs\") pod \"network-metrics-daemon-2rwr8\" (UID: \"1a2c26c6-d757-4ddc-af69-e9fa0515a076\") " pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:01:10.848309 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:10.848289    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:01:10.848347 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:10.848330    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs podName:1a2c26c6-d757-4ddc-af69-e9fa0515a076 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:42.848318404 +0000 UTC m=+65.644325716 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs") pod "network-metrics-daemon-2rwr8" (UID: "1a2c26c6-d757-4ddc-af69-e9fa0515a076") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 19:01:10.897431 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:10.897402    2560 generic.go:356] "Generic (PLEG): container finished" podID="e0848dc8-f613-4656-aa5e-c122e5b2650a" containerID="93b8e572ac8a74e47a65350539a91492702aff56fd6a720a3f59253644d289f8" exitCode=0
Jul 20 19:01:10.897517 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:10.897452    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g85p9" event={"ID":"e0848dc8-f613-4656-aa5e-c122e5b2650a","Type":"ContainerDied","Data":"93b8e572ac8a74e47a65350539a91492702aff56fd6a720a3f59253644d289f8"}
Jul 20 19:01:11.734246 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:11.734214    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:01:11.734586 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:11.734316    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:01:11.734586 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:11.734346    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:01:11.734586 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:11.734406    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:01:12.733812 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:12.733626    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:01:12.733964 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:12.733886    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtmfg" podUID="bd4662d5-a409-4422-a2a5-47356519bf53"
Jul 20 19:01:12.903568 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:12.903541    2560 generic.go:356] "Generic (PLEG): container finished" podID="e0848dc8-f613-4656-aa5e-c122e5b2650a" containerID="b359636b2c1e7c88568d9896519fc0e81e6f98ce6d1cd72b8a4ed0bf325ab9ac" exitCode=0
Jul 20 19:01:12.903921 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:12.903596    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g85p9" event={"ID":"e0848dc8-f613-4656-aa5e-c122e5b2650a","Type":"ContainerDied","Data":"b359636b2c1e7c88568d9896519fc0e81e6f98ce6d1cd72b8a4ed0bf325ab9ac"}
Jul 20 19:01:13.734037 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:13.734006    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:01:13.734214 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:13.734153    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2rwr8" podUID="1a2c26c6-d757-4ddc-af69-e9fa0515a076"
Jul 20 19:01:13.734304 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:13.734218    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:01:13.734349 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:13.734319    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ksnwk" podUID="9ee86025-4e97-450b-84cf-9930112292e6"
Jul 20 19:01:14.521939 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.521908    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-250.ec2.internal" event="NodeReady"
Jul 20 19:01:14.522376 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.522034    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 19:01:14.563136 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.563097    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn"]
Jul 20 19:01:14.567225 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.565845    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn"
Jul 20 19:01:14.568631 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.568606    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d9689c95-tw9cj"]
Jul 20 19:01:14.568915 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.568892    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 20 19:01:14.569488 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.569074    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:01:14.569488 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.569264    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 20 19:01:14.569488 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.569339    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 20 19:01:14.569702 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.569685    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fxfz8\""
Jul 20 19:01:14.570637 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.570617    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6g49j"]
Jul 20 19:01:14.570774 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.570755    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.572174 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.572156    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw"]
Jul 20 19:01:14.572287 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.572267    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6g49j"
Jul 20 19:01:14.572674 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.572656    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 20 19:01:14.573226 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.572917    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 20 19:01:14.573226 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.573000    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 20 19:01:14.573592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.573571    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kl4lh\""
Jul 20 19:01:14.574025 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.573849    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw"
Jul 20 19:01:14.574511 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.574488    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-sxzrg\""
Jul 20 19:01:14.574710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.574690    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 20 19:01:14.574793 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.574715    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:01:14.575963 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.575941    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:01:14.576352 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.576332    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 20 19:01:14.576639 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.576371    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lbrtv\""
Jul 20 19:01:14.576801 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.576787    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 20 19:01:14.578091 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.578062    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn"]
Jul 20 19:01:14.579168 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.578812    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-hp5zw"]
Jul 20 19:01:14.580261 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.580221    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 20 19:01:14.580630 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.580608    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-5nbcw"]
Jul 20 19:01:14.581784 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.581547    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.582442 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.582426    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw"]
Jul 20 19:01:14.582688 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.582510    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:14.584052 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.584035    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 20 19:01:14.584282 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.584175    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 20 19:01:14.584389 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.584084    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 19:01:14.584741 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.584721    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 19:01:14.585095 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.585044    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 20 19:01:14.585263 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.585097    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:01:14.585263 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.585054    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-52csh\""
Jul 20 19:01:14.586346 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.585800    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 20 19:01:14.586346 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.585844    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 20 19:01:14.586346 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.586283    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-l8s6z\""
Jul 20 19:01:14.591341 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.591321    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d9689c95-tw9cj"]
Jul 20 19:01:14.594851 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.594829    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 20 19:01:14.594959 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.594941    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 20 19:01:14.597995 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.597970    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-hp5zw"]
Jul 20 19:01:14.599180 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.599109    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-5nbcw"]
Jul 20 19:01:14.602793 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.602772    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6g49j"]
Jul 20 19:01:14.611726 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.611707    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5lswm"]
Jul 20 19:01:14.613777 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.613755    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv"]
Jul 20 19:01:14.614764 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.614478    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:14.615626 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.615602    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"]
Jul 20 19:01:14.615741 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.615725    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv"
Jul 20 19:01:14.617179 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.617161    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 19:01:14.617297 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.617279    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls"]
Jul 20 19:01:14.617394 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.617208    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 19:01:14.617456 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.617402    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"
Jul 20 19:01:14.617861 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.617841    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-shkhq\""
Jul 20 19:01:14.618090 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.618071    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 20 19:01:14.618608 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.618589    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 20 19:01:14.618859 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.618843    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7mk56\""
Jul 20 19:01:14.619144 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.619101    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6985ddbc8-pvcb7"]
Jul 20 19:01:14.619266 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.619207    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls"
Jul 20 19:01:14.619373 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.619323    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 20 19:01:14.620626 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.620609    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xwlfn\""
Jul 20 19:01:14.620893 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.620738    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 19:01:14.620893 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.620801    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 20 19:01:14.621072 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.621029    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 19:01:14.621847 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.621636    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 20 19:01:14.621847 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.621659    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 20 19:01:14.621994 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.621906    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9cnwf"]
Jul 20 19:01:14.622885 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.622860    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:14.623917 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.623548    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-v8pdx"]
Jul 20 19:01:14.623917 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.623664    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9cnwf"
Jul 20 19:01:14.625282 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.625265    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"]
Jul 20 19:01:14.625491 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.625432    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-v8pdx"
Jul 20 19:01:14.626657 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.626637    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5lswm"]
Jul 20 19:01:14.626868 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.626851    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ctrfk\""
Jul 20 19:01:14.626977 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.626958    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:01:14.627463 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.627440    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 20 19:01:14.627710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.627694    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 20 19:01:14.627996 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.627971    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 20 19:01:14.628443 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.628423    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 20 19:01:14.628570 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.628552    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tjwjb\""
Jul 20 19:01:14.628709 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.627726    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dls6q\""
Jul 20 19:01:14.628845 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.628827    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 19:01:14.628959 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.627768    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 19:01:14.629165 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.629148    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 20 19:01:14.629290 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.629273    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 19:01:14.629412 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.629395    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 19:01:14.629500 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.629019    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 19:01:14.629602 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.629584    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-v8pdx"]
Jul 20 19:01:14.630784 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.630685    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 19:01:14.630784 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.630750    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-5d9hp\""
Jul 20 19:01:14.630933 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.630903    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 19:01:14.631064 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.631048    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls"]
Jul 20 19:01:14.632407 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.632071    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv"]
Jul 20 19:01:14.633301 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.633283    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9cnwf"]
Jul 20 19:01:14.634430 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.634317    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6985ddbc8-pvcb7"]
Jul 20 19:01:14.678368 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678343    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tbpt\" (UniqueName: \"kubernetes.io/projected/010ab407-03e3-4b9c-86e8-7e3419017c52-kube-api-access-8tbpt\") pod \"service-ca-operator-5bcbc94c78-ztwzn\" (UID: \"010ab407-03e3-4b9c-86e8-7e3419017c52\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn"
Jul 20 19:01:14.678453 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-bound-sa-token\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.678453 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678448    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1805f53-670a-44fc-89d6-adac1bf3cddf-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-f7fls\" (UID: \"b1805f53-670a-44fc-89d6-adac1bf3cddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls"
Jul 20 19:01:14.678535 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678474    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t95nv\" (UID: \"f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv"
Jul 20 19:01:14.678535 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678518    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b880cd4d-9983-4244-92e6-da9fcbc6539f-serving-cert\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.678604 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b880cd4d-9983-4244-92e6-da9fcbc6539f-service-ca-bundle\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.678604 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678565    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-t95nv\" (UID: \"f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv"
Jul 20 19:01:14.678604 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678589    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v966b\" (UID: \"ea592eba-3f66-43c3-8235-7dee7375e218\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"
Jul 20 19:01:14.678713 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:14.678713 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.678713 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678687    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-certificates\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.678839 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b880cd4d-9983-4244-92e6-da9fcbc6539f-snapshots\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.678839 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678754    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhwhq\" (UniqueName: \"kubernetes.io/projected/9e6ad052-9fd5-4478-8002-f2546b4df236-kube-api-access-lhwhq\") pod \"console-operator-565b7b569d-5nbcw\" (UID: \"9e6ad052-9fd5-4478-8002-f2546b4df236\") " pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:14.678839 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678776    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58e7255e-a59f-4b53-b234-b12f74f7c894-image-registry-private-configuration\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.678839 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:14.678839 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678832    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-tmp-dir\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:14.679061 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678854    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-stats-auth\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:14.679061 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678875    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6rmt\" (UniqueName: \"kubernetes.io/projected/9a882a69-59de-4dd8-9411-5f53baf13da5-kube-api-access-b6rmt\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:14.679061 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678890    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-config-volume\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:14.679061 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678933    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p59d\" (UniqueName: \"kubernetes.io/projected/8d9ccc69-5ef1-4ab6-aa1d-ae68617c32f6-kube-api-access-5p59d\") pod \"network-check-source-7bc5b6bf85-v8pdx\" (UID: \"8d9ccc69-5ef1-4ab6-aa1d-ae68617c32f6\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-v8pdx"
Jul 20 19:01:14.679061 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f188b329-3e3d-4340-8dcc-75ba3ba8d7c0-cert\") pod \"ingress-canary-9cnwf\" (UID: \"f188b329-3e3d-4340-8dcc-75ba3ba8d7c0\") " pod="openshift-ingress-canary/ingress-canary-9cnwf"
Jul 20 19:01:14.679061 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.678989    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ea592eba-3f66-43c3-8235-7dee7375e218-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-v966b\" (UID: \"ea592eba-3f66-43c3-8235-7dee7375e218\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"
Jul 20 19:01:14.679061 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/010ab407-03e3-4b9c-86e8-7e3419017c52-serving-cert\") pod \"service-ca-operator-5bcbc94c78-ztwzn\" (UID: \"010ab407-03e3-4b9c-86e8-7e3419017c52\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn"
Jul 20 19:01:14.679436 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679062    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr5wx\" (UniqueName: \"kubernetes.io/projected/331b36ec-7043-4009-b601-bb26eb569bfd-kube-api-access-tr5wx\") pod \"cluster-samples-operator-79b7c55f87-2gsnw\" (UID: \"331b36ec-7043-4009-b601-bb26eb569bfd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw"
Jul 20 19:01:14.679436 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679099    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/010ab407-03e3-4b9c-86e8-7e3419017c52-config\") pod \"service-ca-operator-5bcbc94c78-ztwzn\" (UID: \"010ab407-03e3-4b9c-86e8-7e3419017c52\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn"
Jul 20 19:01:14.679436 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58e7255e-a59f-4b53-b234-b12f74f7c894-ca-trust-extracted\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.679436 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2gsnw\" (UID: \"331b36ec-7043-4009-b601-bb26eb569bfd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw"
Jul 20 19:01:14.679436 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679300    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b880cd4d-9983-4244-92e6-da9fcbc6539f-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.679436 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679324    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b880cd4d-9983-4244-92e6-da9fcbc6539f-tmp\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.679436 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679346    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx7h8\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-kube-api-access-zx7h8\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.679436 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679374    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58e7255e-a59f-4b53-b234-b12f74f7c894-installation-pull-secrets\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.679436 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679402    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:14.680060 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679448    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e6ad052-9fd5-4478-8002-f2546b4df236-serving-cert\") pod \"console-operator-565b7b569d-5nbcw\" (UID: \"9e6ad052-9fd5-4478-8002-f2546b4df236\") " pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:14.680060 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679479    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrch4\" (UniqueName: \"kubernetes.io/projected/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-kube-api-access-xrch4\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:14.680060 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679502    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58e7255e-a59f-4b53-b234-b12f74f7c894-trusted-ca\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.680060 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9tq6\" (UniqueName: \"kubernetes.io/projected/ea592eba-3f66-43c3-8235-7dee7375e218-kube-api-access-h9tq6\") pod \"cluster-monitoring-operator-76cf8966f8-v966b\" (UID: \"ea592eba-3f66-43c3-8235-7dee7375e218\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"
Jul 20 19:01:14.680060 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679546    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e6ad052-9fd5-4478-8002-f2546b4df236-trusted-ca\") pod \"console-operator-565b7b569d-5nbcw\" (UID: \"9e6ad052-9fd5-4478-8002-f2546b4df236\") " pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:14.680060 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679625    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlfdv\" (UniqueName: \"kubernetes.io/projected/f188b329-3e3d-4340-8dcc-75ba3ba8d7c0-kube-api-access-mlfdv\") pod \"ingress-canary-9cnwf\" (UID: \"f188b329-3e3d-4340-8dcc-75ba3ba8d7c0\") " pod="openshift-ingress-canary/ingress-canary-9cnwf"
Jul 20 19:01:14.680060 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679698    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e6ad052-9fd5-4478-8002-f2546b4df236-config\") pod \"console-operator-565b7b569d-5nbcw\" (UID: \"9e6ad052-9fd5-4478-8002-f2546b4df236\") " pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:14.680060 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679721    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1805f53-670a-44fc-89d6-adac1bf3cddf-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-f7fls\" (UID: \"b1805f53-670a-44fc-89d6-adac1bf3cddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls"
Jul 20 19:01:14.680060 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679767    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hphht\" (UniqueName: \"kubernetes.io/projected/b1805f53-670a-44fc-89d6-adac1bf3cddf-kube-api-access-hphht\") pod \"kube-storage-version-migrator-operator-7658d9b749-f7fls\" (UID: \"b1805f53-670a-44fc-89d6-adac1bf3cddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls"
Jul 20 19:01:14.680060 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679793    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt868\" (UniqueName: \"kubernetes.io/projected/cc2e9a44-eb77-45b0-afe6-d3a8ea8d5ae0-kube-api-access-qt868\") pod \"volume-data-source-validator-78cf4c6f6-6g49j\" (UID: \"cc2e9a44-eb77-45b0-afe6-d3a8ea8d5ae0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6g49j"
Jul 20 19:01:14.680060 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679838    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-default-certificate\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:14.680060 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.679864    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bldln\" (UniqueName: \"kubernetes.io/projected/b880cd4d-9983-4244-92e6-da9fcbc6539f-kube-api-access-bldln\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.734181 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.734161    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:01:14.736228 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.736206    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 19:01:14.780954 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.780894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2gsnw\" (UID: \"331b36ec-7043-4009-b601-bb26eb569bfd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw"
Jul 20 19:01:14.780954 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.780924    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b880cd4d-9983-4244-92e6-da9fcbc6539f-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.780954 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.780940    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b880cd4d-9983-4244-92e6-da9fcbc6539f-tmp\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.781206 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.780957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx7h8\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-kube-api-access-zx7h8\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.781206 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.780982    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58e7255e-a59f-4b53-b234-b12f74f7c894-installation-pull-secrets\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.781206 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:14.781206 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781032    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e6ad052-9fd5-4478-8002-f2546b4df236-serving-cert\") pod \"console-operator-565b7b569d-5nbcw\" (UID: \"9e6ad052-9fd5-4478-8002-f2546b4df236\") " pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:14.781206 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781061    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrch4\" (UniqueName: \"kubernetes.io/projected/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-kube-api-access-xrch4\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:14.781206 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:14.781068    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 19:01:14.781206 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781085    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58e7255e-a59f-4b53-b234-b12f74f7c894-trusted-ca\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.781206 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781113    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9tq6\" (UniqueName: \"kubernetes.io/projected/ea592eba-3f66-43c3-8235-7dee7375e218-kube-api-access-h9tq6\") pod \"cluster-monitoring-operator-76cf8966f8-v966b\" (UID: \"ea592eba-3f66-43c3-8235-7dee7375e218\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"
Jul 20 19:01:14.781206 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:14.781162    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls podName:331b36ec-7043-4009-b601-bb26eb569bfd nodeName:}" failed. No retries permitted until 2026-07-20 19:01:15.281140159 +0000 UTC m=+38.077147484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2gsnw" (UID: "331b36ec-7043-4009-b601-bb26eb569bfd") : secret "samples-operator-tls" not found
Jul 20 19:01:14.781206 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781203    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e6ad052-9fd5-4478-8002-f2546b4df236-trusted-ca\") pod \"console-operator-565b7b569d-5nbcw\" (UID: \"9e6ad052-9fd5-4478-8002-f2546b4df236\") " pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:14.781734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781229    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlfdv\" (UniqueName: \"kubernetes.io/projected/f188b329-3e3d-4340-8dcc-75ba3ba8d7c0-kube-api-access-mlfdv\") pod \"ingress-canary-9cnwf\" (UID: \"f188b329-3e3d-4340-8dcc-75ba3ba8d7c0\") " pod="openshift-ingress-canary/ingress-canary-9cnwf"
Jul 20 19:01:14.781734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781282    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e6ad052-9fd5-4478-8002-f2546b4df236-config\") pod \"console-operator-565b7b569d-5nbcw\" (UID: \"9e6ad052-9fd5-4478-8002-f2546b4df236\") " pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:14.781734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781316    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1805f53-670a-44fc-89d6-adac1bf3cddf-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-f7fls\" (UID: \"b1805f53-670a-44fc-89d6-adac1bf3cddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls"
Jul 20 19:01:14.781734 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:14.781341    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 19:01:14.781734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781363    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b880cd4d-9983-4244-92e6-da9fcbc6539f-tmp\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.781734 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:14.781403    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs podName:9a882a69-59de-4dd8-9411-5f53baf13da5 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:15.28138531 +0000 UTC m=+38.077392637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs") pod "router-default-6985ddbc8-pvcb7" (UID: "9a882a69-59de-4dd8-9411-5f53baf13da5") : secret "router-metrics-certs-default" not found
Jul 20 19:01:14.781734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781342    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hphht\" (UniqueName: \"kubernetes.io/projected/b1805f53-670a-44fc-89d6-adac1bf3cddf-kube-api-access-hphht\") pod \"kube-storage-version-migrator-operator-7658d9b749-f7fls\" (UID: \"b1805f53-670a-44fc-89d6-adac1bf3cddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls"
Jul 20 19:01:14.781734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781439    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt868\" (UniqueName: \"kubernetes.io/projected/cc2e9a44-eb77-45b0-afe6-d3a8ea8d5ae0-kube-api-access-qt868\") pod \"volume-data-source-validator-78cf4c6f6-6g49j\" (UID: \"cc2e9a44-eb77-45b0-afe6-d3a8ea8d5ae0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6g49j"
Jul 20 19:01:14.781734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781468    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-default-certificate\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:14.781734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bldln\" (UniqueName: \"kubernetes.io/projected/b880cd4d-9983-4244-92e6-da9fcbc6539f-kube-api-access-bldln\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.781734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781529    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tbpt\" (UniqueName: \"kubernetes.io/projected/010ab407-03e3-4b9c-86e8-7e3419017c52-kube-api-access-8tbpt\") pod \"service-ca-operator-5bcbc94c78-ztwzn\" (UID: \"010ab407-03e3-4b9c-86e8-7e3419017c52\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn"
Jul 20 19:01:14.781734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781556    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-bound-sa-token\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.781734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781604    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1805f53-670a-44fc-89d6-adac1bf3cddf-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-f7fls\" (UID: \"b1805f53-670a-44fc-89d6-adac1bf3cddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls"
Jul 20 19:01:14.782382 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781634    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t95nv\" (UID: \"f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv"
Jul 20 19:01:14.782382 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781671    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b880cd4d-9983-4244-92e6-da9fcbc6539f-serving-cert\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.782382 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781698    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b880cd4d-9983-4244-92e6-da9fcbc6539f-service-ca-bundle\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.782382 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-t95nv\" (UID: \"f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv"
Jul 20 19:01:14.782382 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781748    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v966b\" (UID: \"ea592eba-3f66-43c3-8235-7dee7375e218\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"
Jul 20 19:01:14.782382 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:14.782382 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781803    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.782382 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781828    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-certificates\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.782382 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781856    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b880cd4d-9983-4244-92e6-da9fcbc6539f-snapshots\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.782382 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781882    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhwhq\" (UniqueName: \"kubernetes.io/projected/9e6ad052-9fd5-4478-8002-f2546b4df236-kube-api-access-lhwhq\") pod \"console-operator-565b7b569d-5nbcw\" (UID: \"9e6ad052-9fd5-4478-8002-f2546b4df236\") " pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:14.782382 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58e7255e-a59f-4b53-b234-b12f74f7c894-image-registry-private-configuration\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.782382 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781941    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:14.782382 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781965    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-tmp-dir\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:14.783012 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.781989    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-stats-auth\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:14.783012 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.782014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6rmt\" (UniqueName: \"kubernetes.io/projected/9a882a69-59de-4dd8-9411-5f53baf13da5-kube-api-access-b6rmt\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:14.783012 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.782040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-config-volume\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:14.783012 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.782067    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p59d\" (UniqueName: \"kubernetes.io/projected/8d9ccc69-5ef1-4ab6-aa1d-ae68617c32f6-kube-api-access-5p59d\") pod \"network-check-source-7bc5b6bf85-v8pdx\" (UID: \"8d9ccc69-5ef1-4ab6-aa1d-ae68617c32f6\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-v8pdx"
Jul 20 19:01:14.783012 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.782108    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f188b329-3e3d-4340-8dcc-75ba3ba8d7c0-cert\") pod \"ingress-canary-9cnwf\" (UID: \"f188b329-3e3d-4340-8dcc-75ba3ba8d7c0\") " pod="openshift-ingress-canary/ingress-canary-9cnwf"
Jul 20 19:01:14.783012 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.782154    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ea592eba-3f66-43c3-8235-7dee7375e218-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-v966b\" (UID: \"ea592eba-3f66-43c3-8235-7dee7375e218\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"
Jul 20 19:01:14.783012 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.782184    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/010ab407-03e3-4b9c-86e8-7e3419017c52-serving-cert\") pod \"service-ca-operator-5bcbc94c78-ztwzn\" (UID: \"010ab407-03e3-4b9c-86e8-7e3419017c52\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn"
Jul 20 19:01:14.783012 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.782210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr5wx\" (UniqueName: \"kubernetes.io/projected/331b36ec-7043-4009-b601-bb26eb569bfd-kube-api-access-tr5wx\") pod \"cluster-samples-operator-79b7c55f87-2gsnw\" (UID: \"331b36ec-7043-4009-b601-bb26eb569bfd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw"
Jul 20 19:01:14.783012 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.782220    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e6ad052-9fd5-4478-8002-f2546b4df236-config\") pod \"console-operator-565b7b569d-5nbcw\" (UID: \"9e6ad052-9fd5-4478-8002-f2546b4df236\") " pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:14.783012 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.782244    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/010ab407-03e3-4b9c-86e8-7e3419017c52-config\") pod \"service-ca-operator-5bcbc94c78-ztwzn\" (UID: \"010ab407-03e3-4b9c-86e8-7e3419017c52\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn"
Jul 20 19:01:14.783012 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.782250    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58e7255e-a59f-4b53-b234-b12f74f7c894-trusted-ca\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.783012 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.782374    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1805f53-670a-44fc-89d6-adac1bf3cddf-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-f7fls\" (UID: \"b1805f53-670a-44fc-89d6-adac1bf3cddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls"
Jul 20 19:01:14.783012 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.782484    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58e7255e-a59f-4b53-b234-b12f74f7c894-ca-trust-extracted\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.785547 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.782661    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b880cd4d-9983-4244-92e6-da9fcbc6539f-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.785547 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.782841    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58e7255e-a59f-4b53-b234-b12f74f7c894-ca-trust-extracted\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.785547 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.782863    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/010ab407-03e3-4b9c-86e8-7e3419017c52-config\") pod \"service-ca-operator-5bcbc94c78-ztwzn\" (UID: \"010ab407-03e3-4b9c-86e8-7e3419017c52\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn"
Jul 20 19:01:14.785547 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:14.783343    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 19:01:14.785547 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.783115    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e6ad052-9fd5-4478-8002-f2546b4df236-trusted-ca\") pod \"console-operator-565b7b569d-5nbcw\" (UID: \"9e6ad052-9fd5-4478-8002-f2546b4df236\") " pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:14.785547 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.783387    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b880cd4d-9983-4244-92e6-da9fcbc6539f-snapshots\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.785547 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:14.783407    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls podName:ea592eba-3f66-43c3-8235-7dee7375e218 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:15.283390377 +0000 UTC m=+38.079397701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-v966b" (UID: "ea592eba-3f66-43c3-8235-7dee7375e218") : secret "cluster-monitoring-operator-tls" not found
Jul 20 19:01:14.785547 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:14.783539    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle podName:9a882a69-59de-4dd8-9411-5f53baf13da5 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:15.283528191 +0000 UTC m=+38.079535518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle") pod "router-default-6985ddbc8-pvcb7" (UID: "9a882a69-59de-4dd8-9411-5f53baf13da5") : configmap references non-existent config key: service-ca.crt
Jul 20 19:01:14.785547 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:14.783603    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 19:01:14.785547 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:14.783633    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert podName:f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd nodeName:}" failed. No retries permitted until 2026-07-20 19:01:15.283624279 +0000 UTC m=+38.079631609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-t95nv" (UID: "f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd") : secret "networking-console-plugin-cert" not found
Jul 20 19:01:14.785547 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.783793    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b880cd4d-9983-4244-92e6-da9fcbc6539f-service-ca-bundle\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.785547 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:14.783885    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:14.786162 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:14.783926    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls podName:a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf nodeName:}" failed. No retries permitted until 2026-07-20 19:01:15.283911924 +0000 UTC m=+38.079919235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls") pod "dns-default-5lswm" (UID: "a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:14.786162 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.784007    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-t95nv\" (UID: \"f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv"
Jul 20 19:01:14.786162 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.784225    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-tmp-dir\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:14.786162 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:14.784599    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:01:14.786162 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:14.784615    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9689c95-tw9cj: secret "image-registry-tls" not found
Jul 20 19:01:14.786162 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:14.784720    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls podName:58e7255e-a59f-4b53-b234-b12f74f7c894 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:15.284702721 +0000 UTC m=+38.080710033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls") pod "image-registry-7d9689c95-tw9cj" (UID: "58e7255e-a59f-4b53-b234-b12f74f7c894") : secret "image-registry-tls" not found
Jul 20 19:01:14.786162 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.785031    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-certificates\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.786162 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.785905    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ea592eba-3f66-43c3-8235-7dee7375e218-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-v966b\" (UID: \"ea592eba-3f66-43c3-8235-7dee7375e218\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"
Jul 20 19:01:14.786623 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.786501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-config-volume\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:14.787612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.787559    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-default-certificate\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:14.788431 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.787950    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1805f53-670a-44fc-89d6-adac1bf3cddf-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-f7fls\" (UID: \"b1805f53-670a-44fc-89d6-adac1bf3cddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls"
Jul 20 19:01:14.788431 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.788070    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b880cd4d-9983-4244-92e6-da9fcbc6539f-serving-cert\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.788431 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.788137    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e6ad052-9fd5-4478-8002-f2546b4df236-serving-cert\") pod \"console-operator-565b7b569d-5nbcw\" (UID: \"9e6ad052-9fd5-4478-8002-f2546b4df236\") " pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:14.788431 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.788347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58e7255e-a59f-4b53-b234-b12f74f7c894-image-registry-private-configuration\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.788680 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.788580    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f188b329-3e3d-4340-8dcc-75ba3ba8d7c0-cert\") pod \"ingress-canary-9cnwf\" (UID: \"f188b329-3e3d-4340-8dcc-75ba3ba8d7c0\") " pod="openshift-ingress-canary/ingress-canary-9cnwf"
Jul 20 19:01:14.788851 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.788829    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/010ab407-03e3-4b9c-86e8-7e3419017c52-serving-cert\") pod \"service-ca-operator-5bcbc94c78-ztwzn\" (UID: \"010ab407-03e3-4b9c-86e8-7e3419017c52\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn"
Jul 20 19:01:14.789791 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.789772    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58e7255e-a59f-4b53-b234-b12f74f7c894-installation-pull-secrets\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.790070 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.790050    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-stats-auth\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:14.791937 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.791916    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9tq6\" (UniqueName: \"kubernetes.io/projected/ea592eba-3f66-43c3-8235-7dee7375e218-kube-api-access-h9tq6\") pod \"cluster-monitoring-operator-76cf8966f8-v966b\" (UID: \"ea592eba-3f66-43c3-8235-7dee7375e218\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"
Jul 20 19:01:14.792499 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.792450    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hphht\" (UniqueName: \"kubernetes.io/projected/b1805f53-670a-44fc-89d6-adac1bf3cddf-kube-api-access-hphht\") pod \"kube-storage-version-migrator-operator-7658d9b749-f7fls\" (UID: \"b1805f53-670a-44fc-89d6-adac1bf3cddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls"
Jul 20 19:01:14.792916 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.792901    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx7h8\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-kube-api-access-zx7h8\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.797414 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.797389    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrch4\" (UniqueName: \"kubernetes.io/projected/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-kube-api-access-xrch4\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:14.797644 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.797621    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlfdv\" (UniqueName: \"kubernetes.io/projected/f188b329-3e3d-4340-8dcc-75ba3ba8d7c0-kube-api-access-mlfdv\") pod \"ingress-canary-9cnwf\" (UID: \"f188b329-3e3d-4340-8dcc-75ba3ba8d7c0\") " pod="openshift-ingress-canary/ingress-canary-9cnwf"
Jul 20 19:01:14.798974 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.798947    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt868\" (UniqueName: \"kubernetes.io/projected/cc2e9a44-eb77-45b0-afe6-d3a8ea8d5ae0-kube-api-access-qt868\") pod \"volume-data-source-validator-78cf4c6f6-6g49j\" (UID: \"cc2e9a44-eb77-45b0-afe6-d3a8ea8d5ae0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6g49j"
Jul 20 19:01:14.802994 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.802063    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tbpt\" (UniqueName: \"kubernetes.io/projected/010ab407-03e3-4b9c-86e8-7e3419017c52-kube-api-access-8tbpt\") pod \"service-ca-operator-5bcbc94c78-ztwzn\" (UID: \"010ab407-03e3-4b9c-86e8-7e3419017c52\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn"
Jul 20 19:01:14.806728 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.803157    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-bound-sa-token\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:14.809755 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.809727    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhwhq\" (UniqueName: \"kubernetes.io/projected/9e6ad052-9fd5-4478-8002-f2546b4df236-kube-api-access-lhwhq\") pod \"console-operator-565b7b569d-5nbcw\" (UID: \"9e6ad052-9fd5-4478-8002-f2546b4df236\") " pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:14.809861 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.809838    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bldln\" (UniqueName: \"kubernetes.io/projected/b880cd4d-9983-4244-92e6-da9fcbc6539f-kube-api-access-bldln\") pod \"insights-operator-555d9d7885-hp5zw\" (UID: \"b880cd4d-9983-4244-92e6-da9fcbc6539f\") " pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.810430 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.810402    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p59d\" (UniqueName: \"kubernetes.io/projected/8d9ccc69-5ef1-4ab6-aa1d-ae68617c32f6-kube-api-access-5p59d\") pod \"network-check-source-7bc5b6bf85-v8pdx\" (UID: \"8d9ccc69-5ef1-4ab6-aa1d-ae68617c32f6\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-v8pdx"
Jul 20 19:01:14.811427 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.811400    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6rmt\" (UniqueName: \"kubernetes.io/projected/9a882a69-59de-4dd8-9411-5f53baf13da5-kube-api-access-b6rmt\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:14.811511 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.811455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr5wx\" (UniqueName: \"kubernetes.io/projected/331b36ec-7043-4009-b601-bb26eb569bfd-kube-api-access-tr5wx\") pod \"cluster-samples-operator-79b7c55f87-2gsnw\" (UID: \"331b36ec-7043-4009-b601-bb26eb569bfd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw"
Jul 20 19:01:14.881715 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.881679    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn"
Jul 20 19:01:14.900681 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.900659    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6g49j"
Jul 20 19:01:14.918872 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.918677    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-hp5zw"
Jul 20 19:01:14.933810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.933759    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:14.944327 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.944231    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls"
Jul 20 19:01:14.980567 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.980287    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9cnwf"
Jul 20 19:01:14.983302 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:14.983105    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-v8pdx"
Jul 20 19:01:15.122134 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.121734    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn"]
Jul 20 19:01:15.136494 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.136472    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6g49j"]
Jul 20 19:01:15.144381 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:01:15.144354    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc2e9a44_eb77_45b0_afe6_d3a8ea8d5ae0.slice/crio-5156a6919acb99c2e82332817a857520bb510b802d5f4a67d9133b437557ebd4 WatchSource:0}: Error finding container 5156a6919acb99c2e82332817a857520bb510b802d5f4a67d9133b437557ebd4: Status 404 returned error can't find the container with id 5156a6919acb99c2e82332817a857520bb510b802d5f4a67d9133b437557ebd4
Jul 20 19:01:15.154743 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.154042    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-hp5zw"]
Jul 20 19:01:15.158668 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:01:15.158638    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb880cd4d_9983_4244_92e6_da9fcbc6539f.slice/crio-b53ece2f34feee9e317b6b0435414f028b9ed5c4c49281d08e047a2da78837c7 WatchSource:0}: Error finding container b53ece2f34feee9e317b6b0435414f028b9ed5c4c49281d08e047a2da78837c7: Status 404 returned error can't find the container with id b53ece2f34feee9e317b6b0435414f028b9ed5c4c49281d08e047a2da78837c7
Jul 20 19:01:15.181277 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.180901    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-5nbcw"]
Jul 20 19:01:15.183367 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:01:15.183345    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e6ad052_9fd5_4478_8002_f2546b4df236.slice/crio-eef78f2b878dc372c2097f0da320a14c76c7c0c14b0d75f31ea4ecc092113328 WatchSource:0}: Error finding container eef78f2b878dc372c2097f0da320a14c76c7c0c14b0d75f31ea4ecc092113328: Status 404 returned error can't find the container with id eef78f2b878dc372c2097f0da320a14c76c7c0c14b0d75f31ea4ecc092113328
Jul 20 19:01:15.190615 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.190588    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls"]
Jul 20 19:01:15.192552 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:01:15.192518    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1805f53_670a_44fc_89d6_adac1bf3cddf.slice/crio-c175661bb940faad23a4f610bb36a730ae02dfb5388d3f2f7365b44d819efd2a WatchSource:0}: Error finding container c175661bb940faad23a4f610bb36a730ae02dfb5388d3f2f7365b44d819efd2a: Status 404 returned error can't find the container with id c175661bb940faad23a4f610bb36a730ae02dfb5388d3f2f7365b44d819efd2a
Jul 20 19:01:15.202648 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.202599    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9cnwf"]
Jul 20 19:01:15.204897 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:01:15.204873    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf188b329_3e3d_4340_8dcc_75ba3ba8d7c0.slice/crio-c13627efab68925ac84788ab54895292e64ce27a52d01212f1ac38f57dc4a076 WatchSource:0}: Error finding container c13627efab68925ac84788ab54895292e64ce27a52d01212f1ac38f57dc4a076: Status 404 returned error can't find the container with id c13627efab68925ac84788ab54895292e64ce27a52d01212f1ac38f57dc4a076
Jul 20 19:01:15.221990 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.221965    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-v8pdx"]
Jul 20 19:01:15.224683 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:01:15.224660    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d9ccc69_5ef1_4ab6_aa1d_ae68617c32f6.slice/crio-efe8329cf229c691e3492e53a3a45b56f462cd05147db6b707966ce5babda25d WatchSource:0}: Error finding container efe8329cf229c691e3492e53a3a45b56f462cd05147db6b707966ce5babda25d: Status 404 returned error can't find the container with id efe8329cf229c691e3492e53a3a45b56f462cd05147db6b707966ce5babda25d
Jul 20 19:01:15.289725 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.289696    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v966b\" (UID: \"ea592eba-3f66-43c3-8235-7dee7375e218\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"
Jul 20 19:01:15.289832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.289734    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:15.289832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.289762    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:15.289832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.289789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:15.289973 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.289848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2gsnw\" (UID: \"331b36ec-7043-4009-b601-bb26eb569bfd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw"
Jul 20 19:01:15.289973 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:15.289866    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 19:01:15.289973 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.289890    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:15.289973 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:15.289931    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls podName:ea592eba-3f66-43c3-8235-7dee7375e218 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:16.289911552 +0000 UTC m=+39.085918877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-v966b" (UID: "ea592eba-3f66-43c3-8235-7dee7375e218") : secret "cluster-monitoring-operator-tls" not found
Jul 20 19:01:15.290199 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.290006    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t95nv\" (UID: \"f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv"
Jul 20 19:01:15.290199 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:15.290111    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 19:01:15.290199 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:15.290180    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert podName:f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd nodeName:}" failed. No retries permitted until 2026-07-20 19:01:16.290165471 +0000 UTC m=+39.086172799 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-t95nv" (UID: "f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd") : secret "networking-console-plugin-cert" not found
Jul 20 19:01:15.290354 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:15.290254    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle podName:9a882a69-59de-4dd8-9411-5f53baf13da5 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:16.290242231 +0000 UTC m=+39.086249545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle") pod "router-default-6985ddbc8-pvcb7" (UID: "9a882a69-59de-4dd8-9411-5f53baf13da5") : configmap references non-existent config key: service-ca.crt
Jul 20 19:01:15.290354 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:15.290272    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:01:15.290354 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:15.290285    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9689c95-tw9cj: secret "image-registry-tls" not found
Jul 20 19:01:15.290354 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:15.290317    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 19:01:15.290354 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:15.290328    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls podName:58e7255e-a59f-4b53-b234-b12f74f7c894 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:16.290311985 +0000 UTC m=+39.086319299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls") pod "image-registry-7d9689c95-tw9cj" (UID: "58e7255e-a59f-4b53-b234-b12f74f7c894") : secret "image-registry-tls" not found
Jul 20 19:01:15.290354 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:15.290351    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls podName:331b36ec-7043-4009-b601-bb26eb569bfd nodeName:}" failed. No retries permitted until 2026-07-20 19:01:16.290340745 +0000 UTC m=+39.086348070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2gsnw" (UID: "331b36ec-7043-4009-b601-bb26eb569bfd") : secret "samples-operator-tls" not found
Jul 20 19:01:15.290594 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:15.290407    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:15.290594 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:15.290438    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls podName:a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf nodeName:}" failed. No retries permitted until 2026-07-20 19:01:16.290427712 +0000 UTC m=+39.086435065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls") pod "dns-default-5lswm" (UID: "a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:15.290594 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:15.290405    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 19:01:15.290594 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:15.290474    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs podName:9a882a69-59de-4dd8-9411-5f53baf13da5 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:16.290465341 +0000 UTC m=+39.086472656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs") pod "router-default-6985ddbc8-pvcb7" (UID: "9a882a69-59de-4dd8-9411-5f53baf13da5") : secret "router-metrics-certs-default" not found
Jul 20 19:01:15.734102 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.734066    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:01:15.734102 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.734104    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:01:15.736550 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.736503    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 19:01:15.736691 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.736551    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-74mbs\""
Jul 20 19:01:15.736691 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.736556    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s7pj6\""
Jul 20 19:01:15.913342 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.913301    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9cnwf" event={"ID":"f188b329-3e3d-4340-8dcc-75ba3ba8d7c0","Type":"ContainerStarted","Data":"c13627efab68925ac84788ab54895292e64ce27a52d01212f1ac38f57dc4a076"}
Jul 20 19:01:15.914991 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.914958    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls" event={"ID":"b1805f53-670a-44fc-89d6-adac1bf3cddf","Type":"ContainerStarted","Data":"c175661bb940faad23a4f610bb36a730ae02dfb5388d3f2f7365b44d819efd2a"}
Jul 20 19:01:15.916958 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.916927    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-hp5zw" event={"ID":"b880cd4d-9983-4244-92e6-da9fcbc6539f","Type":"ContainerStarted","Data":"b53ece2f34feee9e317b6b0435414f028b9ed5c4c49281d08e047a2da78837c7"}
Jul 20 19:01:15.918374 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.918326    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-5nbcw" event={"ID":"9e6ad052-9fd5-4478-8002-f2546b4df236","Type":"ContainerStarted","Data":"eef78f2b878dc372c2097f0da320a14c76c7c0c14b0d75f31ea4ecc092113328"}
Jul 20 19:01:15.920257 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.920205    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6g49j" event={"ID":"cc2e9a44-eb77-45b0-afe6-d3a8ea8d5ae0","Type":"ContainerStarted","Data":"5156a6919acb99c2e82332817a857520bb510b802d5f4a67d9133b437557ebd4"}
Jul 20 19:01:15.923171 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.923106    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn" event={"ID":"010ab407-03e3-4b9c-86e8-7e3419017c52","Type":"ContainerStarted","Data":"f6a8d52258c060c046e6a7bfad782fa96c803259f22550a5fa6e590d50652a58"}
Jul 20 19:01:15.924690 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:15.924663    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-v8pdx" event={"ID":"8d9ccc69-5ef1-4ab6-aa1d-ae68617c32f6","Type":"ContainerStarted","Data":"efe8329cf229c691e3492e53a3a45b56f462cd05147db6b707966ce5babda25d"}
Jul 20 19:01:16.298568 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:16.298301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t95nv\" (UID: \"f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv"
Jul 20 19:01:16.298568 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:16.298356    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v966b\" (UID: \"ea592eba-3f66-43c3-8235-7dee7375e218\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"
Jul 20 19:01:16.298568 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:16.298388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:16.298568 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:16.298414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:16.298568 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:16.298445    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:16.298568 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:16.298506    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 19:01:16.298991 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:16.298584    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert podName:f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd nodeName:}" failed. No retries permitted until 2026-07-20 19:01:18.298562213 +0000 UTC m=+41.094569528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-t95nv" (UID: "f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd") : secret "networking-console-plugin-cert" not found
Jul 20 19:01:16.298991 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:16.298593    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 19:01:16.298991 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:16.298642    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls podName:331b36ec-7043-4009-b601-bb26eb569bfd nodeName:}" failed. No retries permitted until 2026-07-20 19:01:18.298627583 +0000 UTC m=+41.094634894 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2gsnw" (UID: "331b36ec-7043-4009-b601-bb26eb569bfd") : secret "samples-operator-tls" not found
Jul 20 19:01:16.298991 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:16.298697    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 19:01:16.298991 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:16.298728    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls podName:ea592eba-3f66-43c3-8235-7dee7375e218 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:18.298718206 +0000 UTC m=+41.094725538 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-v966b" (UID: "ea592eba-3f66-43c3-8235-7dee7375e218") : secret "cluster-monitoring-operator-tls" not found
Jul 20 19:01:16.298991 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:16.298788    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle podName:9a882a69-59de-4dd8-9411-5f53baf13da5 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:18.298777286 +0000 UTC m=+41.094784603 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle") pod "router-default-6985ddbc8-pvcb7" (UID: "9a882a69-59de-4dd8-9411-5f53baf13da5") : configmap references non-existent config key: service-ca.crt
Jul 20 19:01:16.298991 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:16.298849    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:01:16.298991 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:16.298860    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9689c95-tw9cj: secret "image-registry-tls" not found
Jul 20 19:01:16.298991 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:16.298890    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls podName:58e7255e-a59f-4b53-b234-b12f74f7c894 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:18.298880197 +0000 UTC m=+41.094887521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls") pod "image-registry-7d9689c95-tw9cj" (UID: "58e7255e-a59f-4b53-b234-b12f74f7c894") : secret "image-registry-tls" not found
Jul 20 19:01:16.298991 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:16.298512    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2gsnw\" (UID: \"331b36ec-7043-4009-b601-bb26eb569bfd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw"
Jul 20 19:01:16.298991 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:16.298964    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:16.298991 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:16.298973    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:16.299576 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:16.298996    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls podName:a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf nodeName:}" failed. No retries permitted until 2026-07-20 19:01:18.29898644 +0000 UTC m=+41.094993752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls") pod "dns-default-5lswm" (UID: "a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:16.299576 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:16.299050    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 19:01:16.299576 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:16.299091    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs podName:9a882a69-59de-4dd8-9411-5f53baf13da5 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:18.29907819 +0000 UTC m=+41.095085502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs") pod "router-default-6985ddbc8-pvcb7" (UID: "9a882a69-59de-4dd8-9411-5f53baf13da5") : secret "router-metrics-certs-default" not found
Jul 20 19:01:18.318609 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:18.318579    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2gsnw\" (UID: \"331b36ec-7043-4009-b601-bb26eb569bfd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw"
Jul 20 19:01:18.318978 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:18.318625    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:18.318978 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:18.318720    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 19:01:18.318978 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:18.318726    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 19:01:18.318978 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:18.318774    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs podName:9a882a69-59de-4dd8-9411-5f53baf13da5 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:22.318759233 +0000 UTC m=+45.114766550 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs") pod "router-default-6985ddbc8-pvcb7" (UID: "9a882a69-59de-4dd8-9411-5f53baf13da5") : secret "router-metrics-certs-default" not found
Jul 20 19:01:18.318978 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:18.318817    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t95nv\" (UID: \"f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv"
Jul 20 19:01:18.318978 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:18.318856    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls podName:331b36ec-7043-4009-b601-bb26eb569bfd nodeName:}" failed. No retries permitted until 2026-07-20 19:01:22.318843799 +0000 UTC m=+45.114851124 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2gsnw" (UID: "331b36ec-7043-4009-b601-bb26eb569bfd") : secret "samples-operator-tls" not found
Jul 20 19:01:18.318978 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:18.318879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v966b\" (UID: \"ea592eba-3f66-43c3-8235-7dee7375e218\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"
Jul 20 19:01:18.318978 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:18.318904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:18.318978 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:18.318921    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 19:01:18.318978 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:18.318932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:18.318978 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:18.318957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:18.318978 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:18.318975    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert podName:f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd nodeName:}" failed. No retries permitted until 2026-07-20 19:01:22.318962088 +0000 UTC m=+45.114969413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-t95nv" (UID: "f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd") : secret "networking-console-plugin-cert" not found
Jul 20 19:01:18.318978 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:18.318986    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 19:01:18.319526 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:18.319015    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:18.319526 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:18.319036    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls podName:ea592eba-3f66-43c3-8235-7dee7375e218 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:22.319022368 +0000 UTC m=+45.115029686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-v966b" (UID: "ea592eba-3f66-43c3-8235-7dee7375e218") : secret "cluster-monitoring-operator-tls" not found
Jul 20 19:01:18.319526 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:18.319061    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls podName:a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf nodeName:}" failed. No retries permitted until 2026-07-20 19:01:22.319049903 +0000 UTC m=+45.115057214 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls") pod "dns-default-5lswm" (UID: "a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:18.319526 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:18.319079    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:01:18.319526 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:18.319091    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9689c95-tw9cj: secret "image-registry-tls" not found
Jul 20 19:01:18.319526 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:18.319092    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle podName:9a882a69-59de-4dd8-9411-5f53baf13da5 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:22.31908242 +0000 UTC m=+45.115089731 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle") pod "router-default-6985ddbc8-pvcb7" (UID: "9a882a69-59de-4dd8-9411-5f53baf13da5") : configmap references non-existent config key: service-ca.crt
Jul 20 19:01:18.319526 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:18.319148    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls podName:58e7255e-a59f-4b53-b234-b12f74f7c894 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:22.31913785 +0000 UTC m=+45.115145160 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls") pod "image-registry-7d9689c95-tw9cj" (UID: "58e7255e-a59f-4b53-b234-b12f74f7c894") : secret "image-registry-tls" not found
Jul 20 19:01:20.741778 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:20.741739    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret\") pod \"global-pull-secret-syncer-gtmfg\" (UID: \"bd4662d5-a409-4422-a2a5-47356519bf53\") " pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:01:20.745405 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:20.745374    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4662d5-a409-4422-a2a5-47356519bf53-original-pull-secret\") pod \"global-pull-secret-syncer-gtmfg\" (UID: \"bd4662d5-a409-4422-a2a5-47356519bf53\") " pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:01:21.043919 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:21.043841    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtmfg"
Jul 20 19:01:22.354918 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:22.354869    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t95nv\" (UID: \"f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv"
Jul 20 19:01:22.355517 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:22.354927    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v966b\" (UID: \"ea592eba-3f66-43c3-8235-7dee7375e218\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"
Jul 20 19:01:22.355517 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:22.354956    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:22.355517 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:22.354980    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:22.355517 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:22.355007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:22.355517 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:22.355023    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 19:01:22.355517 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:22.355054    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2gsnw\" (UID: \"331b36ec-7043-4009-b601-bb26eb569bfd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw"
Jul 20 19:01:22.355517 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:22.355092    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert podName:f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd nodeName:}" failed. No retries permitted until 2026-07-20 19:01:30.355073409 +0000 UTC m=+53.151080741 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-t95nv" (UID: "f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd") : secret "networking-console-plugin-cert" not found
Jul 20 19:01:22.355517 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:22.355104    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 19:01:22.355517 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:22.355137    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:22.355517 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:22.355149    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 19:01:22.355517 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:22.355164    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle podName:9a882a69-59de-4dd8-9411-5f53baf13da5 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:30.355145554 +0000 UTC m=+53.151152884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle") pod "router-default-6985ddbc8-pvcb7" (UID: "9a882a69-59de-4dd8-9411-5f53baf13da5") : configmap references non-existent config key: service-ca.crt
Jul 20 19:01:22.355517 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:22.355191    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls podName:331b36ec-7043-4009-b601-bb26eb569bfd nodeName:}" failed. No retries permitted until 2026-07-20 19:01:30.355181801 +0000 UTC m=+53.151189112 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2gsnw" (UID: "331b36ec-7043-4009-b601-bb26eb569bfd") : secret "samples-operator-tls" not found
Jul 20 19:01:22.355517 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:22.355192    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 19:01:22.356056 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:22.355206    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls podName:ea592eba-3f66-43c3-8235-7dee7375e218 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:30.355198547 +0000 UTC m=+53.151205873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-v966b" (UID: "ea592eba-3f66-43c3-8235-7dee7375e218") : secret "cluster-monitoring-operator-tls" not found
Jul 20 19:01:22.356056 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:22.355228    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:01:22.356056 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:22.355240    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:22.356056 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:22.355234    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs podName:9a882a69-59de-4dd8-9411-5f53baf13da5 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:30.355221105 +0000 UTC m=+53.151228429 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs") pod "router-default-6985ddbc8-pvcb7" (UID: "9a882a69-59de-4dd8-9411-5f53baf13da5") : secret "router-metrics-certs-default" not found
Jul 20 19:01:22.356056 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:22.355250    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9689c95-tw9cj: secret "image-registry-tls" not found
Jul 20 19:01:22.356056 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:22.355326    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls podName:58e7255e-a59f-4b53-b234-b12f74f7c894 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:30.355310532 +0000 UTC m=+53.151317848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls") pod "image-registry-7d9689c95-tw9cj" (UID: "58e7255e-a59f-4b53-b234-b12f74f7c894") : secret "image-registry-tls" not found
Jul 20 19:01:22.356056 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:22.355355    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls podName:a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf nodeName:}" failed. No retries permitted until 2026-07-20 19:01:30.355339008 +0000 UTC m=+53.151346319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls") pod "dns-default-5lswm" (UID: "a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:24.069881 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:24.069855    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gtmfg"]
Jul 20 19:01:24.072447 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:01:24.072414    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd4662d5_a409_4422_a2a5_47356519bf53.slice/crio-8671e24011e1ae24a8ec51834f4bfc12bea0e9bd73207ab088ee0a348c0c3c48 WatchSource:0}: Error finding container 8671e24011e1ae24a8ec51834f4bfc12bea0e9bd73207ab088ee0a348c0c3c48: Status 404 returned error can't find the container with id 8671e24011e1ae24a8ec51834f4bfc12bea0e9bd73207ab088ee0a348c0c3c48
Jul 20 19:01:24.953463 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:24.953316    2560 generic.go:356] "Generic (PLEG): container finished" podID="e0848dc8-f613-4656-aa5e-c122e5b2650a" containerID="a0e7953c7a2fb503103eec8880b63a42c95e8157e52aad8314b4fba311ed8cbd" exitCode=0
Jul 20 19:01:24.953463 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:24.953398    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g85p9" event={"ID":"e0848dc8-f613-4656-aa5e-c122e5b2650a","Type":"ContainerDied","Data":"a0e7953c7a2fb503103eec8880b63a42c95e8157e52aad8314b4fba311ed8cbd"}
Jul 20 19:01:24.956417 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:24.956102    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/0.log"
Jul 20 19:01:24.956417 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:24.956155    2560 generic.go:356] "Generic (PLEG): container finished" podID="9e6ad052-9fd5-4478-8002-f2546b4df236" containerID="1a51f6612228e8c94a8f9a28722e18d1d4b054226347abe8b1f740fccddea4cd" exitCode=255
Jul 20 19:01:24.956417 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:24.956227    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-5nbcw" event={"ID":"9e6ad052-9fd5-4478-8002-f2546b4df236","Type":"ContainerDied","Data":"1a51f6612228e8c94a8f9a28722e18d1d4b054226347abe8b1f740fccddea4cd"}
Jul 20 19:01:24.956594 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:24.956503    2560 scope.go:117] "RemoveContainer" containerID="1a51f6612228e8c94a8f9a28722e18d1d4b054226347abe8b1f740fccddea4cd"
Jul 20 19:01:24.959557 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:24.959083    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6g49j" event={"ID":"cc2e9a44-eb77-45b0-afe6-d3a8ea8d5ae0","Type":"ContainerStarted","Data":"fc47c0358a9db3d80a4d6ca744883f48cc32c7d216282b564f08d1a30de7dacd"}
Jul 20 19:01:24.960672 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:24.960603    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gtmfg" event={"ID":"bd4662d5-a409-4422-a2a5-47356519bf53","Type":"ContainerStarted","Data":"8671e24011e1ae24a8ec51834f4bfc12bea0e9bd73207ab088ee0a348c0c3c48"}
Jul 20 19:01:24.962133 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:24.962091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn" event={"ID":"010ab407-03e3-4b9c-86e8-7e3419017c52","Type":"ContainerStarted","Data":"a0dbaf3aa40dc680017755ce7303c1ddf6e1012ba8d1de6f89564fc3d6c6c1ef"}
Jul 20 19:01:24.963394 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:24.963372    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-v8pdx" event={"ID":"8d9ccc69-5ef1-4ab6-aa1d-ae68617c32f6","Type":"ContainerStarted","Data":"916dce929d576f610c541b9abbe1e9581d294316103f71041f1432f2feeea2d0"}
Jul 20 19:01:24.964840 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:24.964819    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9cnwf" event={"ID":"f188b329-3e3d-4340-8dcc-75ba3ba8d7c0","Type":"ContainerStarted","Data":"f14163eb100364dab84ecbec3eb28a82de34d688a9b9c83417bcdb1c50d52a18"}
Jul 20 19:01:24.966016 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:24.965997    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls" event={"ID":"b1805f53-670a-44fc-89d6-adac1bf3cddf","Type":"ContainerStarted","Data":"524dccfb02f2afef79922783abbd78123fb81bf6d8970bbef4de508ecc2d5bf9"}
Jul 20 19:01:24.967234 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:24.967215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-hp5zw" event={"ID":"b880cd4d-9983-4244-92e6-da9fcbc6539f","Type":"ContainerStarted","Data":"4069ee27f980477ac0b8192c7c8fe3236eb19b7748d062ef21f85460ab23171c"}
Jul 20 19:01:25.017023 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.014260    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-6g49j" podStartSLOduration=18.22115232 podStartE2EDuration="27.014243227s" totalImagesPullingTime="8.793090907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:24.991196577 +0000 UTC m=+47.787203916" watchObservedRunningTime="2026-07-20 19:01:25.014243227 +0000 UTC m=+47.810250557"
Jul 20 19:01:25.058082 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.057167    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls" podStartSLOduration=18.30429205 podStartE2EDuration="27.05714822s" totalImagesPullingTime="8.75285617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:25.034258122 +0000 UTC m=+47.830265457" watchObservedRunningTime="2026-07-20 19:01:25.05714822 +0000 UTC m=+47.853155554"
Jul 20 19:01:25.058082 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.057566    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn" podStartSLOduration=18.291265855 podStartE2EDuration="27.057558052s" totalImagesPullingTime="8.766292197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:25.056633972 +0000 UTC m=+47.852641305" watchObservedRunningTime="2026-07-20 19:01:25.057558052 +0000 UTC m=+47.853565387"
Jul 20 19:01:25.112387 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.112033    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9cnwf" podStartSLOduration=2.371510992 podStartE2EDuration="11.112014945s" totalImagesPullingTime="8.740503953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:25.095172077 +0000 UTC m=+47.891179411" watchObservedRunningTime="2026-07-20 19:01:25.112014945 +0000 UTC m=+47.908022276"
Jul 20 19:01:25.112387 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.112157    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-v8pdx" podStartSLOduration=18.388216814 podStartE2EDuration="27.112150534s" totalImagesPullingTime="8.72393372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:25.112102843 +0000 UTC m=+47.908110176" watchObservedRunningTime="2026-07-20 19:01:25.112150534 +0000 UTC m=+47.908157868"
Jul 20 19:01:25.132331 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.130772    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-hp5zw" podStartSLOduration=18.338582477 podStartE2EDuration="27.130754018s" totalImagesPullingTime="8.792171541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:25.129905425 +0000 UTC m=+47.925912775" watchObservedRunningTime="2026-07-20 19:01:25.130754018 +0000 UTC m=+47.926761351"
Jul 20 19:01:25.399730 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.399308    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8n78l"]
Jul 20 19:01:25.421380 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.421350    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8n78l"]
Jul 20 19:01:25.421542 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.421479    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:25.425498 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.425268    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 19:01:25.425498 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.425288    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-skgq8\""
Jul 20 19:01:25.425498 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.425444    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 19:01:25.586301 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.586235    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d2g2\" (UniqueName: \"kubernetes.io/projected/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-api-access-9d2g2\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:25.586301 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.586291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-data-volume\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:25.586523 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.586354    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:25.586523 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.586404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-crio-socket\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:25.586523 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.586501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:25.687829 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.687761    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:25.687956 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.687844    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d2g2\" (UniqueName: \"kubernetes.io/projected/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-api-access-9d2g2\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:25.687956 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:25.687886    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:01:25.687956 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.687900    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-data-volume\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:25.687956 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:25.687955    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-rbac-proxy-cm podName:b9dffe8c-6686-4451-a0d1-8fa4100c0b88 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:26.187939155 +0000 UTC m=+48.983946466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8n78l" (UID: "b9dffe8c-6686-4451-a0d1-8fa4100c0b88") : configmap "kube-rbac-proxy" not found
Jul 20 19:01:25.688184 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.687974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:25.688184 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.688019    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-crio-socket\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:25.688184 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.688107    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-crio-socket\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:25.688341 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.688192    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-data-volume\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:25.688341 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:25.688253    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:25.688341 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:25.688333    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls podName:b9dffe8c-6686-4451-a0d1-8fa4100c0b88 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:26.188315734 +0000 UTC m=+48.984323061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8n78l" (UID: "b9dffe8c-6686-4451-a0d1-8fa4100c0b88") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:25.699068 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.699045    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d2g2\" (UniqueName: \"kubernetes.io/projected/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-api-access-9d2g2\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:25.973818 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.973789    2560 generic.go:356] "Generic (PLEG): container finished" podID="e0848dc8-f613-4656-aa5e-c122e5b2650a" containerID="e2dfb37583e966b3ec7c99e1f220b1fcff4b312e884588bd5c99f67787b6833a" exitCode=0
Jul 20 19:01:25.973970 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.973871    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g85p9" event={"ID":"e0848dc8-f613-4656-aa5e-c122e5b2650a","Type":"ContainerDied","Data":"e2dfb37583e966b3ec7c99e1f220b1fcff4b312e884588bd5c99f67787b6833a"}
Jul 20 19:01:25.975553 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.975490    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:01:25.975900 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.975881    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/0.log"
Jul 20 19:01:25.975987 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.975912    2560 generic.go:356] "Generic (PLEG): container finished" podID="9e6ad052-9fd5-4478-8002-f2546b4df236" containerID="f9bb8e4488097029b825e4a80f732571af1a1d48b3c99898619c2cb4971802e0" exitCode=255
Jul 20 19:01:25.975987 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.975973    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-5nbcw" event={"ID":"9e6ad052-9fd5-4478-8002-f2546b4df236","Type":"ContainerDied","Data":"f9bb8e4488097029b825e4a80f732571af1a1d48b3c99898619c2cb4971802e0"}
Jul 20 19:01:25.976100 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.976018    2560 scope.go:117] "RemoveContainer" containerID="1a51f6612228e8c94a8f9a28722e18d1d4b054226347abe8b1f740fccddea4cd"
Jul 20 19:01:25.976265 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:25.976250    2560 scope.go:117] "RemoveContainer" containerID="f9bb8e4488097029b825e4a80f732571af1a1d48b3c99898619c2cb4971802e0"
Jul 20 19:01:25.976417 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:25.976398    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-5nbcw_openshift-console-operator(9e6ad052-9fd5-4478-8002-f2546b4df236)\"" pod="openshift-console-operator/console-operator-565b7b569d-5nbcw" podUID="9e6ad052-9fd5-4478-8002-f2546b4df236"
Jul 20 19:01:26.194096 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:26.193479    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:26.194096 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:26.193709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:26.194096 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:26.193798    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:26.194096 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:26.193846    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls podName:b9dffe8c-6686-4451-a0d1-8fa4100c0b88 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:27.193830142 +0000 UTC m=+49.989837467 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8n78l" (UID: "b9dffe8c-6686-4451-a0d1-8fa4100c0b88") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:26.194096 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:26.194086    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:01:26.194691 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:26.194157    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-rbac-proxy-cm podName:b9dffe8c-6686-4451-a0d1-8fa4100c0b88 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:27.194139426 +0000 UTC m=+49.990146743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8n78l" (UID: "b9dffe8c-6686-4451-a0d1-8fa4100c0b88") : configmap "kube-rbac-proxy" not found
Jul 20 19:01:26.983187 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:26.983152    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g85p9" event={"ID":"e0848dc8-f613-4656-aa5e-c122e5b2650a","Type":"ContainerStarted","Data":"c4321d1093a3c40ca2784bafc121d7adff1cdceea45561992780b46ad5c9cf58"}
Jul 20 19:01:26.984722 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:26.984700    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:01:26.985015 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:26.984993    2560 scope.go:117] "RemoveContainer" containerID="f9bb8e4488097029b825e4a80f732571af1a1d48b3c99898619c2cb4971802e0"
Jul 20 19:01:26.985223 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:26.985198    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-5nbcw_openshift-console-operator(9e6ad052-9fd5-4478-8002-f2546b4df236)\"" pod="openshift-console-operator/console-operator-565b7b569d-5nbcw" podUID="9e6ad052-9fd5-4478-8002-f2546b4df236"
Jul 20 19:01:27.009586 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:27.009542    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g85p9" podStartSLOduration=7.480893471 podStartE2EDuration="48.009526826s" totalImagesPullingTime="40.528633355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:27.008692988 +0000 UTC m=+49.804700323" watchObservedRunningTime="2026-07-20 19:01:27.009526826 +0000 UTC m=+49.805534159"
Jul 20 19:01:27.203817 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:27.203780    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:27.204253 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:27.203882    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:27.204253 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:27.203930    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:27.204253 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:27.204012    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls podName:b9dffe8c-6686-4451-a0d1-8fa4100c0b88 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:29.203989059 +0000 UTC m=+51.999996383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8n78l" (UID: "b9dffe8c-6686-4451-a0d1-8fa4100c0b88") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:27.204253 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:27.203959    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:01:27.204253 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:27.204110    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-rbac-proxy-cm podName:b9dffe8c-6686-4451-a0d1-8fa4100c0b88 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:29.204097033 +0000 UTC m=+52.000104344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8n78l" (UID: "b9dffe8c-6686-4451-a0d1-8fa4100c0b88") : configmap "kube-rbac-proxy" not found
Jul 20 19:01:27.587488 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:27.587460    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vt7z5_7a05c4ac-04f4-4ff5-adc2-411cffcb815c/dns-node-resolver/0.log"
Jul 20 19:01:28.387412 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:28.387372    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-87ghh_510bef60-8698-405f-a2bd-7200700ecb52/node-ca/0.log"
Jul 20 19:01:29.188489 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:29.188464    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9cnwf_f188b329-3e3d-4340-8dcc-75ba3ba8d7c0/serve-healthcheck-canary/0.log"
Jul 20 19:01:29.224567 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:29.224541    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:29.224690 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:29.224653    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 19:01:29.224730 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:29.224694    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:29.224730 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:29.224705    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-rbac-proxy-cm podName:b9dffe8c-6686-4451-a0d1-8fa4100c0b88 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:33.224692481 +0000 UTC m=+56.020699795 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8n78l" (UID: "b9dffe8c-6686-4451-a0d1-8fa4100c0b88") : configmap "kube-rbac-proxy" not found
Jul 20 19:01:29.224823 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:29.224766    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:29.224823 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:29.224815    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls podName:b9dffe8c-6686-4451-a0d1-8fa4100c0b88 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:33.224802526 +0000 UTC m=+56.020809840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8n78l" (UID: "b9dffe8c-6686-4451-a0d1-8fa4100c0b88") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:29.997295 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:29.997257    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gtmfg" event={"ID":"bd4662d5-a409-4422-a2a5-47356519bf53","Type":"ContainerStarted","Data":"98b0740837b4053678353da97f2f4acff00e6d7651eae01be96f64e44e0f9338"}
Jul 20 19:01:30.015648 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:30.015600    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gtmfg" podStartSLOduration=36.724519722 podStartE2EDuration="42.015587058s" totalImagesPullingTime="5.291067336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:30.014776517 +0000 UTC m=+52.810783850" watchObservedRunningTime="2026-07-20 19:01:30.015587058 +0000 UTC m=+52.811594368"
Jul 20 19:01:30.436025 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:30.435947    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:30.436025 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:30.436024    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t95nv\" (UID: \"f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv"
Jul 20 19:01:30.436257 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:30.436049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v966b\" (UID: \"ea592eba-3f66-43c3-8235-7dee7375e218\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"
Jul 20 19:01:30.436257 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:30.436073    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:30.436257 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:30.436091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:30.436257 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:30.436109    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:30.436257 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:30.436089    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 19:01:30.436257 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:30.436166    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2gsnw\" (UID: \"331b36ec-7043-4009-b601-bb26eb569bfd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw"
Jul 20 19:01:30.436257 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:30.436186    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 19:01:30.436257 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:30.436207    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 19:01:30.436257 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:30.436225    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle podName:9a882a69-59de-4dd8-9411-5f53baf13da5 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:46.436204673 +0000 UTC m=+69.232211985 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle") pod "router-default-6985ddbc8-pvcb7" (UID: "9a882a69-59de-4dd8-9411-5f53baf13da5") : configmap references non-existent config key: service-ca.crt
Jul 20 19:01:30.436257 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:30.436210    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 19:01:30.436257 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:30.436250    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs podName:9a882a69-59de-4dd8-9411-5f53baf13da5 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:46.436239064 +0000 UTC m=+69.232246375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs") pod "router-default-6985ddbc8-pvcb7" (UID: "9a882a69-59de-4dd8-9411-5f53baf13da5") : secret "router-metrics-certs-default" not found
Jul 20 19:01:30.436257 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:30.436227    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9689c95-tw9cj: secret "image-registry-tls" not found
Jul 20 19:01:30.436257 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:30.436265    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert podName:f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd nodeName:}" failed. No retries permitted until 2026-07-20 19:01:46.436257093 +0000 UTC m=+69.232264404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-t95nv" (UID: "f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd") : secret "networking-console-plugin-cert" not found
Jul 20 19:01:30.436724 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:30.436281    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls podName:a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf nodeName:}" failed. No retries permitted until 2026-07-20 19:01:46.436273575 +0000 UTC m=+69.232280885 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls") pod "dns-default-5lswm" (UID: "a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf") : secret "dns-default-metrics-tls" not found
Jul 20 19:01:30.436724 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:30.436158    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 19:01:30.436724 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:30.436297    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls podName:58e7255e-a59f-4b53-b234-b12f74f7c894 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:46.436288574 +0000 UTC m=+69.232295886 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls") pod "image-registry-7d9689c95-tw9cj" (UID: "58e7255e-a59f-4b53-b234-b12f74f7c894") : secret "image-registry-tls" not found
Jul 20 19:01:30.436724 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:30.436323    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls podName:ea592eba-3f66-43c3-8235-7dee7375e218 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:46.436305327 +0000 UTC m=+69.232312651 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-v966b" (UID: "ea592eba-3f66-43c3-8235-7dee7375e218") : secret "cluster-monitoring-operator-tls" not found
Jul 20 19:01:30.436724 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:30.436238    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 19:01:30.436724 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:30.436362    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls podName:331b36ec-7043-4009-b601-bb26eb569bfd nodeName:}" failed. No retries permitted until 2026-07-20 19:01:46.436351783 +0000 UTC m=+69.232359098 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2gsnw" (UID: "331b36ec-7043-4009-b601-bb26eb569bfd") : secret "samples-operator-tls" not found
Jul 20 19:01:33.260359 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:33.260318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:33.260831 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:33.260419    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:33.260831 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:33.260515    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:33.260831 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:33.260563    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls podName:b9dffe8c-6686-4451-a0d1-8fa4100c0b88 nodeName:}" failed. No retries permitted until 2026-07-20 19:01:41.260551106 +0000 UTC m=+64.056558417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8n78l" (UID: "b9dffe8c-6686-4451-a0d1-8fa4100c0b88") : secret "insights-runtime-extractor-tls" not found
Jul 20 19:01:33.260983 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:33.260843    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:34.934907 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:34.934877    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:34.935363 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:34.934936    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:34.935363 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:34.935304    2560 scope.go:117] "RemoveContainer" containerID="f9bb8e4488097029b825e4a80f732571af1a1d48b3c99898619c2cb4971802e0"
Jul 20 19:01:34.935486 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:34.935463    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-5nbcw_openshift-console-operator(9e6ad052-9fd5-4478-8002-f2546b4df236)\"" pod="openshift-console-operator/console-operator-565b7b569d-5nbcw" podUID="9e6ad052-9fd5-4478-8002-f2546b4df236"
Jul 20 19:01:35.012425 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:35.012401    2560 scope.go:117] "RemoveContainer" containerID="f9bb8e4488097029b825e4a80f732571af1a1d48b3c99898619c2cb4971802e0"
Jul 20 19:01:35.012570 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:01:35.012537    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-5nbcw_openshift-console-operator(9e6ad052-9fd5-4478-8002-f2546b4df236)\"" pod="openshift-console-operator/console-operator-565b7b569d-5nbcw" podUID="9e6ad052-9fd5-4478-8002-f2546b4df236"
Jul 20 19:01:38.908968 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:38.908941    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7jhvx"
Jul 20 19:01:41.327277 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:41.327240    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:41.329491 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:41.329471    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9dffe8c-6686-4451-a0d1-8fa4100c0b88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8n78l\" (UID: \"b9dffe8c-6686-4451-a0d1-8fa4100c0b88\") " pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:41.335830 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:41.335808    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-skgq8\""
Jul 20 19:01:41.343692 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:41.343674    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8n78l"
Jul 20 19:01:41.489434 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:41.489371    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8n78l"]
Jul 20 19:01:41.491751 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:01:41.491730    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9dffe8c_6686_4451_a0d1_8fa4100c0b88.slice/crio-1c739b5ff4abf91d30a0b0362ca32e3e0752a865737bbf58844364510101d486 WatchSource:0}: Error finding container 1c739b5ff4abf91d30a0b0362ca32e3e0752a865737bbf58844364510101d486: Status 404 returned error can't find the container with id 1c739b5ff4abf91d30a0b0362ca32e3e0752a865737bbf58844364510101d486
Jul 20 19:01:42.045316 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:42.045276    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8n78l" event={"ID":"b9dffe8c-6686-4451-a0d1-8fa4100c0b88","Type":"ContainerStarted","Data":"1c739b5ff4abf91d30a0b0362ca32e3e0752a865737bbf58844364510101d486"}
Jul 20 19:01:42.842709 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:42.842679    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mttgk\" (UniqueName: \"kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk\") pod \"network-check-target-ksnwk\" (UID: \"9ee86025-4e97-450b-84cf-9930112292e6\") " pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:01:42.845211 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:42.845190    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mttgk\" (UniqueName: \"kubernetes.io/projected/9ee86025-4e97-450b-84cf-9930112292e6-kube-api-access-mttgk\") pod \"network-check-target-ksnwk\" (UID: \"9ee86025-4e97-450b-84cf-9930112292e6\") " pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:01:42.943779 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:42.943750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs\") pod \"network-metrics-daemon-2rwr8\" (UID: \"1a2c26c6-d757-4ddc-af69-e9fa0515a076\") " pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:01:42.946344 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:42.946319    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 19:01:42.956845 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:42.956826    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a2c26c6-d757-4ddc-af69-e9fa0515a076-metrics-certs\") pod \"network-metrics-daemon-2rwr8\" (UID: \"1a2c26c6-d757-4ddc-af69-e9fa0515a076\") " pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:01:43.050188 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:43.050156    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-74mbs\""
Jul 20 19:01:43.057361 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:43.057335    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s7pj6\""
Jul 20 19:01:43.058378 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:43.058361    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2rwr8"
Jul 20 19:01:43.066190 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:43.066166    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:01:43.204295 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:43.204270    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2rwr8"]
Jul 20 19:01:43.206915 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:01:43.206886    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a2c26c6_d757_4ddc_af69_e9fa0515a076.slice/crio-5af2437e88fbfe4529deb58283819c2e4e9fe2efae7b9e9ad1117dc61c83ba8e WatchSource:0}: Error finding container 5af2437e88fbfe4529deb58283819c2e4e9fe2efae7b9e9ad1117dc61c83ba8e: Status 404 returned error can't find the container with id 5af2437e88fbfe4529deb58283819c2e4e9fe2efae7b9e9ad1117dc61c83ba8e
Jul 20 19:01:43.222257 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:43.222233    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ksnwk"]
Jul 20 19:01:43.225939 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:01:43.225915    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee86025_4e97_450b_84cf_9930112292e6.slice/crio-d4ba6e1062561062c0864aca77ba7796d6c0619e3368249b3b59facfb147f513 WatchSource:0}: Error finding container d4ba6e1062561062c0864aca77ba7796d6c0619e3368249b3b59facfb147f513: Status 404 returned error can't find the container with id d4ba6e1062561062c0864aca77ba7796d6c0619e3368249b3b59facfb147f513
Jul 20 19:01:44.054917 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:44.054809    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ksnwk" event={"ID":"9ee86025-4e97-450b-84cf-9930112292e6","Type":"ContainerStarted","Data":"44fe1c19bd60cc745f4fcb478f413a6779fefbe020c10ed54dc67be0882e940e"}
Jul 20 19:01:44.055421 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:44.054927    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:01:44.055421 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:44.054966    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ksnwk" event={"ID":"9ee86025-4e97-450b-84cf-9930112292e6","Type":"ContainerStarted","Data":"d4ba6e1062561062c0864aca77ba7796d6c0619e3368249b3b59facfb147f513"}
Jul 20 19:01:44.056212 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:44.056187    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2rwr8" event={"ID":"1a2c26c6-d757-4ddc-af69-e9fa0515a076","Type":"ContainerStarted","Data":"5af2437e88fbfe4529deb58283819c2e4e9fe2efae7b9e9ad1117dc61c83ba8e"}
Jul 20 19:01:44.070084 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:44.070040    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ksnwk" podStartSLOduration=65.070027141 podStartE2EDuration="1m5.070027141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:44.068950681 +0000 UTC m=+66.864958014" watchObservedRunningTime="2026-07-20 19:01:44.070027141 +0000 UTC m=+66.866034474"
Jul 20 19:01:46.478782 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.478742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:46.479251 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.478824    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2gsnw\" (UID: \"331b36ec-7043-4009-b601-bb26eb569bfd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw"
Jul 20 19:01:46.479251 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.478863    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:46.479251 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.478926    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t95nv\" (UID: \"f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv"
Jul 20 19:01:46.479251 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.478960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v966b\" (UID: \"ea592eba-3f66-43c3-8235-7dee7375e218\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"
Jul 20 19:01:46.479490 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.479368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:46.479490 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.479424    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:46.480181 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.480150    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a882a69-59de-4dd8-9411-5f53baf13da5-service-ca-bundle\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:46.481597 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.481568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf-metrics-tls\") pod \"dns-default-5lswm\" (UID: \"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf\") " pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:46.481963 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.481934    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-t95nv\" (UID: \"f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv"
Jul 20 19:01:46.482040 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.482015    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/331b36ec-7043-4009-b601-bb26eb569bfd-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2gsnw\" (UID: \"331b36ec-7043-4009-b601-bb26eb569bfd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw"
Jul 20 19:01:46.482340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.482324    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls\") pod \"image-registry-7d9689c95-tw9cj\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") " pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:46.482517 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.482495    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ea592eba-3f66-43c3-8235-7dee7375e218-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-v966b\" (UID: \"ea592eba-3f66-43c3-8235-7dee7375e218\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"
Jul 20 19:01:46.483307 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.483286    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a882a69-59de-4dd8-9411-5f53baf13da5-metrics-certs\") pod \"router-default-6985ddbc8-pvcb7\" (UID: \"9a882a69-59de-4dd8-9411-5f53baf13da5\") " pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:46.694061 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.694040    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kl4lh\""
Jul 20 19:01:46.702203 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.702154    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:46.712264 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.712246    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lbrtv\""
Jul 20 19:01:46.720165 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.720142    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw"
Jul 20 19:01:46.753754 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.753730    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-shkhq\""
Jul 20 19:01:46.759852 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.759622    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7mk56\""
Jul 20 19:01:46.762507 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.762483    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:46.764749 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.764727    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xwlfn\""
Jul 20 19:01:46.768170 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.768112    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv"
Jul 20 19:01:46.771198 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.771181    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dls6q\""
Jul 20 19:01:46.773966 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.773943    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"
Jul 20 19:01:46.780932 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.780771    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:46.908006 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.903741    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d9689c95-tw9cj"]
Jul 20 19:01:46.919614 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:46.919533    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw"]
Jul 20 19:01:47.017085 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:47.017012    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv"]
Jul 20 19:01:47.021708 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:01:47.021678    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a45bf4_ad3e_4d9e_a588_aa6ef7c405cd.slice/crio-5c83f4ee7a66ea57216df532b41eb2947b596c2d2c9974fd8e4f2cf7fe7896ea WatchSource:0}: Error finding container 5c83f4ee7a66ea57216df532b41eb2947b596c2d2c9974fd8e4f2cf7fe7896ea: Status 404 returned error can't find the container with id 5c83f4ee7a66ea57216df532b41eb2947b596c2d2c9974fd8e4f2cf7fe7896ea
Jul 20 19:01:47.048175 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:47.048110    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5lswm"]
Jul 20 19:01:47.050901 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:01:47.050878    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5bd5c9d_7b47_4f04_adcf_b0a8a6b8aedf.slice/crio-fe26ad56be190629bb525c2cab4a5b4f834bb8d4adc308e72a31ed29761b9118 WatchSource:0}: Error finding container fe26ad56be190629bb525c2cab4a5b4f834bb8d4adc308e72a31ed29761b9118: Status 404 returned error can't find the container with id fe26ad56be190629bb525c2cab4a5b4f834bb8d4adc308e72a31ed29761b9118
Jul 20 19:01:47.063457 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:47.063434    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6985ddbc8-pvcb7"]
Jul 20 19:01:47.065845 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:01:47.065772    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a882a69_59de_4dd8_9411_5f53baf13da5.slice/crio-cc37268c8ae6ecc52edcb6e3e8e225f9227422bdb0e8abd8ddff8cbcd45efc71 WatchSource:0}: Error finding container cc37268c8ae6ecc52edcb6e3e8e225f9227422bdb0e8abd8ddff8cbcd45efc71: Status 404 returned error can't find the container with id cc37268c8ae6ecc52edcb6e3e8e225f9227422bdb0e8abd8ddff8cbcd45efc71
Jul 20 19:01:47.070020 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:47.069993    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8n78l" event={"ID":"b9dffe8c-6686-4451-a0d1-8fa4100c0b88","Type":"ContainerStarted","Data":"9f5f96569c3a77b29633bda3333e929713e9da94e4a45eb46ee91419fbe7544e"}
Jul 20 19:01:47.071062 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:47.071031    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5lswm" event={"ID":"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf","Type":"ContainerStarted","Data":"fe26ad56be190629bb525c2cab4a5b4f834bb8d4adc308e72a31ed29761b9118"}
Jul 20 19:01:47.072101 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:47.072077    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw" event={"ID":"331b36ec-7043-4009-b601-bb26eb569bfd","Type":"ContainerStarted","Data":"872e994cb85a4149744d6bce701fe8a3d482db5d608c4335e6755b0fb7812930"}
Jul 20 19:01:47.073845 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:47.073818    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2rwr8" event={"ID":"1a2c26c6-d757-4ddc-af69-e9fa0515a076","Type":"ContainerStarted","Data":"ad5bb9ba2854b776218ba58c6aa05f2da204bfb6ca823ef2035c9c1dc6697a67"}
Jul 20 19:01:47.073926 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:47.073872    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2rwr8" event={"ID":"1a2c26c6-d757-4ddc-af69-e9fa0515a076","Type":"ContainerStarted","Data":"4a04cd4687956e71f496e17fd5ca248e362882998eff7bc5605f07fa1d7c265c"}
Jul 20 19:01:47.074939 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:47.074914    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv" event={"ID":"f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd","Type":"ContainerStarted","Data":"5c83f4ee7a66ea57216df532b41eb2947b596c2d2c9974fd8e4f2cf7fe7896ea"}
Jul 20 19:01:47.076284 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:47.076263    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9689c95-tw9cj" event={"ID":"58e7255e-a59f-4b53-b234-b12f74f7c894","Type":"ContainerStarted","Data":"46b33af44eca21e60866350b4eddd636ded8c85e0125c9c5abeea496176d2b68"}
Jul 20 19:01:47.076387 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:47.076296    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9689c95-tw9cj" event={"ID":"58e7255e-a59f-4b53-b234-b12f74f7c894","Type":"ContainerStarted","Data":"5cbc80c12c479279ab08fe416bac653b94cd8c9af5ad26ea80203abe388d9c40"}
Jul 20 19:01:47.076387 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:47.076382    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:01:47.094286 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:47.094237    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2rwr8" podStartSLOduration=64.603369037 podStartE2EDuration="1m8.094219156s" totalImagesPullingTime="3.490850119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:47.092955589 +0000 UTC m=+69.888962923" watchObservedRunningTime="2026-07-20 19:01:47.094219156 +0000 UTC m=+69.890226490"
Jul 20 19:01:47.112960 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:47.112919    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d9689c95-tw9cj" podStartSLOduration=68.11290283 podStartE2EDuration="1m8.11290283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:47.112883023 +0000 UTC m=+69.908890355" watchObservedRunningTime="2026-07-20 19:01:47.11290283 +0000 UTC m=+69.908910167"
Jul 20 19:01:47.211733 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:47.211699    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b"]
Jul 20 19:01:47.215608 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:01:47.215578    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea592eba_3f66_43c3_8235_7dee7375e218.slice/crio-a2395423452ebfa9107942ef3c28070ba1e93df104ccbfebedf21a9f48e911aa WatchSource:0}: Error finding container a2395423452ebfa9107942ef3c28070ba1e93df104ccbfebedf21a9f48e911aa: Status 404 returned error can't find the container with id a2395423452ebfa9107942ef3c28070ba1e93df104ccbfebedf21a9f48e911aa
Jul 20 19:01:48.083000 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:48.082958    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b" event={"ID":"ea592eba-3f66-43c3-8235-7dee7375e218","Type":"ContainerStarted","Data":"a2395423452ebfa9107942ef3c28070ba1e93df104ccbfebedf21a9f48e911aa"}
Jul 20 19:01:48.088323 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:48.088295    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6985ddbc8-pvcb7" event={"ID":"9a882a69-59de-4dd8-9411-5f53baf13da5","Type":"ContainerStarted","Data":"9ca0fcf51639f8d9e859b3331edd5448dfe700626a649ad688aa032b14a68181"}
Jul 20 19:01:48.088455 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:48.088343    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6985ddbc8-pvcb7" event={"ID":"9a882a69-59de-4dd8-9411-5f53baf13da5","Type":"ContainerStarted","Data":"cc37268c8ae6ecc52edcb6e3e8e225f9227422bdb0e8abd8ddff8cbcd45efc71"}
Jul 20 19:01:48.112458 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:48.112409    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6985ddbc8-pvcb7" podStartSLOduration=50.112391904 podStartE2EDuration="50.112391904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:48.111768722 +0000 UTC m=+70.907776056" watchObservedRunningTime="2026-07-20 19:01:48.112391904 +0000 UTC m=+70.908399239"
Jul 20 19:01:48.781176 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:48.781072    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:48.784411 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:48.784385    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:49.091230 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:49.091160    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:49.093492 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:49.093466    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6985ddbc8-pvcb7"
Jul 20 19:01:49.734628 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:49.734597    2560 scope.go:117] "RemoveContainer" containerID="f9bb8e4488097029b825e4a80f732571af1a1d48b3c99898619c2cb4971802e0"
Jul 20 19:01:53.109267 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:53.109172    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv" event={"ID":"f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd","Type":"ContainerStarted","Data":"12a26d12edc2dfc90dc4e1e548f49d443e3313ead689120f7be009955da26076"}
Jul 20 19:01:53.111796 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:53.111771    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:01:53.111930 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:53.111859    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-5nbcw" event={"ID":"9e6ad052-9fd5-4478-8002-f2546b4df236","Type":"ContainerStarted","Data":"7738b7f0135a2aafdac4963d9bfda0d4d1e059bf86ddd66c57723b63da62110e"}
Jul 20 19:01:53.112824 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:53.112663    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:53.115023 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:53.114983    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5lswm" event={"ID":"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf","Type":"ContainerStarted","Data":"ce7b98fc50a34082fb0aaeb843d0f4e8ae9615c221392a75270126588869d4e0"}
Jul 20 19:01:53.117376 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:53.117346    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw" event={"ID":"331b36ec-7043-4009-b601-bb26eb569bfd","Type":"ContainerStarted","Data":"205577861d63b7873dbd5e6094f99408e43348e8b598ff56b211d33b357ccde1"}
Jul 20 19:01:53.119042 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:53.118998    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b" event={"ID":"ea592eba-3f66-43c3-8235-7dee7375e218","Type":"ContainerStarted","Data":"d8c6de895af97dd3cebbcb1a723be8f33230644db6fea3672d289f55631fd67b"}
Jul 20 19:01:53.127267 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:53.127218    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-t95nv" podStartSLOduration=49.307845033 podStartE2EDuration="55.127202361s" totalImagesPullingTime="5.819357328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:53.126073147 +0000 UTC m=+75.922080480" watchObservedRunningTime="2026-07-20 19:01:53.127202361 +0000 UTC m=+75.923209675"
Jul 20 19:01:53.141738 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:53.141223    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-5nbcw" podStartSLOduration=46.855158094 podStartE2EDuration="55.141210362s" totalImagesPullingTime="8.286052268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:53.140958965 +0000 UTC m=+75.936966289" watchObservedRunningTime="2026-07-20 19:01:53.141210362 +0000 UTC m=+75.937217710"
Jul 20 19:01:53.155448 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:53.155412    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-v966b" podStartSLOduration=49.529975976 podStartE2EDuration="55.155399753s" totalImagesPullingTime="5.625423777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:53.154565731 +0000 UTC m=+75.950573065" watchObservedRunningTime="2026-07-20 19:01:53.155399753 +0000 UTC m=+75.951407101"
Jul 20 19:01:54.073633 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.073604    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-5nbcw"
Jul 20 19:01:54.125999 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.125954    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8n78l" event={"ID":"b9dffe8c-6686-4451-a0d1-8fa4100c0b88","Type":"ContainerStarted","Data":"5700fe26cc726694724f502369e2f76c41f50b5b72de914e91c4a4014a38cca3"}
Jul 20 19:01:54.128378 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.128345    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5lswm" event={"ID":"a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf","Type":"ContainerStarted","Data":"9ffa301252a4d3edabb2d4d6efd0d25ffb16235a67d7cec334b1250acf232b2e"}
Jul 20 19:01:54.128521 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.128447    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5lswm"
Jul 20 19:01:54.130514 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.130487    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw" event={"ID":"331b36ec-7043-4009-b601-bb26eb569bfd","Type":"ContainerStarted","Data":"c19d7c51590409e33d862ac34366a56349af764514ad31565cb39c981b402514"}
Jul 20 19:01:54.163919 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.163868    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5lswm" podStartSLOduration=34.371230389 podStartE2EDuration="40.163850917s" totalImagesPullingTime="5.792620528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:54.163265684 +0000 UTC m=+76.959273018" watchObservedRunningTime="2026-07-20 19:01:54.163850917 +0000 UTC m=+76.959858251"
Jul 20 19:01:54.196548 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.195881    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2gsnw" podStartSLOduration=50.35994022 podStartE2EDuration="56.195863902s" totalImagesPullingTime="5.835923682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:54.19435729 +0000 UTC m=+76.990364624" watchObservedRunningTime="2026-07-20 19:01:54.195863902 +0000 UTC m=+76.991871238"
Jul 20 19:01:54.387389 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.387356    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-gxnnq"]
Jul 20 19:01:54.405067 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.405030    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7qcjv"]
Jul 20 19:01:54.405217 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.405166    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-gxnnq"
Jul 20 19:01:54.411246 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.411216    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 19:01:54.411402 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.411216    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 19:01:54.411663 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.411645    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vp2mf\""
Jul 20 19:01:54.417471 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.417438    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-gxnnq"]
Jul 20 19:01:54.417565 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.417476    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7qcjv"]
Jul 20 19:01:54.417565 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.417554    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7qcjv"
Jul 20 19:01:54.419757 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.419742    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 20 19:01:54.420706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.420538    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-nxjt7\""
Jul 20 19:01:54.550436 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.550406    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpj6g\" (UniqueName: \"kubernetes.io/projected/9fff8118-980d-4191-81b9-0b78ad1faa13-kube-api-access-fpj6g\") pod \"downloads-5bc67dcd46-gxnnq\" (UID: \"9fff8118-980d-4191-81b9-0b78ad1faa13\") " pod="openshift-console/downloads-5bc67dcd46-gxnnq"
Jul 20 19:01:54.550595 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.550448    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/012fde97-534a-4d50-9241-2ac475bd96a6-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-7qcjv\" (UID: \"012fde97-534a-4d50-9241-2ac475bd96a6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7qcjv"
Jul 20 19:01:54.651191 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.651102    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpj6g\" (UniqueName: \"kubernetes.io/projected/9fff8118-980d-4191-81b9-0b78ad1faa13-kube-api-access-fpj6g\") pod \"downloads-5bc67dcd46-gxnnq\" (UID: \"9fff8118-980d-4191-81b9-0b78ad1faa13\") " pod="openshift-console/downloads-5bc67dcd46-gxnnq"
Jul 20 19:01:54.651191 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.651179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/012fde97-534a-4d50-9241-2ac475bd96a6-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-7qcjv\" (UID: \"012fde97-534a-4d50-9241-2ac475bd96a6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7qcjv"
Jul 20 19:01:54.653896 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.653866    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/012fde97-534a-4d50-9241-2ac475bd96a6-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-7qcjv\" (UID: \"012fde97-534a-4d50-9241-2ac475bd96a6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7qcjv"
Jul 20 19:01:54.660825 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.660800    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpj6g\" (UniqueName: \"kubernetes.io/projected/9fff8118-980d-4191-81b9-0b78ad1faa13-kube-api-access-fpj6g\") pod \"downloads-5bc67dcd46-gxnnq\" (UID: \"9fff8118-980d-4191-81b9-0b78ad1faa13\") " pod="openshift-console/downloads-5bc67dcd46-gxnnq"
Jul 20 19:01:54.719292 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.719266    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-gxnnq"
Jul 20 19:01:54.729371 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.729346    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7qcjv"
Jul 20 19:01:54.890734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.890702    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-gxnnq"]
Jul 20 19:01:54.896546 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:01:54.896501    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fff8118_980d_4191_81b9_0b78ad1faa13.slice/crio-49d8a9dcd312fbd73f4559092e587430245e6bb2517f2805eb3dfcffacf46c76 WatchSource:0}: Error finding container 49d8a9dcd312fbd73f4559092e587430245e6bb2517f2805eb3dfcffacf46c76: Status 404 returned error can't find the container with id 49d8a9dcd312fbd73f4559092e587430245e6bb2517f2805eb3dfcffacf46c76
Jul 20 19:01:54.915154 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:54.915131    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7qcjv"]
Jul 20 19:01:54.917914 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:01:54.917891    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod012fde97_534a_4d50_9241_2ac475bd96a6.slice/crio-22d6c71609cd1a3fe022fda15ee3307b7a864d3289515ac9e57242dc80f361da WatchSource:0}: Error finding container 22d6c71609cd1a3fe022fda15ee3307b7a864d3289515ac9e57242dc80f361da: Status 404 returned error can't find the container with id 22d6c71609cd1a3fe022fda15ee3307b7a864d3289515ac9e57242dc80f361da
Jul 20 19:01:55.136940 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:55.136897    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7qcjv" event={"ID":"012fde97-534a-4d50-9241-2ac475bd96a6","Type":"ContainerStarted","Data":"22d6c71609cd1a3fe022fda15ee3307b7a864d3289515ac9e57242dc80f361da"}
Jul 20 19:01:55.138411 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:55.138379    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-gxnnq" event={"ID":"9fff8118-980d-4191-81b9-0b78ad1faa13","Type":"ContainerStarted","Data":"49d8a9dcd312fbd73f4559092e587430245e6bb2517f2805eb3dfcffacf46c76"}
Jul 20 19:01:58.152440 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:58.152407    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8n78l" event={"ID":"b9dffe8c-6686-4451-a0d1-8fa4100c0b88","Type":"ContainerStarted","Data":"d471c3ea3f64b1e37a5a6ac323d29d656d745000335cdf5714ea69912da1f9f3"}
Jul 20 19:01:58.170738 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:58.170691    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8n78l" podStartSLOduration=17.59103842 podStartE2EDuration="33.170674281s" totalImagesPullingTime="15.579635861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:01:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:58.170367053 +0000 UTC m=+80.966374404" watchObservedRunningTime="2026-07-20 19:01:58.170674281 +0000 UTC m=+80.966681625"
Jul 20 19:01:59.158383 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:59.158335    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7qcjv" event={"ID":"012fde97-534a-4d50-9241-2ac475bd96a6","Type":"ContainerStarted","Data":"6fc10618c67ac8b88ef78845e34c8dffb9847836cd83f762740733aa1e3854d4"}
Jul 20 19:01:59.158851 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:59.158763    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7qcjv"
Jul 20 19:01:59.164037 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:59.163999    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7qcjv"
Jul 20 19:01:59.172832 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:01:59.172792    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7qcjv" podStartSLOduration=1.5805563299999998 podStartE2EDuration="5.17277779s" totalImagesPullingTime="3.59222146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:01:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:01:59.172342183 +0000 UTC m=+81.968349517" watchObservedRunningTime="2026-07-20 19:01:59.17277779 +0000 UTC m=+81.968785123"
Jul 20 19:02:04.015448 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.015296    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qtzqr"]
Jul 20 19:02:04.020736 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.020710    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.023973 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.023944    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 19:02:04.024212 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.024191    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 19:02:04.024333 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.024272    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9chdd\""
Jul 20 19:02:04.024333 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.024281    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 19:02:04.024542 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.024525    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 19:02:04.066849 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.066827    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-v2psj"]
Jul 20 19:02:04.068959 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.068934    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.073442 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.073415    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 20 19:02:04.073547 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.073530    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-kbc2m\""
Jul 20 19:02:04.073613 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.073532    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 20 19:02:04.073709 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.073692    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 20 19:02:04.099034 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.099014    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-v2psj"]
Jul 20 19:02:04.100884 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.100863    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c78cc9478-57v4f"]
Jul 20 19:02:04.102794 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.102778    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.106159 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.106113    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 19:02:04.106588 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.106545    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 19:02:04.107113 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.106935    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 19:02:04.107113 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.106938    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gf4mx\""
Jul 20 19:02:04.107113 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.107056    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 19:02:04.111201 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.111172    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 19:02:04.122926 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.122871    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c78cc9478-57v4f"]
Jul 20 19:02:04.134102 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.134080    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/180956ae-0304-43a1-a2f6-74302402e25b-sys\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.134227 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.134140    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/180956ae-0304-43a1-a2f6-74302402e25b-node-exporter-textfile\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.134227 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.134165    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/180956ae-0304-43a1-a2f6-74302402e25b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.134227 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.134190    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/180956ae-0304-43a1-a2f6-74302402e25b-node-exporter-accelerators-collector-config\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.134227 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.134210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/180956ae-0304-43a1-a2f6-74302402e25b-root\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.134227 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.134224    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/180956ae-0304-43a1-a2f6-74302402e25b-metrics-client-ca\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.134417 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.134327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5bg7\" (UniqueName: \"kubernetes.io/projected/180956ae-0304-43a1-a2f6-74302402e25b-kube-api-access-p5bg7\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.134417 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.134375    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/180956ae-0304-43a1-a2f6-74302402e25b-node-exporter-tls\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.134495 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.134428    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/180956ae-0304-43a1-a2f6-74302402e25b-node-exporter-wtmp\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.140687 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.140668    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5lswm"
Jul 20 19:02:04.235757 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.235724    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/180956ae-0304-43a1-a2f6-74302402e25b-node-exporter-wtmp\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.235914 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.235773    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.235914 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.235809    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.235914 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.235845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-oauth-serving-cert\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.235914 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.235877    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50f2da57-2acb-4782-8ec0-61ff81d73461-console-serving-cert\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.236151 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.235919    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/180956ae-0304-43a1-a2f6-74302402e25b-node-exporter-wtmp\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.236151 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.235948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/180956ae-0304-43a1-a2f6-74302402e25b-sys\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.236151 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.235992    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6fgv\" (UniqueName: \"kubernetes.io/projected/50f2da57-2acb-4782-8ec0-61ff81d73461-kube-api-access-r6fgv\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.236151 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.236151 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236052    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/180956ae-0304-43a1-a2f6-74302402e25b-sys\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.236151 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236061    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50f2da57-2acb-4782-8ec0-61ff81d73461-console-oauth-config\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.236404 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236155    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/180956ae-0304-43a1-a2f6-74302402e25b-node-exporter-textfile\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.236404 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236193    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/180956ae-0304-43a1-a2f6-74302402e25b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.236404 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236220    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/180956ae-0304-43a1-a2f6-74302402e25b-node-exporter-accelerators-collector-config\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.236404 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236248    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-service-ca\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.236404 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236274    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwwdj\" (UniqueName: \"kubernetes.io/projected/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-kube-api-access-gwwdj\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.236404 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236306    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/180956ae-0304-43a1-a2f6-74302402e25b-root\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.236404 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/180956ae-0304-43a1-a2f6-74302402e25b-metrics-client-ca\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.236404 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-console-config\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.236701 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5bg7\" (UniqueName: \"kubernetes.io/projected/180956ae-0304-43a1-a2f6-74302402e25b-kube-api-access-p5bg7\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.236701 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236464    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.236701 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236489    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.236701 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236491    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/180956ae-0304-43a1-a2f6-74302402e25b-node-exporter-textfile\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.236701 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236520    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/180956ae-0304-43a1-a2f6-74302402e25b-node-exporter-tls\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.236896 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236806    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/180956ae-0304-43a1-a2f6-74302402e25b-node-exporter-accelerators-collector-config\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.236896 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.236823    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/180956ae-0304-43a1-a2f6-74302402e25b-root\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.237331 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.237311    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/180956ae-0304-43a1-a2f6-74302402e25b-metrics-client-ca\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.238784 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.238758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/180956ae-0304-43a1-a2f6-74302402e25b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.239268 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.239248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/180956ae-0304-43a1-a2f6-74302402e25b-node-exporter-tls\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.247978 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.247954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5bg7\" (UniqueName: \"kubernetes.io/projected/180956ae-0304-43a1-a2f6-74302402e25b-kube-api-access-p5bg7\") pod \"node-exporter-qtzqr\" (UID: \"180956ae-0304-43a1-a2f6-74302402e25b\") " pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.331920 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.331860    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qtzqr"
Jul 20 19:02:04.337365 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.337337    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwwdj\" (UniqueName: \"kubernetes.io/projected/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-kube-api-access-gwwdj\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.337480 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.337387    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-console-config\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.337480 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.337434    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.337480 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.337459    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.337760 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.337709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.337845 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.337766    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.337845 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.337802    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-oauth-serving-cert\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.337845 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.337830    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50f2da57-2acb-4782-8ec0-61ff81d73461-console-serving-cert\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.338004 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.337880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6fgv\" (UniqueName: \"kubernetes.io/projected/50f2da57-2acb-4782-8ec0-61ff81d73461-kube-api-access-r6fgv\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.338004 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.337911    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.338004 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.337937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50f2da57-2acb-4782-8ec0-61ff81d73461-console-oauth-config\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.338004 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.337976    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-service-ca\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.338231 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.338170    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.338231 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.338190    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-console-config\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.338507 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.338480    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.338744 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.338689    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-service-ca\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.338837 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.338811    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-oauth-serving-cert\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.339347 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.339318    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.341366 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.341353    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50f2da57-2acb-4782-8ec0-61ff81d73461-console-serving-cert\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.341517 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.341495    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.341792 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.341770    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.341878 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.341779    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50f2da57-2acb-4782-8ec0-61ff81d73461-console-oauth-config\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.344428 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:02:04.344398    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod180956ae_0304_43a1_a2f6_74302402e25b.slice/crio-65fec49882f425f4618abc246a607bc42e109bed364712b0d274f8790aa8d901 WatchSource:0}: Error finding container 65fec49882f425f4618abc246a607bc42e109bed364712b0d274f8790aa8d901: Status 404 returned error can't find the container with id 65fec49882f425f4618abc246a607bc42e109bed364712b0d274f8790aa8d901
Jul 20 19:02:04.347025 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.346958    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6fgv\" (UniqueName: \"kubernetes.io/projected/50f2da57-2acb-4782-8ec0-61ff81d73461-kube-api-access-r6fgv\") pod \"console-6c78cc9478-57v4f\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") " pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.347751 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.347704    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwwdj\" (UniqueName: \"kubernetes.io/projected/3fed9cbe-8183-44ab-ac42-23baf9c13b4c-kube-api-access-gwwdj\") pod \"kube-state-metrics-56c5594674-v2psj\" (UID: \"3fed9cbe-8183-44ab-ac42-23baf9c13b4c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.379492 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.379468    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj"
Jul 20 19:02:04.413553 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.413523    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:04.540640 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.539962    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-v2psj"]
Jul 20 19:02:04.542399 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:02:04.542365    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fed9cbe_8183_44ab_ac42_23baf9c13b4c.slice/crio-f5d37ec4d2747bc84afb7b75f0e5625f6888dac5caa55ff041a7179578654950 WatchSource:0}: Error finding container f5d37ec4d2747bc84afb7b75f0e5625f6888dac5caa55ff041a7179578654950: Status 404 returned error can't find the container with id f5d37ec4d2747bc84afb7b75f0e5625f6888dac5caa55ff041a7179578654950
Jul 20 19:02:04.567880 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:04.567855    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c78cc9478-57v4f"]
Jul 20 19:02:04.569348 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:02:04.569319    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f2da57_2acb_4782_8ec0_61ff81d73461.slice/crio-63e72590b1435dfa825d9f26eb8f67220a394d218c03bb22291a0203105bb009 WatchSource:0}: Error finding container 63e72590b1435dfa825d9f26eb8f67220a394d218c03bb22291a0203105bb009: Status 404 returned error can't find the container with id 63e72590b1435dfa825d9f26eb8f67220a394d218c03bb22291a0203105bb009
Jul 20 19:02:05.193933 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:05.193825    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c78cc9478-57v4f" event={"ID":"50f2da57-2acb-4782-8ec0-61ff81d73461","Type":"ContainerStarted","Data":"63e72590b1435dfa825d9f26eb8f67220a394d218c03bb22291a0203105bb009"}
Jul 20 19:02:05.195515 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:05.195483    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtzqr" event={"ID":"180956ae-0304-43a1-a2f6-74302402e25b","Type":"ContainerStarted","Data":"65fec49882f425f4618abc246a607bc42e109bed364712b0d274f8790aa8d901"}
Jul 20 19:02:05.197085 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:05.197047    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj" event={"ID":"3fed9cbe-8183-44ab-ac42-23baf9c13b4c","Type":"ContainerStarted","Data":"f5d37ec4d2747bc84afb7b75f0e5625f6888dac5caa55ff041a7179578654950"}
Jul 20 19:02:06.204736 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:06.204695    2560 generic.go:356] "Generic (PLEG): container finished" podID="180956ae-0304-43a1-a2f6-74302402e25b" containerID="ef26e50e1a5bdaebb0fe30329efffcf75efea2d7d510ef61f13009fe46018b89" exitCode=0
Jul 20 19:02:06.205198 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:06.204797    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtzqr" event={"ID":"180956ae-0304-43a1-a2f6-74302402e25b","Type":"ContainerDied","Data":"ef26e50e1a5bdaebb0fe30329efffcf75efea2d7d510ef61f13009fe46018b89"}
Jul 20 19:02:06.713608 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:06.713297    2560 patch_prober.go:28] interesting pod/image-registry-7d9689c95-tw9cj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 20 19:02:06.713608 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:06.713364    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7d9689c95-tw9cj" podUID="58e7255e-a59f-4b53-b234-b12f74f7c894" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 19:02:06.944711 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:06.944680    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-78f4df8445-xwwjm"]
Jul 20 19:02:06.948145 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:06.948110    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:06.950553 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:06.950526    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 20 19:02:06.950868 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:06.950537    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 20 19:02:06.950868 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:06.950862    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 20 19:02:06.951159 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:06.950871    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 20 19:02:06.951246 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:06.951231    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-95u6no3msblf5\""
Jul 20 19:02:06.951409 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:06.951389    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-c75nd\""
Jul 20 19:02:06.951494 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:06.951431    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 20 19:02:06.961630 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:06.961567    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78f4df8445-xwwjm"]
Jul 20 19:02:07.063071 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.062989    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-metrics-client-ca\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.063071 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.063042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krfrc\" (UniqueName: \"kubernetes.io/projected/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-kube-api-access-krfrc\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.063302 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.063141    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.063302 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.063234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.063302 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.063277    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.063459 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.063329    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-grpc-tls\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.063459 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.063376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.063459 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.063434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-thanos-querier-tls\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.164336 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.164302    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.164507 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.164358    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.164507 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.164408    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.164507 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.164453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-grpc-tls\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.164507 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.164498    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.164722 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.164546    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-thanos-querier-tls\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.164722 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.164577    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-metrics-client-ca\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.164722 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.164606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krfrc\" (UniqueName: \"kubernetes.io/projected/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-kube-api-access-krfrc\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.166224 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.165596    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-metrics-client-ca\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.167394 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.167340    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.168574 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.167571    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.168574 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.168023    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.168574 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.168537    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-grpc-tls\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.169452 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.169430    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-thanos-querier-tls\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.170000 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.169944    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.172548 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.172525    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krfrc\" (UniqueName: \"kubernetes.io/projected/cc707e43-07dd-4fa6-b6cc-341d6f443cd5-kube-api-access-krfrc\") pod \"thanos-querier-78f4df8445-xwwjm\" (UID: \"cc707e43-07dd-4fa6-b6cc-341d6f443cd5\") " pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.213390 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.213105    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtzqr" event={"ID":"180956ae-0304-43a1-a2f6-74302402e25b","Type":"ContainerStarted","Data":"dcfd7502a444924cfdb3ee9aa8c6b75a3ac0cf919f3c164f8ebb913105a9bd04"}
Jul 20 19:02:07.213390 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.213226    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtzqr" event={"ID":"180956ae-0304-43a1-a2f6-74302402e25b","Type":"ContainerStarted","Data":"f5819e1070daef43d697816b8f9c6879729e82e2baba457fd0d214028b12b1f8"}
Jul 20 19:02:07.215928 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.215891    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj" event={"ID":"3fed9cbe-8183-44ab-ac42-23baf9c13b4c","Type":"ContainerStarted","Data":"e385f4c7b6dc4e7c69bff9b6981621f5000ce50ce4ef03bc7816831d82d0b354"}
Jul 20 19:02:07.216032 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.215959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj" event={"ID":"3fed9cbe-8183-44ab-ac42-23baf9c13b4c","Type":"ContainerStarted","Data":"47edf221e97a07c949e7efb4b75e75f91bad8638d94fcfd52f944b89cfe938d3"}
Jul 20 19:02:07.216032 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.215989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj" event={"ID":"3fed9cbe-8183-44ab-ac42-23baf9c13b4c","Type":"ContainerStarted","Data":"4f0da9b9e1004e01ee052ef5abd10819a46933451b70c2a6af4fa8e8fe541e32"}
Jul 20 19:02:07.237230 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.236800    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qtzqr" podStartSLOduration=3.117496248 podStartE2EDuration="4.236782204s" totalImagesPullingTime="1.045209109s" totalInitContainerRuntime="74.076847ms" isStatefulPod=true podCreationTimestamp="2026-07-20 19:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:07.233343024 +0000 UTC m=+90.029350358" watchObservedRunningTime="2026-07-20 19:02:07.236782204 +0000 UTC m=+90.032789538"
Jul 20 19:02:07.256411 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.256079    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-v2psj" podStartSLOduration=1.27563713 podStartE2EDuration="3.256061888s" totalImagesPullingTime="1.980424758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:02:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:07.254767152 +0000 UTC m=+90.050774485" watchObservedRunningTime="2026-07-20 19:02:07.256061888 +0000 UTC m=+90.052069222"
Jul 20 19:02:07.262734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.262702    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:07.422509 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:07.422435    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78f4df8445-xwwjm"]
Jul 20 19:02:08.094142 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.094095    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:02:08.263132 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.263085    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-766d85bd97-b89tw"]
Jul 20 19:02:08.269299 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.269277    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.271861 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.271833    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 20 19:02:08.271974 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.271941    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 20 19:02:08.271974 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.271950    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-hi3ngnovbaoo\""
Jul 20 19:02:08.272056 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.271837    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 20 19:02:08.272089 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.272071    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 20 19:02:08.272089 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.271941    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lrcmp\""
Jul 20 19:02:08.277409 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.277321    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-766d85bd97-b89tw"]
Jul 20 19:02:08.376549 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.376476    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q46tt\" (UniqueName: \"kubernetes.io/projected/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-kube-api-access-q46tt\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.376702 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.376602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-metrics-server-audit-profiles\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.376702 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.376668    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-secret-metrics-server-client-certs\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.376817 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.376768    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-client-ca-bundle\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.376874 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.376858    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.376928 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.376913    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-secret-metrics-server-tls\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.377011 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.376993    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-audit-log\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.458675 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:02:08.458640    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc707e43_07dd_4fa6_b6cc_341d6f443cd5.slice/crio-6abc08eca76c3595001ca4bae26bcdab7c8d55b4a4dcf9832f0c516facb4f363 WatchSource:0}: Error finding container 6abc08eca76c3595001ca4bae26bcdab7c8d55b4a4dcf9832f0c516facb4f363: Status 404 returned error can't find the container with id 6abc08eca76c3595001ca4bae26bcdab7c8d55b4a4dcf9832f0c516facb4f363
Jul 20 19:02:08.478493 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.478469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-metrics-server-audit-profiles\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.478577 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.478507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-secret-metrics-server-client-certs\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.478577 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.478532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-client-ca-bundle\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.478577 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.478554    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.478702 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.478678    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-secret-metrics-server-tls\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.478780 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.478763    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-audit-log\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.478839 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.478826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q46tt\" (UniqueName: \"kubernetes.io/projected/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-kube-api-access-q46tt\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.479168 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.479143    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-audit-log\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.479317 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.479293    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.479597 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.479576    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-metrics-server-audit-profiles\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.481005 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.480987    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-secret-metrics-server-client-certs\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.481091 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.481063    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-client-ca-bundle\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.481187 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.481171    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-secret-metrics-server-tls\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.486287 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.486268    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q46tt\" (UniqueName: \"kubernetes.io/projected/8c77cbf2-1a30-4069-8eee-e4c9b56787e7-kube-api-access-q46tt\") pod \"metrics-server-766d85bd97-b89tw\" (UID: \"8c77cbf2-1a30-4069-8eee-e4c9b56787e7\") " pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:08.583043 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:08.583011    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:09.229459 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:09.229420    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm" event={"ID":"cc707e43-07dd-4fa6-b6cc-341d6f443cd5","Type":"ContainerStarted","Data":"6abc08eca76c3595001ca4bae26bcdab7c8d55b4a4dcf9832f0c516facb4f363"}
Jul 20 19:02:15.063021 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.062991    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ksnwk"
Jul 20 19:02:15.639739 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.639698    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c78cc9478-57v4f"]
Jul 20 19:02:15.667943 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.667917    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8547dd8754-fmlj5"]
Jul 20 19:02:15.677949 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.677931    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.681353 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.681321    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8547dd8754-fmlj5"]
Jul 20 19:02:15.685500 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.685476    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 19:02:15.747003 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.746978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-oauth-config\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.747105 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.747011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-config\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.747105 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.747037    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-service-ca\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.747105 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.747060    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-serving-cert\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.747263 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.747100    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-trusted-ca-bundle\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.747263 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.747169    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-oauth-serving-cert\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.747263 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.747199    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7287f\" (UniqueName: \"kubernetes.io/projected/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-kube-api-access-7287f\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.848310 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.848280    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7287f\" (UniqueName: \"kubernetes.io/projected/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-kube-api-access-7287f\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.848412 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.848346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-oauth-config\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.848412 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.848383    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-config\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.848551 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.848422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-service-ca\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.848551 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.848461    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-serving-cert\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.848551 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.848486    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-trusted-ca-bundle\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.848709 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.848592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-oauth-serving-cert\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.849190 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.849165    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-config\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.849293 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.849239    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-service-ca\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.849293 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.849276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-trusted-ca-bundle\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.849390 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.849299    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-oauth-serving-cert\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.850831 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.850807    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-serving-cert\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.850911 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.850897    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-oauth-config\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.856099 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.856081    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7287f\" (UniqueName: \"kubernetes.io/projected/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-kube-api-access-7287f\") pod \"console-8547dd8754-fmlj5\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") " pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:15.989486 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:15.989460    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:16.164108 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:16.162957    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-766d85bd97-b89tw"]
Jul 20 19:02:16.166943 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:02:16.166899    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c77cbf2_1a30_4069_8eee_e4c9b56787e7.slice/crio-41c9a771c17f101adb64f4d25cfc69bb0a058a061b71d0d907bc6c0aa758aaed WatchSource:0}: Error finding container 41c9a771c17f101adb64f4d25cfc69bb0a058a061b71d0d907bc6c0aa758aaed: Status 404 returned error can't find the container with id 41c9a771c17f101adb64f4d25cfc69bb0a058a061b71d0d907bc6c0aa758aaed
Jul 20 19:02:16.194415 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:16.194375    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8547dd8754-fmlj5"]
Jul 20 19:02:16.197353 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:02:16.197310    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c20ed42_7e95_4d9e_9eae_c6c33d767f4e.slice/crio-8cd0c92c1816e838405926e2ce4b60e2e6e307413b89289ae160e4c78ecaae09 WatchSource:0}: Error finding container 8cd0c92c1816e838405926e2ce4b60e2e6e307413b89289ae160e4c78ecaae09: Status 404 returned error can't find the container with id 8cd0c92c1816e838405926e2ce4b60e2e6e307413b89289ae160e4c78ecaae09
Jul 20 19:02:16.270421 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:16.270383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8547dd8754-fmlj5" event={"ID":"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e","Type":"ContainerStarted","Data":"8cd0c92c1816e838405926e2ce4b60e2e6e307413b89289ae160e4c78ecaae09"}
Jul 20 19:02:16.273283 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:16.272196    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-gxnnq" event={"ID":"9fff8118-980d-4191-81b9-0b78ad1faa13","Type":"ContainerStarted","Data":"e2db5323163e16b098c3affd6a5a5638e9ab594143db46c2a629643dedac8a1a"}
Jul 20 19:02:16.273283 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:16.273098    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-gxnnq"
Jul 20 19:02:16.274867 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:16.274240    2560 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-gxnnq container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.20:8080/\": dial tcp 10.132.0.20:8080: connect: connection refused" start-of-body=
Jul 20 19:02:16.274867 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:16.274324    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-gxnnq" podUID="9fff8118-980d-4191-81b9-0b78ad1faa13" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.20:8080/\": dial tcp 10.132.0.20:8080: connect: connection refused"
Jul 20 19:02:16.275059 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:16.275030    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-766d85bd97-b89tw" event={"ID":"8c77cbf2-1a30-4069-8eee-e4c9b56787e7","Type":"ContainerStarted","Data":"41c9a771c17f101adb64f4d25cfc69bb0a058a061b71d0d907bc6c0aa758aaed"}
Jul 20 19:02:16.277028 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:16.277008    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c78cc9478-57v4f" event={"ID":"50f2da57-2acb-4782-8ec0-61ff81d73461","Type":"ContainerStarted","Data":"1b0dcb58625eba7a5d41bd24a4ad0d48626e816647f7b1b8cc37a58cf44fb864"}
Jul 20 19:02:16.288966 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:16.288684    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d9689c95-tw9cj"]
Jul 20 19:02:16.295607 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:16.295543    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-gxnnq" podStartSLOduration=1.145879705 podStartE2EDuration="22.295525993s" totalImagesPullingTime="21.149646288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:01:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:16.29207451 +0000 UTC m=+99.088081849" watchObservedRunningTime="2026-07-20 19:02:16.295525993 +0000 UTC m=+99.091533330"
Jul 20 19:02:16.344420 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:16.342729    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c78cc9478-57v4f" podStartSLOduration=0.937472354 podStartE2EDuration="12.342706233s" totalImagesPullingTime="11.405233879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:02:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:16.318670321 +0000 UTC m=+99.114677667" watchObservedRunningTime="2026-07-20 19:02:16.342706233 +0000 UTC m=+99.138713568"
Jul 20 19:02:17.291239 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:17.290745    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8547dd8754-fmlj5" event={"ID":"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e","Type":"ContainerStarted","Data":"5e77b002d4237dd3162d21a0e378323d6b3d3a38dff71be7ba05b914618430ec"}
Jul 20 19:02:17.306804 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:17.306775    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-gxnnq"
Jul 20 19:02:17.312054 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:17.311467    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8547dd8754-fmlj5" podStartSLOduration=2.311446559 podStartE2EDuration="2.311446559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:02:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:17.30904122 +0000 UTC m=+100.105048558" watchObservedRunningTime="2026-07-20 19:02:17.311446559 +0000 UTC m=+100.107453895"
Jul 20 19:02:19.303051 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:19.302985    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-766d85bd97-b89tw" event={"ID":"8c77cbf2-1a30-4069-8eee-e4c9b56787e7","Type":"ContainerStarted","Data":"252762c4897224a470c2e8241a5e09df946ecd12ca2f668b439ad1374a1f8097"}
Jul 20 19:02:19.305166 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:19.305142    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm" event={"ID":"cc707e43-07dd-4fa6-b6cc-341d6f443cd5","Type":"ContainerStarted","Data":"14c34ff5bbd6d31bcdee622bb976b6db825f8a21a54a1ab13b9b96194c7883b4"}
Jul 20 19:02:19.324589 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:19.324538    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-766d85bd97-b89tw" podStartSLOduration=8.419728141 podStartE2EDuration="11.32452058s" totalImagesPullingTime="2.904792439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:02:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:19.322017311 +0000 UTC m=+102.118024645" watchObservedRunningTime="2026-07-20 19:02:19.32452058 +0000 UTC m=+102.120527913"
Jul 20 19:02:20.314891 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:20.314844    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm" event={"ID":"cc707e43-07dd-4fa6-b6cc-341d6f443cd5","Type":"ContainerStarted","Data":"61bf88edb5fe5735866477df8244f099eae3210bdf72fb946809f29aee56bc0c"}
Jul 20 19:02:20.315732 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:20.314980    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm" event={"ID":"cc707e43-07dd-4fa6-b6cc-341d6f443cd5","Type":"ContainerStarted","Data":"06fcf9c5d5b616736d795c3cbc927c55fb2881234966c9dcbde053df333a109f"}
Jul 20 19:02:21.324203 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:21.324095    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm" event={"ID":"cc707e43-07dd-4fa6-b6cc-341d6f443cd5","Type":"ContainerStarted","Data":"9558090a1f7bf2ea52a7e6749e4ca6dd726e7c70dfb5cf9cc943c0bc8dfd4561"}
Jul 20 19:02:21.324203 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:21.324199    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm" event={"ID":"cc707e43-07dd-4fa6-b6cc-341d6f443cd5","Type":"ContainerStarted","Data":"de8ff5d1f6c8abbac23d64b73c1bb976ee309045a26ace3f89504324d19afb38"}
Jul 20 19:02:21.324770 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:21.324243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm" event={"ID":"cc707e43-07dd-4fa6-b6cc-341d6f443cd5","Type":"ContainerStarted","Data":"5cb22d6df4b05f7ef301576b0c77bd88b875482172e6b0b34d50f5dd570b65d4"}
Jul 20 19:02:21.324770 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:21.324392    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:21.351969 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:21.351915    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm" podStartSLOduration=3.306441951 podStartE2EDuration="15.351895493s" totalImagesPullingTime="12.045453542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:02:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:02:21.351154597 +0000 UTC m=+104.147161933" watchObservedRunningTime="2026-07-20 19:02:21.351895493 +0000 UTC m=+104.147903037"
Jul 20 19:02:24.414581 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:24.414549    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:25.989996 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:25.989965    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:25.990380 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:25.990018    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:25.994532 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:25.994514    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:26.357983 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:26.357900    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:02:27.337423 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:27.337397    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-78f4df8445-xwwjm"
Jul 20 19:02:28.583913 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:28.583885    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:28.584278 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:28.583934    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:41.308162 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.308105    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c78cc9478-57v4f" podUID="50f2da57-2acb-4782-8ec0-61ff81d73461" containerName="console" containerID="cri-o://1b0dcb58625eba7a5d41bd24a4ad0d48626e816647f7b1b8cc37a58cf44fb864" gracePeriod=15
Jul 20 19:02:41.318077 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.318034    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d9689c95-tw9cj" podUID="58e7255e-a59f-4b53-b234-b12f74f7c894" containerName="registry" containerID="cri-o://46b33af44eca21e60866350b4eddd636ded8c85e0125c9c5abeea496176d2b68" gracePeriod=30
Jul 20 19:02:41.578578 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.578525    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:41.614880 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.614857    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:02:41.661415 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.661389    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-console-config\") pod \"50f2da57-2acb-4782-8ec0-61ff81d73461\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") "
Jul 20 19:02:41.661536 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.661451    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50f2da57-2acb-4782-8ec0-61ff81d73461-console-oauth-config\") pod \"50f2da57-2acb-4782-8ec0-61ff81d73461\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") "
Jul 20 19:02:41.661536 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.661469    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-service-ca\") pod \"50f2da57-2acb-4782-8ec0-61ff81d73461\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") "
Jul 20 19:02:41.661536 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.661495    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls\") pod \"58e7255e-a59f-4b53-b234-b12f74f7c894\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") "
Jul 20 19:02:41.661536 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.661515    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-bound-sa-token\") pod \"58e7255e-a59f-4b53-b234-b12f74f7c894\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") "
Jul 20 19:02:41.661536 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.661530    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-certificates\") pod \"58e7255e-a59f-4b53-b234-b12f74f7c894\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") "
Jul 20 19:02:41.661786 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.661567    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-oauth-serving-cert\") pod \"50f2da57-2acb-4782-8ec0-61ff81d73461\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") "
Jul 20 19:02:41.661786 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.661601    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50f2da57-2acb-4782-8ec0-61ff81d73461-console-serving-cert\") pod \"50f2da57-2acb-4782-8ec0-61ff81d73461\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") "
Jul 20 19:02:41.661786 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.661633    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58e7255e-a59f-4b53-b234-b12f74f7c894-ca-trust-extracted\") pod \"58e7255e-a59f-4b53-b234-b12f74f7c894\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") "
Jul 20 19:02:41.661786 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.661664    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58e7255e-a59f-4b53-b234-b12f74f7c894-image-registry-private-configuration\") pod \"58e7255e-a59f-4b53-b234-b12f74f7c894\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") "
Jul 20 19:02:41.661982 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.661777    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-console-config" (OuterVolumeSpecName: "console-config") pod "50f2da57-2acb-4782-8ec0-61ff81d73461" (UID: "50f2da57-2acb-4782-8ec0-61ff81d73461"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:02:41.661982 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.661855    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-service-ca" (OuterVolumeSpecName: "service-ca") pod "50f2da57-2acb-4782-8ec0-61ff81d73461" (UID: "50f2da57-2acb-4782-8ec0-61ff81d73461"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:02:41.662261 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.662241    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx7h8\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-kube-api-access-zx7h8\") pod \"58e7255e-a59f-4b53-b234-b12f74f7c894\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") "
Jul 20 19:02:41.662352 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.662289    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58e7255e-a59f-4b53-b234-b12f74f7c894-installation-pull-secrets\") pod \"58e7255e-a59f-4b53-b234-b12f74f7c894\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") "
Jul 20 19:02:41.662352 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.662344    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6fgv\" (UniqueName: \"kubernetes.io/projected/50f2da57-2acb-4782-8ec0-61ff81d73461-kube-api-access-r6fgv\") pod \"50f2da57-2acb-4782-8ec0-61ff81d73461\" (UID: \"50f2da57-2acb-4782-8ec0-61ff81d73461\") "
Jul 20 19:02:41.662456 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.662385    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58e7255e-a59f-4b53-b234-b12f74f7c894-trusted-ca\") pod \"58e7255e-a59f-4b53-b234-b12f74f7c894\" (UID: \"58e7255e-a59f-4b53-b234-b12f74f7c894\") "
Jul 20 19:02:41.662581 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.662287    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "50f2da57-2acb-4782-8ec0-61ff81d73461" (UID: "50f2da57-2acb-4782-8ec0-61ff81d73461"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:02:41.662652 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.662318    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "58e7255e-a59f-4b53-b234-b12f74f7c894" (UID: "58e7255e-a59f-4b53-b234-b12f74f7c894"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:02:41.662712 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.662664    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-console-config\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:02:41.662712 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.662684    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:02:41.662712 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.662699    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50f2da57-2acb-4782-8ec0-61ff81d73461-oauth-serving-cert\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:02:41.663005 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.662980    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58e7255e-a59f-4b53-b234-b12f74f7c894-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "58e7255e-a59f-4b53-b234-b12f74f7c894" (UID: "58e7255e-a59f-4b53-b234-b12f74f7c894"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:02:41.664632 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.664588    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "58e7255e-a59f-4b53-b234-b12f74f7c894" (UID: "58e7255e-a59f-4b53-b234-b12f74f7c894"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:02:41.664927 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.664874    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50f2da57-2acb-4782-8ec0-61ff81d73461-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "50f2da57-2acb-4782-8ec0-61ff81d73461" (UID: "50f2da57-2acb-4782-8ec0-61ff81d73461"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:02:41.664927 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.664889    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e7255e-a59f-4b53-b234-b12f74f7c894-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "58e7255e-a59f-4b53-b234-b12f74f7c894" (UID: "58e7255e-a59f-4b53-b234-b12f74f7c894"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:02:41.665066 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.664982    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e7255e-a59f-4b53-b234-b12f74f7c894-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "58e7255e-a59f-4b53-b234-b12f74f7c894" (UID: "58e7255e-a59f-4b53-b234-b12f74f7c894"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:02:41.665066 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.665053    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50f2da57-2acb-4782-8ec0-61ff81d73461-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "50f2da57-2acb-4782-8ec0-61ff81d73461" (UID: "50f2da57-2acb-4782-8ec0-61ff81d73461"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:02:41.665205 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.665105    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-kube-api-access-zx7h8" (OuterVolumeSpecName: "kube-api-access-zx7h8") pod "58e7255e-a59f-4b53-b234-b12f74f7c894" (UID: "58e7255e-a59f-4b53-b234-b12f74f7c894"). InnerVolumeSpecName "kube-api-access-zx7h8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:02:41.665205 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.665155    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "58e7255e-a59f-4b53-b234-b12f74f7c894" (UID: "58e7255e-a59f-4b53-b234-b12f74f7c894"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:02:41.666157 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.666132    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50f2da57-2acb-4782-8ec0-61ff81d73461-kube-api-access-r6fgv" (OuterVolumeSpecName: "kube-api-access-r6fgv") pod "50f2da57-2acb-4782-8ec0-61ff81d73461" (UID: "50f2da57-2acb-4782-8ec0-61ff81d73461"). InnerVolumeSpecName "kube-api-access-r6fgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:02:41.670565 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.670541    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e7255e-a59f-4b53-b234-b12f74f7c894-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "58e7255e-a59f-4b53-b234-b12f74f7c894" (UID: "58e7255e-a59f-4b53-b234-b12f74f7c894"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:02:41.763938 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.763915    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50f2da57-2acb-4782-8ec0-61ff81d73461-console-serving-cert\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:02:41.763938 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.763935    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58e7255e-a59f-4b53-b234-b12f74f7c894-ca-trust-extracted\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:02:41.764067 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.763946    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58e7255e-a59f-4b53-b234-b12f74f7c894-image-registry-private-configuration\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:02:41.764067 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.763957    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx7h8\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-kube-api-access-zx7h8\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:02:41.764067 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.763967    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58e7255e-a59f-4b53-b234-b12f74f7c894-installation-pull-secrets\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:02:41.764067 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.763975    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6fgv\" (UniqueName: \"kubernetes.io/projected/50f2da57-2acb-4782-8ec0-61ff81d73461-kube-api-access-r6fgv\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:02:41.764067 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.763984    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58e7255e-a59f-4b53-b234-b12f74f7c894-trusted-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:02:41.764067 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.763992    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50f2da57-2acb-4782-8ec0-61ff81d73461-console-oauth-config\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:02:41.764067 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.764002    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-tls\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:02:41.764067 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.764010    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58e7255e-a59f-4b53-b234-b12f74f7c894-bound-sa-token\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:02:41.764067 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:41.764018    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58e7255e-a59f-4b53-b234-b12f74f7c894-registry-certificates\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:02:42.422015 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.421982    2560 generic.go:356] "Generic (PLEG): container finished" podID="50f2da57-2acb-4782-8ec0-61ff81d73461" containerID="1b0dcb58625eba7a5d41bd24a4ad0d48626e816647f7b1b8cc37a58cf44fb864" exitCode=0
Jul 20 19:02:42.422475 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.422030    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c78cc9478-57v4f"
Jul 20 19:02:42.422475 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.422063    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c78cc9478-57v4f" event={"ID":"50f2da57-2acb-4782-8ec0-61ff81d73461","Type":"ContainerDied","Data":"1b0dcb58625eba7a5d41bd24a4ad0d48626e816647f7b1b8cc37a58cf44fb864"}
Jul 20 19:02:42.422475 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.422131    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c78cc9478-57v4f" event={"ID":"50f2da57-2acb-4782-8ec0-61ff81d73461","Type":"ContainerDied","Data":"63e72590b1435dfa825d9f26eb8f67220a394d218c03bb22291a0203105bb009"}
Jul 20 19:02:42.422475 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.422146    2560 scope.go:117] "RemoveContainer" containerID="1b0dcb58625eba7a5d41bd24a4ad0d48626e816647f7b1b8cc37a58cf44fb864"
Jul 20 19:02:42.423747 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.423724    2560 generic.go:356] "Generic (PLEG): container finished" podID="58e7255e-a59f-4b53-b234-b12f74f7c894" containerID="46b33af44eca21e60866350b4eddd636ded8c85e0125c9c5abeea496176d2b68" exitCode=0
Jul 20 19:02:42.423862 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.423764    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9689c95-tw9cj"
Jul 20 19:02:42.423862 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.423816    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9689c95-tw9cj" event={"ID":"58e7255e-a59f-4b53-b234-b12f74f7c894","Type":"ContainerDied","Data":"46b33af44eca21e60866350b4eddd636ded8c85e0125c9c5abeea496176d2b68"}
Jul 20 19:02:42.423967 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.423877    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9689c95-tw9cj" event={"ID":"58e7255e-a59f-4b53-b234-b12f74f7c894","Type":"ContainerDied","Data":"5cbc80c12c479279ab08fe416bac653b94cd8c9af5ad26ea80203abe388d9c40"}
Jul 20 19:02:42.431488 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.431468    2560 scope.go:117] "RemoveContainer" containerID="1b0dcb58625eba7a5d41bd24a4ad0d48626e816647f7b1b8cc37a58cf44fb864"
Jul 20 19:02:42.431785 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:02:42.431759    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b0dcb58625eba7a5d41bd24a4ad0d48626e816647f7b1b8cc37a58cf44fb864\": container with ID starting with 1b0dcb58625eba7a5d41bd24a4ad0d48626e816647f7b1b8cc37a58cf44fb864 not found: ID does not exist" containerID="1b0dcb58625eba7a5d41bd24a4ad0d48626e816647f7b1b8cc37a58cf44fb864"
Jul 20 19:02:42.431881 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.431795    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b0dcb58625eba7a5d41bd24a4ad0d48626e816647f7b1b8cc37a58cf44fb864"} err="failed to get container status \"1b0dcb58625eba7a5d41bd24a4ad0d48626e816647f7b1b8cc37a58cf44fb864\": rpc error: code = NotFound desc = could not find container \"1b0dcb58625eba7a5d41bd24a4ad0d48626e816647f7b1b8cc37a58cf44fb864\": container with ID starting with 1b0dcb58625eba7a5d41bd24a4ad0d48626e816647f7b1b8cc37a58cf44fb864 not found: ID does not exist"
Jul 20 19:02:42.431881 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.431831    2560 scope.go:117] "RemoveContainer" containerID="46b33af44eca21e60866350b4eddd636ded8c85e0125c9c5abeea496176d2b68"
Jul 20 19:02:42.439681 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.439665    2560 scope.go:117] "RemoveContainer" containerID="46b33af44eca21e60866350b4eddd636ded8c85e0125c9c5abeea496176d2b68"
Jul 20 19:02:42.439927 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:02:42.439910    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46b33af44eca21e60866350b4eddd636ded8c85e0125c9c5abeea496176d2b68\": container with ID starting with 46b33af44eca21e60866350b4eddd636ded8c85e0125c9c5abeea496176d2b68 not found: ID does not exist" containerID="46b33af44eca21e60866350b4eddd636ded8c85e0125c9c5abeea496176d2b68"
Jul 20 19:02:42.440004 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.439931    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46b33af44eca21e60866350b4eddd636ded8c85e0125c9c5abeea496176d2b68"} err="failed to get container status \"46b33af44eca21e60866350b4eddd636ded8c85e0125c9c5abeea496176d2b68\": rpc error: code = NotFound desc = could not find container \"46b33af44eca21e60866350b4eddd636ded8c85e0125c9c5abeea496176d2b68\": container with ID starting with 46b33af44eca21e60866350b4eddd636ded8c85e0125c9c5abeea496176d2b68 not found: ID does not exist"
Jul 20 19:02:42.447897 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.447877    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c78cc9478-57v4f"]
Jul 20 19:02:42.452497 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.452477    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c78cc9478-57v4f"]
Jul 20 19:02:42.467461 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.467438    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d9689c95-tw9cj"]
Jul 20 19:02:42.469029 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.468993    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d9689c95-tw9cj"]
Jul 20 19:02:42.739354 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.739333    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50f2da57-2acb-4782-8ec0-61ff81d73461" path="/var/lib/kubelet/pods/50f2da57-2acb-4782-8ec0-61ff81d73461/volumes"
Jul 20 19:02:42.739713 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:42.739700    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58e7255e-a59f-4b53-b234-b12f74f7c894" path="/var/lib/kubelet/pods/58e7255e-a59f-4b53-b234-b12f74f7c894/volumes"
Jul 20 19:02:45.438944 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:45.438890    2560 generic.go:356] "Generic (PLEG): container finished" podID="b880cd4d-9983-4244-92e6-da9fcbc6539f" containerID="4069ee27f980477ac0b8192c7c8fe3236eb19b7748d062ef21f85460ab23171c" exitCode=0
Jul 20 19:02:45.439298 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:45.438959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-hp5zw" event={"ID":"b880cd4d-9983-4244-92e6-da9fcbc6539f","Type":"ContainerDied","Data":"4069ee27f980477ac0b8192c7c8fe3236eb19b7748d062ef21f85460ab23171c"}
Jul 20 19:02:45.439369 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:45.439321    2560 scope.go:117] "RemoveContainer" containerID="4069ee27f980477ac0b8192c7c8fe3236eb19b7748d062ef21f85460ab23171c"
Jul 20 19:02:45.440603 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:45.440573    2560 generic.go:356] "Generic (PLEG): container finished" podID="b1805f53-670a-44fc-89d6-adac1bf3cddf" containerID="524dccfb02f2afef79922783abbd78123fb81bf6d8970bbef4de508ecc2d5bf9" exitCode=0
Jul 20 19:02:45.440702 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:45.440665    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls" event={"ID":"b1805f53-670a-44fc-89d6-adac1bf3cddf","Type":"ContainerDied","Data":"524dccfb02f2afef79922783abbd78123fb81bf6d8970bbef4de508ecc2d5bf9"}
Jul 20 19:02:45.440980 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:45.440957    2560 scope.go:117] "RemoveContainer" containerID="524dccfb02f2afef79922783abbd78123fb81bf6d8970bbef4de508ecc2d5bf9"
Jul 20 19:02:45.442155 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:45.442112    2560 generic.go:356] "Generic (PLEG): container finished" podID="010ab407-03e3-4b9c-86e8-7e3419017c52" containerID="a0dbaf3aa40dc680017755ce7303c1ddf6e1012ba8d1de6f89564fc3d6c6c1ef" exitCode=0
Jul 20 19:02:45.442155 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:45.442143    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn" event={"ID":"010ab407-03e3-4b9c-86e8-7e3419017c52","Type":"ContainerDied","Data":"a0dbaf3aa40dc680017755ce7303c1ddf6e1012ba8d1de6f89564fc3d6c6c1ef"}
Jul 20 19:02:45.442370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:45.442358    2560 scope.go:117] "RemoveContainer" containerID="a0dbaf3aa40dc680017755ce7303c1ddf6e1012ba8d1de6f89564fc3d6c6c1ef"
Jul 20 19:02:46.456482 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:46.456438    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-ztwzn" event={"ID":"010ab407-03e3-4b9c-86e8-7e3419017c52","Type":"ContainerStarted","Data":"4262287c0468f0cab7e7a86d7c22ca6ee03b4834d77403a42555cd60fd97ba52"}
Jul 20 19:02:46.458358 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:46.458328    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-hp5zw" event={"ID":"b880cd4d-9983-4244-92e6-da9fcbc6539f","Type":"ContainerStarted","Data":"db9a27f57db3afc031c33ae01c6288156d1a9f84a083052c49948cba5f063692"}
Jul 20 19:02:46.459946 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:46.459919    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-f7fls" event={"ID":"b1805f53-670a-44fc-89d6-adac1bf3cddf","Type":"ContainerStarted","Data":"554747fbc9469278748f417eba972ae9e621c9f8783ba61c276a7dffe867cd38"}
Jul 20 19:02:48.588436 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:48.588407    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:02:48.592786 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:02:48.592763    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-766d85bd97-b89tw"
Jul 20 19:03:26.680182 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.680143    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 19:03:26.680746 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.680598    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e7255e-a59f-4b53-b234-b12f74f7c894" containerName="registry"
Jul 20 19:03:26.680746 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.680621    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e7255e-a59f-4b53-b234-b12f74f7c894" containerName="registry"
Jul 20 19:03:26.680746 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.680654    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50f2da57-2acb-4782-8ec0-61ff81d73461" containerName="console"
Jul 20 19:03:26.680746 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.680663    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="50f2da57-2acb-4782-8ec0-61ff81d73461" containerName="console"
Jul 20 19:03:26.680746 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.680749    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="58e7255e-a59f-4b53-b234-b12f74f7c894" containerName="registry"
Jul 20 19:03:26.681033 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.680763    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="50f2da57-2acb-4782-8ec0-61ff81d73461" containerName="console"
Jul 20 19:03:26.684626 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.684602    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.687491 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.687468    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 20 19:03:26.687859 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.687837    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 20 19:03:26.688012 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.687990    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 20 19:03:26.688170 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.688113    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 20 19:03:26.688170 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.688113    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 20 19:03:26.688170 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.688151    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x4f8g\""
Jul 20 19:03:26.688372 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.688137    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 20 19:03:26.688372 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.688317    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 20 19:03:26.688662 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.688647    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 20 19:03:26.693949 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.693929    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 20 19:03:26.698682 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.698659    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 19:03:26.711604 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.711578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2967d194-9039-45be-8bcd-3b70c897015c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.711697 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.711616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psfl4\" (UniqueName: \"kubernetes.io/projected/2967d194-9039-45be-8bcd-3b70c897015c-kube-api-access-psfl4\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.711697 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.711674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2967d194-9039-45be-8bcd-3b70c897015c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.711789 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.711705    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.711789 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.711748    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-web-config\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.711789 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.711766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2967d194-9039-45be-8bcd-3b70c897015c-config-out\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.711988 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.711790    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.711988 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.711820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.711988 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.711863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-config-volume\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.711988 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.711892    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2967d194-9039-45be-8bcd-3b70c897015c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.711988 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.711954    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2967d194-9039-45be-8bcd-3b70c897015c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.711988 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.711983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.712255 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.712047    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.813054 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.813034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.813165 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.813065    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2967d194-9039-45be-8bcd-3b70c897015c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.813165 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.813091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psfl4\" (UniqueName: \"kubernetes.io/projected/2967d194-9039-45be-8bcd-3b70c897015c-kube-api-access-psfl4\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.813254 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.813226    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2967d194-9039-45be-8bcd-3b70c897015c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.813299 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.813264    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.813352 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.813302    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-web-config\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.813352 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.813331    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2967d194-9039-45be-8bcd-3b70c897015c-config-out\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.813448 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.813372    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.813448 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.813396    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.813448 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.813422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-config-volume\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.813448 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.813442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2967d194-9039-45be-8bcd-3b70c897015c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.813642 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.813469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2967d194-9039-45be-8bcd-3b70c897015c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.813642 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.813508    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.814086 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.814059    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2967d194-9039-45be-8bcd-3b70c897015c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.814637 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.814612    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2967d194-9039-45be-8bcd-3b70c897015c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.814727 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.814710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2967d194-9039-45be-8bcd-3b70c897015c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.816261 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.816236    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-web-config\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.816600 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.816578    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2967d194-9039-45be-8bcd-3b70c897015c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.816783 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.816763    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.816907 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.816888    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-config-volume\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.817015 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.816995    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.817211 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.817192    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2967d194-9039-45be-8bcd-3b70c897015c-config-out\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.817283 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.817192    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.817283 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.817237    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.817999 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.817972    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2967d194-9039-45be-8bcd-3b70c897015c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.820872 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.820841    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psfl4\" (UniqueName: \"kubernetes.io/projected/2967d194-9039-45be-8bcd-3b70c897015c-kube-api-access-psfl4\") pod \"alertmanager-main-0\" (UID: \"2967d194-9039-45be-8bcd-3b70c897015c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:26.994925 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:26.994904    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 19:03:27.126907 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:27.126878    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 19:03:27.130103 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:03:27.130071    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2967d194_9039_45be_8bcd_3b70c897015c.slice/crio-09dbe280c2b308cd94ae0427e4411a0871468e7ec5b073729b51812085031ace WatchSource:0}: Error finding container 09dbe280c2b308cd94ae0427e4411a0871468e7ec5b073729b51812085031ace: Status 404 returned error can't find the container with id 09dbe280c2b308cd94ae0427e4411a0871468e7ec5b073729b51812085031ace
Jul 20 19:03:27.654413 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:27.654376    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2967d194-9039-45be-8bcd-3b70c897015c","Type":"ContainerStarted","Data":"09dbe280c2b308cd94ae0427e4411a0871468e7ec5b073729b51812085031ace"}
Jul 20 19:03:28.660030 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:28.659999    2560 generic.go:356] "Generic (PLEG): container finished" podID="2967d194-9039-45be-8bcd-3b70c897015c" containerID="e80932d5a691d22dacabfa5b6aaa3c6adb4a818b914b7d2fdf652c114ae7c993" exitCode=0
Jul 20 19:03:28.660389 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:28.660074    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2967d194-9039-45be-8bcd-3b70c897015c","Type":"ContainerDied","Data":"e80932d5a691d22dacabfa5b6aaa3c6adb4a818b914b7d2fdf652c114ae7c993"}
Jul 20 19:03:30.673346 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:30.673308    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2967d194-9039-45be-8bcd-3b70c897015c","Type":"ContainerStarted","Data":"4c9ae15afea031ce96af638e1d18bb6343f7a6ff3313e155dd7dae946d368764"}
Jul 20 19:03:30.673667 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:30.673420    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2967d194-9039-45be-8bcd-3b70c897015c","Type":"ContainerStarted","Data":"aa5e1d33bfc0304b003e65a3108199dbe219c307f6a6028453dee8ed7d284c67"}
Jul 20 19:03:30.673667 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:30.673462    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2967d194-9039-45be-8bcd-3b70c897015c","Type":"ContainerStarted","Data":"62b74c11cbe2a0d65cccc6d79e20c4da1e1dfb0c885f8d59e9e4a77a298cd074"}
Jul 20 19:03:30.673667 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:30.673498    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2967d194-9039-45be-8bcd-3b70c897015c","Type":"ContainerStarted","Data":"c3676c79ec51951e34d818e63f4108e5ca1152ef4808758a63f29a836c8e0b21"}
Jul 20 19:03:30.673667 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:30.673534    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2967d194-9039-45be-8bcd-3b70c897015c","Type":"ContainerStarted","Data":"de96c8753a954f1d65c52a2e377440be02956b7d1f9b6301de3ca5be46414c8d"}
Jul 20 19:03:30.673667 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:30.673570    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2967d194-9039-45be-8bcd-3b70c897015c","Type":"ContainerStarted","Data":"baea1b0acf96fcc03931c13cf2f0ef39d9fb5f6b697c15a60fde530c03a9b2c5"}
Jul 20 19:03:30.700892 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:30.700831    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.780794673 podStartE2EDuration="4.700815866s" totalImagesPullingTime="2.907294929s" totalInitContainerRuntime="12.726264ms" isStatefulPod=false podCreationTimestamp="2026-07-20 19:03:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:03:30.699663555 +0000 UTC m=+173.495670893" watchObservedRunningTime="2026-07-20 19:03:30.700815866 +0000 UTC m=+173.496823189"
Jul 20 19:03:44.118106 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.118071    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79c545845b-njx5b"]
Jul 20 19:03:44.121377 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.121349    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.132185 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.132163    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79c545845b-njx5b"]
Jul 20 19:03:44.141014 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.140991    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-trusted-ca-bundle\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.141140 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.141022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-console-config\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.141140 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.141053    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8517436-9eac-4a60-bd93-91103228c9e0-console-serving-cert\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.141140 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.141105    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-service-ca\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.141279 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.141208    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8517436-9eac-4a60-bd93-91103228c9e0-console-oauth-config\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.141279 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.141258    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqzmg\" (UniqueName: \"kubernetes.io/projected/e8517436-9eac-4a60-bd93-91103228c9e0-kube-api-access-hqzmg\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.141374 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.141326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-oauth-serving-cert\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.241821 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.241796    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8517436-9eac-4a60-bd93-91103228c9e0-console-oauth-config\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.241940 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.241833    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqzmg\" (UniqueName: \"kubernetes.io/projected/e8517436-9eac-4a60-bd93-91103228c9e0-kube-api-access-hqzmg\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.241940 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.241857    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-oauth-serving-cert\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.241940 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.241879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-trusted-ca-bundle\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.242090 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.242008    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-console-config\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.242191 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.242085    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8517436-9eac-4a60-bd93-91103228c9e0-console-serving-cert\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.242191 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.242147    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-service-ca\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.242726 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.242700    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-oauth-serving-cert\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.242847 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.242749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-console-config\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.242847 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.242777    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-trusted-ca-bundle\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.242847 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.242829    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-service-ca\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.244342 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.244317    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8517436-9eac-4a60-bd93-91103228c9e0-console-oauth-config\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.244602 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.244581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8517436-9eac-4a60-bd93-91103228c9e0-console-serving-cert\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.249873 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.249852    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqzmg\" (UniqueName: \"kubernetes.io/projected/e8517436-9eac-4a60-bd93-91103228c9e0-kube-api-access-hqzmg\") pod \"console-79c545845b-njx5b\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") " pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.432961 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.432870    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:44.576872 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.576839    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79c545845b-njx5b"]
Jul 20 19:03:44.578753 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:03:44.578712    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8517436_9eac_4a60_bd93_91103228c9e0.slice/crio-c9b4effc458317eacab16559b78d3a09202bf3ff39ec7b055d0c0cac424035a6 WatchSource:0}: Error finding container c9b4effc458317eacab16559b78d3a09202bf3ff39ec7b055d0c0cac424035a6: Status 404 returned error can't find the container with id c9b4effc458317eacab16559b78d3a09202bf3ff39ec7b055d0c0cac424035a6
Jul 20 19:03:44.742452 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.742414    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c545845b-njx5b" event={"ID":"e8517436-9eac-4a60-bd93-91103228c9e0","Type":"ContainerStarted","Data":"104b49d4fc35faf5806adc1ce3a30cb648b435e42267f98166c6626838e06ef1"}
Jul 20 19:03:44.742602 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.742472    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c545845b-njx5b" event={"ID":"e8517436-9eac-4a60-bd93-91103228c9e0","Type":"ContainerStarted","Data":"c9b4effc458317eacab16559b78d3a09202bf3ff39ec7b055d0c0cac424035a6"}
Jul 20 19:03:44.764513 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:44.764468    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79c545845b-njx5b" podStartSLOduration=0.764453691 podStartE2EDuration="764.453691ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:03:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:03:44.763633081 +0000 UTC m=+187.559640415" watchObservedRunningTime="2026-07-20 19:03:44.764453691 +0000 UTC m=+187.560461024"
Jul 20 19:03:54.433407 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:54.433370    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:54.433806 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:54.433438    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:54.438202 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:54.438180    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:54.790001 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:54.789975    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:03:54.834500 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:03:54.834473    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8547dd8754-fmlj5"]
Jul 20 19:04:19.860937 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:19.860894    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8547dd8754-fmlj5" podUID="7c20ed42-7e95-4d9e-9eae-c6c33d767f4e" containerName="console" containerID="cri-o://5e77b002d4237dd3162d21a0e378323d6b3d3a38dff71be7ba05b914618430ec" gracePeriod=15
Jul 20 19:04:20.102986 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.102964    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:04:20.233901 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.233872    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-serving-cert\") pod \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") "
Jul 20 19:04:20.234066 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.233941    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-oauth-serving-cert\") pod \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") "
Jul 20 19:04:20.234167 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.234106    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-service-ca\") pod \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") "
Jul 20 19:04:20.234229 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.234193    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7287f\" (UniqueName: \"kubernetes.io/projected/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-kube-api-access-7287f\") pod \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") "
Jul 20 19:04:20.234286 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.234237    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-oauth-config\") pod \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") "
Jul 20 19:04:20.234364 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.234339    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7c20ed42-7e95-4d9e-9eae-c6c33d767f4e" (UID: "7c20ed42-7e95-4d9e-9eae-c6c33d767f4e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:04:20.234413 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.234369    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-config\") pod \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") "
Jul 20 19:04:20.234413 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.234407    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-trusted-ca-bundle\") pod \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\" (UID: \"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e\") "
Jul 20 19:04:20.234497 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.234437    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-service-ca" (OuterVolumeSpecName: "service-ca") pod "7c20ed42-7e95-4d9e-9eae-c6c33d767f4e" (UID: "7c20ed42-7e95-4d9e-9eae-c6c33d767f4e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:04:20.234724 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.234705    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-oauth-serving-cert\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:04:20.234724 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.234725    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:04:20.234881 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.234804    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-config" (OuterVolumeSpecName: "console-config") pod "7c20ed42-7e95-4d9e-9eae-c6c33d767f4e" (UID: "7c20ed42-7e95-4d9e-9eae-c6c33d767f4e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:04:20.234881 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.234861    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7c20ed42-7e95-4d9e-9eae-c6c33d767f4e" (UID: "7c20ed42-7e95-4d9e-9eae-c6c33d767f4e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:04:20.236258 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.236238    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7c20ed42-7e95-4d9e-9eae-c6c33d767f4e" (UID: "7c20ed42-7e95-4d9e-9eae-c6c33d767f4e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:04:20.236525 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.236503    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7c20ed42-7e95-4d9e-9eae-c6c33d767f4e" (UID: "7c20ed42-7e95-4d9e-9eae-c6c33d767f4e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:04:20.236588 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.236521    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-kube-api-access-7287f" (OuterVolumeSpecName: "kube-api-access-7287f") pod "7c20ed42-7e95-4d9e-9eae-c6c33d767f4e" (UID: "7c20ed42-7e95-4d9e-9eae-c6c33d767f4e"). InnerVolumeSpecName "kube-api-access-7287f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:04:20.336046 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.336006    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7287f\" (UniqueName: \"kubernetes.io/projected/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-kube-api-access-7287f\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:04:20.336046 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.336043    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-oauth-config\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:04:20.336206 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.336058    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-config\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:04:20.336206 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.336071    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-trusted-ca-bundle\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:04:20.336206 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.336082    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e-console-serving-cert\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:04:20.901294 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.901261    2560 generic.go:356] "Generic (PLEG): container finished" podID="7c20ed42-7e95-4d9e-9eae-c6c33d767f4e" containerID="5e77b002d4237dd3162d21a0e378323d6b3d3a38dff71be7ba05b914618430ec" exitCode=0
Jul 20 19:04:20.901670 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.901316    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8547dd8754-fmlj5"
Jul 20 19:04:20.901670 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.901327    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8547dd8754-fmlj5" event={"ID":"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e","Type":"ContainerDied","Data":"5e77b002d4237dd3162d21a0e378323d6b3d3a38dff71be7ba05b914618430ec"}
Jul 20 19:04:20.901670 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.901368    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8547dd8754-fmlj5" event={"ID":"7c20ed42-7e95-4d9e-9eae-c6c33d767f4e","Type":"ContainerDied","Data":"8cd0c92c1816e838405926e2ce4b60e2e6e307413b89289ae160e4c78ecaae09"}
Jul 20 19:04:20.901670 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.901386    2560 scope.go:117] "RemoveContainer" containerID="5e77b002d4237dd3162d21a0e378323d6b3d3a38dff71be7ba05b914618430ec"
Jul 20 19:04:20.911320 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.911300    2560 scope.go:117] "RemoveContainer" containerID="5e77b002d4237dd3162d21a0e378323d6b3d3a38dff71be7ba05b914618430ec"
Jul 20 19:04:20.911590 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:04:20.911570    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e77b002d4237dd3162d21a0e378323d6b3d3a38dff71be7ba05b914618430ec\": container with ID starting with 5e77b002d4237dd3162d21a0e378323d6b3d3a38dff71be7ba05b914618430ec not found: ID does not exist" containerID="5e77b002d4237dd3162d21a0e378323d6b3d3a38dff71be7ba05b914618430ec"
Jul 20 19:04:20.911659 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.911602    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e77b002d4237dd3162d21a0e378323d6b3d3a38dff71be7ba05b914618430ec"} err="failed to get container status \"5e77b002d4237dd3162d21a0e378323d6b3d3a38dff71be7ba05b914618430ec\": rpc error: code = NotFound desc = could not find container \"5e77b002d4237dd3162d21a0e378323d6b3d3a38dff71be7ba05b914618430ec\": container with ID starting with 5e77b002d4237dd3162d21a0e378323d6b3d3a38dff71be7ba05b914618430ec not found: ID does not exist"
Jul 20 19:04:20.919022 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.918999    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8547dd8754-fmlj5"]
Jul 20 19:04:20.920679 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:20.920659    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8547dd8754-fmlj5"]
Jul 20 19:04:22.739638 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:22.739607    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c20ed42-7e95-4d9e-9eae-c6c33d767f4e" path="/var/lib/kubelet/pods/7c20ed42-7e95-4d9e-9eae-c6c33d767f4e/volumes"
Jul 20 19:04:52.118305 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:52.118273    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r4hpg"]
Jul 20 19:04:52.118844 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:52.118673    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c20ed42-7e95-4d9e-9eae-c6c33d767f4e" containerName="console"
Jul 20 19:04:52.118844 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:52.118687    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c20ed42-7e95-4d9e-9eae-c6c33d767f4e" containerName="console"
Jul 20 19:04:52.118844 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:52.118747    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c20ed42-7e95-4d9e-9eae-c6c33d767f4e" containerName="console"
Jul 20 19:04:52.123127 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:52.123098    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r4hpg"
Jul 20 19:04:52.125491 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:52.125468    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xmjtr\""
Jul 20 19:04:52.125609 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:52.125532    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 20 19:04:52.125609 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:52.125589    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 20 19:04:52.131403 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:52.131377    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r4hpg"]
Jul 20 19:04:52.175702 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:52.175680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5kmp\" (UniqueName: \"kubernetes.io/projected/0d54f199-6007-492b-bd32-e7946133a887-kube-api-access-b5kmp\") pod \"cert-manager-webhook-6486ffd997-r4hpg\" (UID: \"0d54f199-6007-492b-bd32-e7946133a887\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r4hpg"
Jul 20 19:04:52.175810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:52.175727    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d54f199-6007-492b-bd32-e7946133a887-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r4hpg\" (UID: \"0d54f199-6007-492b-bd32-e7946133a887\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r4hpg"
Jul 20 19:04:52.276427 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:52.276401    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5kmp\" (UniqueName: \"kubernetes.io/projected/0d54f199-6007-492b-bd32-e7946133a887-kube-api-access-b5kmp\") pod \"cert-manager-webhook-6486ffd997-r4hpg\" (UID: \"0d54f199-6007-492b-bd32-e7946133a887\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r4hpg"
Jul 20 19:04:52.276552 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:52.276452    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d54f199-6007-492b-bd32-e7946133a887-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r4hpg\" (UID: \"0d54f199-6007-492b-bd32-e7946133a887\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r4hpg"
Jul 20 19:04:52.284335 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:52.284316    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d54f199-6007-492b-bd32-e7946133a887-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r4hpg\" (UID: \"0d54f199-6007-492b-bd32-e7946133a887\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r4hpg"
Jul 20 19:04:52.284515 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:52.284499    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5kmp\" (UniqueName: \"kubernetes.io/projected/0d54f199-6007-492b-bd32-e7946133a887-kube-api-access-b5kmp\") pod \"cert-manager-webhook-6486ffd997-r4hpg\" (UID: \"0d54f199-6007-492b-bd32-e7946133a887\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r4hpg"
Jul 20 19:04:52.446352 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:52.446321    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r4hpg"
Jul 20 19:04:52.574759 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:52.574737    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r4hpg"]
Jul 20 19:04:52.576702 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:04:52.576676    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d54f199_6007_492b_bd32_e7946133a887.slice/crio-7f465908bf75c61fc505ecb0a22c38cfd03dee25389aa367b78b74faa3b46d34 WatchSource:0}: Error finding container 7f465908bf75c61fc505ecb0a22c38cfd03dee25389aa367b78b74faa3b46d34: Status 404 returned error can't find the container with id 7f465908bf75c61fc505ecb0a22c38cfd03dee25389aa367b78b74faa3b46d34
Jul 20 19:04:53.045991 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:53.045953    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r4hpg" event={"ID":"0d54f199-6007-492b-bd32-e7946133a887","Type":"ContainerStarted","Data":"7f465908bf75c61fc505ecb0a22c38cfd03dee25389aa367b78b74faa3b46d34"}
Jul 20 19:04:54.104486 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:54.104433    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p967w"]
Jul 20 19:04:54.114251 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:54.114176    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p967w"
Jul 20 19:04:54.115782 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:54.115752    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p967w"]
Jul 20 19:04:54.116647 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:54.116622    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-45l8g\""
Jul 20 19:04:54.193641 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:54.193608    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnrf8\" (UniqueName: \"kubernetes.io/projected/96806fe5-5d57-4fb5-93fa-ed4902a86fc9-kube-api-access-xnrf8\") pod \"cert-manager-cainjector-559cdd8c87-p967w\" (UID: \"96806fe5-5d57-4fb5-93fa-ed4902a86fc9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p967w"
Jul 20 19:04:54.193818 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:54.193678    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96806fe5-5d57-4fb5-93fa-ed4902a86fc9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p967w\" (UID: \"96806fe5-5d57-4fb5-93fa-ed4902a86fc9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p967w"
Jul 20 19:04:54.294956 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:54.294920    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnrf8\" (UniqueName: \"kubernetes.io/projected/96806fe5-5d57-4fb5-93fa-ed4902a86fc9-kube-api-access-xnrf8\") pod \"cert-manager-cainjector-559cdd8c87-p967w\" (UID: \"96806fe5-5d57-4fb5-93fa-ed4902a86fc9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p967w"
Jul 20 19:04:54.295160 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:54.294977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96806fe5-5d57-4fb5-93fa-ed4902a86fc9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p967w\" (UID: \"96806fe5-5d57-4fb5-93fa-ed4902a86fc9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p967w"
Jul 20 19:04:54.304473 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:54.304445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnrf8\" (UniqueName: \"kubernetes.io/projected/96806fe5-5d57-4fb5-93fa-ed4902a86fc9-kube-api-access-xnrf8\") pod \"cert-manager-cainjector-559cdd8c87-p967w\" (UID: \"96806fe5-5d57-4fb5-93fa-ed4902a86fc9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p967w"
Jul 20 19:04:54.304628 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:54.304609    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96806fe5-5d57-4fb5-93fa-ed4902a86fc9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p967w\" (UID: \"96806fe5-5d57-4fb5-93fa-ed4902a86fc9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p967w"
Jul 20 19:04:54.427009 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:54.426937    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p967w"
Jul 20 19:04:55.590586 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:55.590563    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p967w"]
Jul 20 19:04:55.592692 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:04:55.592662    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96806fe5_5d57_4fb5_93fa_ed4902a86fc9.slice/crio-67e2d67f1166f18c899b1d59e74e38ff13e71b3431b6bb7fb26384ee12909afb WatchSource:0}: Error finding container 67e2d67f1166f18c899b1d59e74e38ff13e71b3431b6bb7fb26384ee12909afb: Status 404 returned error can't find the container with id 67e2d67f1166f18c899b1d59e74e38ff13e71b3431b6bb7fb26384ee12909afb
Jul 20 19:04:56.062585 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:56.062537    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p967w" event={"ID":"96806fe5-5d57-4fb5-93fa-ed4902a86fc9","Type":"ContainerStarted","Data":"0ac1814b6838f3a4a7d3118fd483c1874dc61a6b220b34f404d45d529fdba892"}
Jul 20 19:04:56.062585 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:56.062591    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p967w" event={"ID":"96806fe5-5d57-4fb5-93fa-ed4902a86fc9","Type":"ContainerStarted","Data":"67e2d67f1166f18c899b1d59e74e38ff13e71b3431b6bb7fb26384ee12909afb"}
Jul 20 19:04:56.063823 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:56.063797    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r4hpg" event={"ID":"0d54f199-6007-492b-bd32-e7946133a887","Type":"ContainerStarted","Data":"dfa3f685efbf5505ebf30c97aba6ab3b17de7fe421355100f87a809bef7a0813"}
Jul 20 19:04:56.063958 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:56.063848    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r4hpg"
Jul 20 19:04:56.077306 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:56.077260    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p967w" podStartSLOduration=2.077246482 podStartE2EDuration="2.077246482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:04:56.076581484 +0000 UTC m=+258.872588831" watchObservedRunningTime="2026-07-20 19:04:56.077246482 +0000 UTC m=+258.873253814"
Jul 20 19:04:56.092580 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:04:56.092535    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-r4hpg" podStartSLOduration=1.137313916 podStartE2EDuration="4.092521066s" totalImagesPullingTime="2.95520715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:04:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:04:56.090992616 +0000 UTC m=+258.886999941" watchObservedRunningTime="2026-07-20 19:04:56.092521066 +0000 UTC m=+258.888528399"
Jul 20 19:05:02.071022 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:02.070948    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r4hpg"
Jul 20 19:05:25.398653 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.398620    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"]
Jul 20 19:05:25.405709 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.405684    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:25.412362 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.412345    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 19:05:25.412362 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.412353    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 19:05:25.412525 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.412346    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 19:05:25.412525 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.412476    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 19:05:25.412525 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.412476    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wsgrw\""
Jul 20 19:05:25.437907 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.437881    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"]
Jul 20 19:05:25.447627 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.447606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9693c682-68d1-49fe-9dc2-6c6775f2cbc1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-nsn6m\" (UID: \"9693c682-68d1-49fe-9dc2-6c6775f2cbc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:25.447749 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.447637    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9693c682-68d1-49fe-9dc2-6c6775f2cbc1-manifests\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-nsn6m\" (UID: \"9693c682-68d1-49fe-9dc2-6c6775f2cbc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:25.447749 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.447658    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9693c682-68d1-49fe-9dc2-6c6775f2cbc1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-nsn6m\" (UID: \"9693c682-68d1-49fe-9dc2-6c6775f2cbc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:25.447749 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.447717    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9693c682-68d1-49fe-9dc2-6c6775f2cbc1-tmp\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-nsn6m\" (UID: \"9693c682-68d1-49fe-9dc2-6c6775f2cbc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:25.447925 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.447762    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjx5z\" (UniqueName: \"kubernetes.io/projected/9693c682-68d1-49fe-9dc2-6c6775f2cbc1-kube-api-access-cjx5z\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-nsn6m\" (UID: \"9693c682-68d1-49fe-9dc2-6c6775f2cbc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:25.548021 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.547999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9693c682-68d1-49fe-9dc2-6c6775f2cbc1-tmp\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-nsn6m\" (UID: \"9693c682-68d1-49fe-9dc2-6c6775f2cbc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:25.548151 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.548041    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjx5z\" (UniqueName: \"kubernetes.io/projected/9693c682-68d1-49fe-9dc2-6c6775f2cbc1-kube-api-access-cjx5z\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-nsn6m\" (UID: \"9693c682-68d1-49fe-9dc2-6c6775f2cbc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:25.548151 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.548095    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9693c682-68d1-49fe-9dc2-6c6775f2cbc1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-nsn6m\" (UID: \"9693c682-68d1-49fe-9dc2-6c6775f2cbc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:25.548151 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.548142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9693c682-68d1-49fe-9dc2-6c6775f2cbc1-manifests\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-nsn6m\" (UID: \"9693c682-68d1-49fe-9dc2-6c6775f2cbc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:25.548319 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.548168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9693c682-68d1-49fe-9dc2-6c6775f2cbc1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-nsn6m\" (UID: \"9693c682-68d1-49fe-9dc2-6c6775f2cbc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:25.548625 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.548598    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9693c682-68d1-49fe-9dc2-6c6775f2cbc1-manifests\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-nsn6m\" (UID: \"9693c682-68d1-49fe-9dc2-6c6775f2cbc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:25.550364 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.550343    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9693c682-68d1-49fe-9dc2-6c6775f2cbc1-tmp\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-nsn6m\" (UID: \"9693c682-68d1-49fe-9dc2-6c6775f2cbc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:25.550597 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.550580    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9693c682-68d1-49fe-9dc2-6c6775f2cbc1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-nsn6m\" (UID: \"9693c682-68d1-49fe-9dc2-6c6775f2cbc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:25.550754 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.550735    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9693c682-68d1-49fe-9dc2-6c6775f2cbc1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-nsn6m\" (UID: \"9693c682-68d1-49fe-9dc2-6c6775f2cbc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:25.556086 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.556065    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjx5z\" (UniqueName: \"kubernetes.io/projected/9693c682-68d1-49fe-9dc2-6c6775f2cbc1-kube-api-access-cjx5z\") pod \"opendatahub-operator-controller-manager-6dc69fccc8-nsn6m\" (UID: \"9693c682-68d1-49fe-9dc2-6c6775f2cbc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:25.714878 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.714858    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:25.853140 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:25.853096    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"]
Jul 20 19:05:25.855920 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:05:25.855890    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9693c682_68d1_49fe_9dc2_6c6775f2cbc1.slice/crio-08ba04b5d231587092880f78eadce18ad02ff87b067b86dae899a8e8a3086de5 WatchSource:0}: Error finding container 08ba04b5d231587092880f78eadce18ad02ff87b067b86dae899a8e8a3086de5: Status 404 returned error can't find the container with id 08ba04b5d231587092880f78eadce18ad02ff87b067b86dae899a8e8a3086de5
Jul 20 19:05:26.197473 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:26.197440    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m" event={"ID":"9693c682-68d1-49fe-9dc2-6c6775f2cbc1","Type":"ContainerStarted","Data":"08ba04b5d231587092880f78eadce18ad02ff87b067b86dae899a8e8a3086de5"}
Jul 20 19:05:30.218974 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:30.218942    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m" event={"ID":"9693c682-68d1-49fe-9dc2-6c6775f2cbc1","Type":"ContainerStarted","Data":"654ee7b373470aa4875ffc414d7a71aaaade900acd413c31bdec6f7021f15c9e"}
Jul 20 19:05:31.224498 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:31.224459    2560 generic.go:356] "Generic (PLEG): container finished" podID="9693c682-68d1-49fe-9dc2-6c6775f2cbc1" containerID="654ee7b373470aa4875ffc414d7a71aaaade900acd413c31bdec6f7021f15c9e" exitCode=0
Jul 20 19:05:31.224976 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:31.224527    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m" event={"ID":"9693c682-68d1-49fe-9dc2-6c6775f2cbc1","Type":"ContainerDied","Data":"654ee7b373470aa4875ffc414d7a71aaaade900acd413c31bdec6f7021f15c9e"}
Jul 20 19:05:32.231850 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:32.231812    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m" event={"ID":"9693c682-68d1-49fe-9dc2-6c6775f2cbc1","Type":"ContainerStarted","Data":"a604321902f225c30ab8f170617fb33f69ec2ac8da827849a5622fcb0ca0d07e"}
Jul 20 19:05:32.232254 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:32.231916    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:32.256882 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:32.256825    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m" podStartSLOduration=2.5625970909999998 podStartE2EDuration="7.256809461s" totalImagesPullingTime="3.676962745s" totalInitContainerRuntime="1.017249625s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:05:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:05:32.254364707 +0000 UTC m=+295.050372041" watchObservedRunningTime="2026-07-20 19:05:32.256809461 +0000 UTC m=+295.052816794"
Jul 20 19:05:37.640590 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:37.640557    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:05:37.641976 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:37.641950    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:05:37.644505 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:37.644482    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:05:37.645892 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:37.645870    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:05:37.652612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:37.652593    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 19:05:43.239076 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:43.239039    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc69fccc8-nsn6m"
Jul 20 19:05:45.804890 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:45.804858    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"]
Jul 20 19:05:45.808409 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:45.808388    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"
Jul 20 19:05:45.812899 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:45.812874    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 19:05:45.813078 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:45.812927    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 20 19:05:45.813209 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:45.812934    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 20 19:05:45.813280 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:45.812954    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 20 19:05:45.813782 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:45.813754    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 19:05:45.819352 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:45.819335    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-q9849\""
Jul 20 19:05:45.833698 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:45.833676    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"]
Jul 20 19:05:45.910051 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:45.910024    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/37f30b1a-bd1e-4cc5-aece-ca1401794f7b-manager-config\") pod \"lws-controller-manager-569f4dcc7-lb95z\" (UID: \"37f30b1a-bd1e-4cc5-aece-ca1401794f7b\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"
Jul 20 19:05:45.910228 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:45.910057    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/37f30b1a-bd1e-4cc5-aece-ca1401794f7b-metrics-cert\") pod \"lws-controller-manager-569f4dcc7-lb95z\" (UID: \"37f30b1a-bd1e-4cc5-aece-ca1401794f7b\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"
Jul 20 19:05:45.910228 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:45.910078    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37f30b1a-bd1e-4cc5-aece-ca1401794f7b-cert\") pod \"lws-controller-manager-569f4dcc7-lb95z\" (UID: \"37f30b1a-bd1e-4cc5-aece-ca1401794f7b\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"
Jul 20 19:05:45.910228 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:45.910194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-278nt\" (UniqueName: \"kubernetes.io/projected/37f30b1a-bd1e-4cc5-aece-ca1401794f7b-kube-api-access-278nt\") pod \"lws-controller-manager-569f4dcc7-lb95z\" (UID: \"37f30b1a-bd1e-4cc5-aece-ca1401794f7b\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"
Jul 20 19:05:46.010904 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:46.010877    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/37f30b1a-bd1e-4cc5-aece-ca1401794f7b-manager-config\") pod \"lws-controller-manager-569f4dcc7-lb95z\" (UID: \"37f30b1a-bd1e-4cc5-aece-ca1401794f7b\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"
Jul 20 19:05:46.011014 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:46.010910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/37f30b1a-bd1e-4cc5-aece-ca1401794f7b-metrics-cert\") pod \"lws-controller-manager-569f4dcc7-lb95z\" (UID: \"37f30b1a-bd1e-4cc5-aece-ca1401794f7b\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"
Jul 20 19:05:46.011014 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:46.010934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37f30b1a-bd1e-4cc5-aece-ca1401794f7b-cert\") pod \"lws-controller-manager-569f4dcc7-lb95z\" (UID: \"37f30b1a-bd1e-4cc5-aece-ca1401794f7b\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"
Jul 20 19:05:46.011014 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:46.010987    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-278nt\" (UniqueName: \"kubernetes.io/projected/37f30b1a-bd1e-4cc5-aece-ca1401794f7b-kube-api-access-278nt\") pod \"lws-controller-manager-569f4dcc7-lb95z\" (UID: \"37f30b1a-bd1e-4cc5-aece-ca1401794f7b\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"
Jul 20 19:05:46.011613 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:46.011589    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/37f30b1a-bd1e-4cc5-aece-ca1401794f7b-manager-config\") pod \"lws-controller-manager-569f4dcc7-lb95z\" (UID: \"37f30b1a-bd1e-4cc5-aece-ca1401794f7b\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"
Jul 20 19:05:46.013413 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:46.013392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37f30b1a-bd1e-4cc5-aece-ca1401794f7b-cert\") pod \"lws-controller-manager-569f4dcc7-lb95z\" (UID: \"37f30b1a-bd1e-4cc5-aece-ca1401794f7b\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"
Jul 20 19:05:46.013501 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:46.013453    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/37f30b1a-bd1e-4cc5-aece-ca1401794f7b-metrics-cert\") pod \"lws-controller-manager-569f4dcc7-lb95z\" (UID: \"37f30b1a-bd1e-4cc5-aece-ca1401794f7b\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"
Jul 20 19:05:46.032286 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:46.032265    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-278nt\" (UniqueName: \"kubernetes.io/projected/37f30b1a-bd1e-4cc5-aece-ca1401794f7b-kube-api-access-278nt\") pod \"lws-controller-manager-569f4dcc7-lb95z\" (UID: \"37f30b1a-bd1e-4cc5-aece-ca1401794f7b\") " pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"
Jul 20 19:05:46.119795 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:46.119720    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"
Jul 20 19:05:46.256360 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:46.256332    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"]
Jul 20 19:05:46.258687 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:05:46.258658    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f30b1a_bd1e_4cc5_aece_ca1401794f7b.slice/crio-6222dd01e83abde9ff3394b4990ba8436699b00b9d79c784e07ed021670affe1 WatchSource:0}: Error finding container 6222dd01e83abde9ff3394b4990ba8436699b00b9d79c784e07ed021670affe1: Status 404 returned error can't find the container with id 6222dd01e83abde9ff3394b4990ba8436699b00b9d79c784e07ed021670affe1
Jul 20 19:05:46.260971 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:46.260950    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:05:46.296499 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:46.296471    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z" event={"ID":"37f30b1a-bd1e-4cc5-aece-ca1401794f7b","Type":"ContainerStarted","Data":"6222dd01e83abde9ff3394b4990ba8436699b00b9d79c784e07ed021670affe1"}
Jul 20 19:05:49.314991 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:49.314955    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z" event={"ID":"37f30b1a-bd1e-4cc5-aece-ca1401794f7b","Type":"ContainerStarted","Data":"4f17a36223e6ccf7db52eb19480376a2c4c0465a27482b00e973419c3d196d83"}
Jul 20 19:05:49.315391 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:49.315074    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"
Jul 20 19:05:49.334033 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:49.333987    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z" podStartSLOduration=1.785307393 podStartE2EDuration="4.333974513s" totalImagesPullingTime="2.54866712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:05:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:05:49.33224596 +0000 UTC m=+312.128253306" watchObservedRunningTime="2026-07-20 19:05:49.333974513 +0000 UTC m=+312.129981916"
Jul 20 19:05:54.344278 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.344239    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"]
Jul 20 19:05:54.348186 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.348162    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.352506 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.352484    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 20 19:05:54.352611 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.352511    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 19:05:54.352794 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.352773    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 20 19:05:54.352794 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.352784    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 20 19:05:54.353446 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.353427    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-g2d5q\""
Jul 20 19:05:54.362946 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.362924    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"]
Jul 20 19:05:54.480891 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.480854    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8247b686-125a-4945-86fa-7ba56a3207ef-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.481015 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.480902    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c5vm\" (UniqueName: \"kubernetes.io/projected/8247b686-125a-4945-86fa-7ba56a3207ef-kube-api-access-6c5vm\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.481015 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.480932    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8247b686-125a-4945-86fa-7ba56a3207ef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.481015 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.480960    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8247b686-125a-4945-86fa-7ba56a3207ef-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.481015 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.480982    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8247b686-125a-4945-86fa-7ba56a3207ef-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.481168 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.481046    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8247b686-125a-4945-86fa-7ba56a3207ef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.481168 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.481076    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8247b686-125a-4945-86fa-7ba56a3207ef-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.581743 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.581720    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8247b686-125a-4945-86fa-7ba56a3207ef-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.581850 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.581757    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c5vm\" (UniqueName: \"kubernetes.io/projected/8247b686-125a-4945-86fa-7ba56a3207ef-kube-api-access-6c5vm\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.581850 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.581800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8247b686-125a-4945-86fa-7ba56a3207ef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.581850 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.581825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8247b686-125a-4945-86fa-7ba56a3207ef-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.582000 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.581861    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8247b686-125a-4945-86fa-7ba56a3207ef-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.582000 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.581897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8247b686-125a-4945-86fa-7ba56a3207ef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.582000 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.581926    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8247b686-125a-4945-86fa-7ba56a3207ef-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.582632 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.582608    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8247b686-125a-4945-86fa-7ba56a3207ef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.584381 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.584353    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8247b686-125a-4945-86fa-7ba56a3207ef-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.584482 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.584459    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8247b686-125a-4945-86fa-7ba56a3207ef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.584526 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.584475    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8247b686-125a-4945-86fa-7ba56a3207ef-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.584526 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.584491    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8247b686-125a-4945-86fa-7ba56a3207ef-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.590251 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.590231    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8247b686-125a-4945-86fa-7ba56a3207ef-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.590470 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.590452    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c5vm\" (UniqueName: \"kubernetes.io/projected/8247b686-125a-4945-86fa-7ba56a3207ef-kube-api-access-6c5vm\") pod \"istiod-openshift-gateway-94bb8fbfd-x7stb\" (UID: \"8247b686-125a-4945-86fa-7ba56a3207ef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.658418 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.658357    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:05:54.825080 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:54.825045    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"]
Jul 20 19:05:54.827723 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:05:54.827698    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8247b686_125a_4945_86fa_7ba56a3207ef.slice/crio-80cf8dcd368d38b15b80a5628ca0542f47aad9dcfeafa7d1b6223d3b969ae011 WatchSource:0}: Error finding container 80cf8dcd368d38b15b80a5628ca0542f47aad9dcfeafa7d1b6223d3b969ae011: Status 404 returned error can't find the container with id 80cf8dcd368d38b15b80a5628ca0542f47aad9dcfeafa7d1b6223d3b969ae011
Jul 20 19:05:55.343156 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:05:55.343102    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb" event={"ID":"8247b686-125a-4945-86fa-7ba56a3207ef","Type":"ContainerStarted","Data":"80cf8dcd368d38b15b80a5628ca0542f47aad9dcfeafa7d1b6223d3b969ae011"}
Jul 20 19:06:00.322687 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:06:00.322655    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-569f4dcc7-lb95z"
Jul 20 19:06:00.546146 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:06:00.546077    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 19:06:00.546223 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:06:00.546201    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 20 19:06:01.374825 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:06:01.374787    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb" event={"ID":"8247b686-125a-4945-86fa-7ba56a3207ef","Type":"ContainerStarted","Data":"c871f629c8d09a6d05c3149d5bc57c3dada36544ce3f3d27774810e0bd9ad79a"}
Jul 20 19:06:01.375287 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:06:01.375018    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:06:01.376748 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:06:01.376720    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-x7stb container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 19:06:01.376871 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:06:01.376788    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb" podUID="8247b686-125a-4945-86fa-7ba56a3207ef" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 19:06:01.397283 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:06:01.396814    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb" podStartSLOduration=1.680980565 podStartE2EDuration="7.396794736s" totalImagesPullingTime="5.715814171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:06:01.395671244 +0000 UTC m=+324.191678578" watchObservedRunningTime="2026-07-20 19:06:01.396794736 +0000 UTC m=+324.192802070"
Jul 20 19:06:02.380536 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:06:02.380510    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x7stb"
Jul 20 19:07:27.408715 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:27.408679    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79c545845b-njx5b"]
Jul 20 19:07:52.430084 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.430025    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79c545845b-njx5b" podUID="e8517436-9eac-4a60-bd93-91103228c9e0" containerName="console" containerID="cri-o://104b49d4fc35faf5806adc1ce3a30cb648b435e42267f98166c6626838e06ef1" gracePeriod=15
Jul 20 19:07:52.681991 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.681938    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:07:52.718882 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.718849    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-oauth-serving-cert\") pod \"e8517436-9eac-4a60-bd93-91103228c9e0\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") "
Jul 20 19:07:52.719014 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.718896    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqzmg\" (UniqueName: \"kubernetes.io/projected/e8517436-9eac-4a60-bd93-91103228c9e0-kube-api-access-hqzmg\") pod \"e8517436-9eac-4a60-bd93-91103228c9e0\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") "
Jul 20 19:07:52.719014 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.718966    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-console-config\") pod \"e8517436-9eac-4a60-bd93-91103228c9e0\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") "
Jul 20 19:07:52.719143 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.719022    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-service-ca\") pod \"e8517436-9eac-4a60-bd93-91103228c9e0\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") "
Jul 20 19:07:52.719143 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.719062    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8517436-9eac-4a60-bd93-91103228c9e0-console-serving-cert\") pod \"e8517436-9eac-4a60-bd93-91103228c9e0\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") "
Jul 20 19:07:52.719143 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.719091    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8517436-9eac-4a60-bd93-91103228c9e0-console-oauth-config\") pod \"e8517436-9eac-4a60-bd93-91103228c9e0\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") "
Jul 20 19:07:52.719143 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.719133    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-trusted-ca-bundle\") pod \"e8517436-9eac-4a60-bd93-91103228c9e0\" (UID: \"e8517436-9eac-4a60-bd93-91103228c9e0\") "
Jul 20 19:07:52.719392 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.719274    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e8517436-9eac-4a60-bd93-91103228c9e0" (UID: "e8517436-9eac-4a60-bd93-91103228c9e0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:07:52.719488 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.719452    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-service-ca" (OuterVolumeSpecName: "service-ca") pod "e8517436-9eac-4a60-bd93-91103228c9e0" (UID: "e8517436-9eac-4a60-bd93-91103228c9e0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:07:52.719488 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.719448    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-console-config" (OuterVolumeSpecName: "console-config") pod "e8517436-9eac-4a60-bd93-91103228c9e0" (UID: "e8517436-9eac-4a60-bd93-91103228c9e0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:07:52.719759 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.719739    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e8517436-9eac-4a60-bd93-91103228c9e0" (UID: "e8517436-9eac-4a60-bd93-91103228c9e0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:07:52.721313 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.721286    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8517436-9eac-4a60-bd93-91103228c9e0-kube-api-access-hqzmg" (OuterVolumeSpecName: "kube-api-access-hqzmg") pod "e8517436-9eac-4a60-bd93-91103228c9e0" (UID: "e8517436-9eac-4a60-bd93-91103228c9e0"). InnerVolumeSpecName "kube-api-access-hqzmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:07:52.721313 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.721296    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8517436-9eac-4a60-bd93-91103228c9e0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e8517436-9eac-4a60-bd93-91103228c9e0" (UID: "e8517436-9eac-4a60-bd93-91103228c9e0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:07:52.721444 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.721347    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8517436-9eac-4a60-bd93-91103228c9e0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e8517436-9eac-4a60-bd93-91103228c9e0" (UID: "e8517436-9eac-4a60-bd93-91103228c9e0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:07:52.820458 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.820435    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8517436-9eac-4a60-bd93-91103228c9e0-console-oauth-config\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:07:52.820458 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.820458    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-trusted-ca-bundle\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:07:52.820580 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.820467    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-oauth-serving-cert\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:07:52.820580 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.820477    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqzmg\" (UniqueName: \"kubernetes.io/projected/e8517436-9eac-4a60-bd93-91103228c9e0-kube-api-access-hqzmg\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:07:52.820580 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.820486    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-console-config\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:07:52.820580 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.820494    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8517436-9eac-4a60-bd93-91103228c9e0-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:07:52.820580 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.820502    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8517436-9eac-4a60-bd93-91103228c9e0-console-serving-cert\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:07:52.893536 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.893512    2560 generic.go:356] "Generic (PLEG): container finished" podID="e8517436-9eac-4a60-bd93-91103228c9e0" containerID="104b49d4fc35faf5806adc1ce3a30cb648b435e42267f98166c6626838e06ef1" exitCode=0
Jul 20 19:07:52.893628 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.893553    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c545845b-njx5b"
Jul 20 19:07:52.893670 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.893554    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c545845b-njx5b" event={"ID":"e8517436-9eac-4a60-bd93-91103228c9e0","Type":"ContainerDied","Data":"104b49d4fc35faf5806adc1ce3a30cb648b435e42267f98166c6626838e06ef1"}
Jul 20 19:07:52.893711 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.893689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c545845b-njx5b" event={"ID":"e8517436-9eac-4a60-bd93-91103228c9e0","Type":"ContainerDied","Data":"c9b4effc458317eacab16559b78d3a09202bf3ff39ec7b055d0c0cac424035a6"}
Jul 20 19:07:52.893760 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.893717    2560 scope.go:117] "RemoveContainer" containerID="104b49d4fc35faf5806adc1ce3a30cb648b435e42267f98166c6626838e06ef1"
Jul 20 19:07:52.902268 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.902252    2560 scope.go:117] "RemoveContainer" containerID="104b49d4fc35faf5806adc1ce3a30cb648b435e42267f98166c6626838e06ef1"
Jul 20 19:07:52.902506 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:07:52.902486    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"104b49d4fc35faf5806adc1ce3a30cb648b435e42267f98166c6626838e06ef1\": container with ID starting with 104b49d4fc35faf5806adc1ce3a30cb648b435e42267f98166c6626838e06ef1 not found: ID does not exist" containerID="104b49d4fc35faf5806adc1ce3a30cb648b435e42267f98166c6626838e06ef1"
Jul 20 19:07:52.902564 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.902513    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"104b49d4fc35faf5806adc1ce3a30cb648b435e42267f98166c6626838e06ef1"} err="failed to get container status \"104b49d4fc35faf5806adc1ce3a30cb648b435e42267f98166c6626838e06ef1\": rpc error: code = NotFound desc = could not find container \"104b49d4fc35faf5806adc1ce3a30cb648b435e42267f98166c6626838e06ef1\": container with ID starting with 104b49d4fc35faf5806adc1ce3a30cb648b435e42267f98166c6626838e06ef1 not found: ID does not exist"
Jul 20 19:07:52.911634 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.911614    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79c545845b-njx5b"]
Jul 20 19:07:52.915003 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:52.914983    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79c545845b-njx5b"]
Jul 20 19:07:54.739191 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:07:54.739161    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8517436-9eac-4a60-bd93-91103228c9e0" path="/var/lib/kubelet/pods/e8517436-9eac-4a60-bd93-91103228c9e0/volumes"
Jul 20 19:08:25.613434 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.613401    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:08:25.613880 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.613755    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8517436-9eac-4a60-bd93-91103228c9e0" containerName="console"
Jul 20 19:08:25.613880 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.613766    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8517436-9eac-4a60-bd93-91103228c9e0" containerName="console"
Jul 20 19:08:25.613880 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.613842    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8517436-9eac-4a60-bd93-91103228c9e0" containerName="console"
Jul 20 19:08:25.617175 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.617147    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"
Jul 20 19:08:25.619618 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.619589    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 20 19:08:25.619618 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.619589    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 19:08:25.620327 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.620303    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 19:08:25.620444 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.620312    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rdzrm\""
Jul 20 19:08:25.627071 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.627047    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:08:25.659480 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.659452    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:08:25.706094 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.706073    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d1441c0e-c7ec-4f9b-a5b4-47f4489efca2-config-file\") pod \"limitador-limitador-54d6d988d5-hqwmw\" (UID: \"d1441c0e-c7ec-4f9b-a5b4-47f4489efca2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"
Jul 20 19:08:25.706209 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.706148    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlfxb\" (UniqueName: \"kubernetes.io/projected/d1441c0e-c7ec-4f9b-a5b4-47f4489efca2-kube-api-access-mlfxb\") pod \"limitador-limitador-54d6d988d5-hqwmw\" (UID: \"d1441c0e-c7ec-4f9b-a5b4-47f4489efca2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"
Jul 20 19:08:25.807099 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.807070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlfxb\" (UniqueName: \"kubernetes.io/projected/d1441c0e-c7ec-4f9b-a5b4-47f4489efca2-kube-api-access-mlfxb\") pod \"limitador-limitador-54d6d988d5-hqwmw\" (UID: \"d1441c0e-c7ec-4f9b-a5b4-47f4489efca2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"
Jul 20 19:08:25.807255 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.807216    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d1441c0e-c7ec-4f9b-a5b4-47f4489efca2-config-file\") pod \"limitador-limitador-54d6d988d5-hqwmw\" (UID: \"d1441c0e-c7ec-4f9b-a5b4-47f4489efca2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"
Jul 20 19:08:25.807759 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.807742    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d1441c0e-c7ec-4f9b-a5b4-47f4489efca2-config-file\") pod \"limitador-limitador-54d6d988d5-hqwmw\" (UID: \"d1441c0e-c7ec-4f9b-a5b4-47f4489efca2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"
Jul 20 19:08:25.816337 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.816314    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlfxb\" (UniqueName: \"kubernetes.io/projected/d1441c0e-c7ec-4f9b-a5b4-47f4489efca2-kube-api-access-mlfxb\") pod \"limitador-limitador-54d6d988d5-hqwmw\" (UID: \"d1441c0e-c7ec-4f9b-a5b4-47f4489efca2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"
Jul 20 19:08:25.928654 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:25.928601    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"
Jul 20 19:08:26.060696 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:26.060671    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:08:26.063080 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:08:26.063050    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1441c0e_c7ec_4f9b_a5b4_47f4489efca2.slice/crio-6e91ee033deb584c4f5ca9dbfd3449f3854b52eb27390b3201b8954fa9e643de WatchSource:0}: Error finding container 6e91ee033deb584c4f5ca9dbfd3449f3854b52eb27390b3201b8954fa9e643de: Status 404 returned error can't find the container with id 6e91ee033deb584c4f5ca9dbfd3449f3854b52eb27390b3201b8954fa9e643de
Jul 20 19:08:27.061716 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:27.061682    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hqwmw" event={"ID":"d1441c0e-c7ec-4f9b-a5b4-47f4489efca2","Type":"ContainerStarted","Data":"6e91ee033deb584c4f5ca9dbfd3449f3854b52eb27390b3201b8954fa9e643de"}
Jul 20 19:08:30.077729 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:30.077697    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hqwmw" event={"ID":"d1441c0e-c7ec-4f9b-a5b4-47f4489efca2","Type":"ContainerStarted","Data":"f7f94d3873bf607a178bdf91b59df486856090652143d896bbc38270bf5d5419"}
Jul 20 19:08:30.078085 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:30.077766    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"
Jul 20 19:08:30.096106 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:30.096059    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-hqwmw" podStartSLOduration=1.7436412909999999 podStartE2EDuration="5.096045099s" totalImagesPullingTime="3.352403808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:08:30.095140992 +0000 UTC m=+472.891148319" watchObservedRunningTime="2026-07-20 19:08:30.096045099 +0000 UTC m=+472.892052432"
Jul 20 19:08:41.084412 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:08:41.084381    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"
Jul 20 19:09:39.674133 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:09:39.674082    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:09:58.208142 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:09:58.208092    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:10:37.672973 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:37.672944    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:10:37.673617 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:37.673596    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:10:37.676545 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:37.676512    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:10:37.677349 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:37.677327    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:10:37.816910 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:37.816883    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:10:42.911957 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:42.911917    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"]
Jul 20 19:10:42.916210 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:42.916185    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:42.918866 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:42.918839    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 19:10:42.918866 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:42.918856    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 20 19:10:42.919905 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:42.919887    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-87hgb\""
Jul 20 19:10:42.919977 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:42.919890    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 19:10:42.927082 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:42.927060    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"]
Jul 20 19:10:43.092619 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.092586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw7bj\" (UniqueName: \"kubernetes.io/projected/d5499da4-600e-40bf-b3c3-5e6290fb78ee-kube-api-access-nw7bj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.092746 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.092636    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5499da4-600e-40bf-b3c3-5e6290fb78ee-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.092787 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.092737    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5499da4-600e-40bf-b3c3-5e6290fb78ee-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.092787 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.092767    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5499da4-600e-40bf-b3c3-5e6290fb78ee-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.092852 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.092788    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5499da4-600e-40bf-b3c3-5e6290fb78ee-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.092852 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.092836    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5499da4-600e-40bf-b3c3-5e6290fb78ee-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.194036 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.194012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw7bj\" (UniqueName: \"kubernetes.io/projected/d5499da4-600e-40bf-b3c3-5e6290fb78ee-kube-api-access-nw7bj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.194167 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.194055    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5499da4-600e-40bf-b3c3-5e6290fb78ee-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.194167 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.194089    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5499da4-600e-40bf-b3c3-5e6290fb78ee-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.194167 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.194108    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5499da4-600e-40bf-b3c3-5e6290fb78ee-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.194167 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.194153    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5499da4-600e-40bf-b3c3-5e6290fb78ee-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.194347 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.194290    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5499da4-600e-40bf-b3c3-5e6290fb78ee-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.194530 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.194510    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5499da4-600e-40bf-b3c3-5e6290fb78ee-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.194574 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.194550    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5499da4-600e-40bf-b3c3-5e6290fb78ee-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.194619 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.194554    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5499da4-600e-40bf-b3c3-5e6290fb78ee-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.196425 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.196399    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5499da4-600e-40bf-b3c3-5e6290fb78ee-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.196700 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.196684    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5499da4-600e-40bf-b3c3-5e6290fb78ee-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.202327 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.202310    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw7bj\" (UniqueName: \"kubernetes.io/projected/d5499da4-600e-40bf-b3c3-5e6290fb78ee-kube-api-access-nw7bj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ltxjc\" (UID: \"d5499da4-600e-40bf-b3c3-5e6290fb78ee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.227181 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.227157    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:43.362951 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.362928    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"]
Jul 20 19:10:43.365369 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:10:43.365339    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5499da4_600e_40bf_b3c3_5e6290fb78ee.slice/crio-b7b29834fa51e60aa93cda79fc8a0e69c594249aea1da4ac13fa4ff42dbdb5be WatchSource:0}: Error finding container b7b29834fa51e60aa93cda79fc8a0e69c594249aea1da4ac13fa4ff42dbdb5be: Status 404 returned error can't find the container with id b7b29834fa51e60aa93cda79fc8a0e69c594249aea1da4ac13fa4ff42dbdb5be
Jul 20 19:10:43.703139 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.703070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc" event={"ID":"d5499da4-600e-40bf-b3c3-5e6290fb78ee","Type":"ContainerStarted","Data":"b7b29834fa51e60aa93cda79fc8a0e69c594249aea1da4ac13fa4ff42dbdb5be"}
Jul 20 19:10:43.913349 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:43.913039    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:10:44.709292 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:44.709254    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc" event={"ID":"d5499da4-600e-40bf-b3c3-5e6290fb78ee","Type":"ContainerStarted","Data":"87491d5389e056e1710312c7c83f35f4331ff7808c010a781f99687dc606092d"}
Jul 20 19:10:44.732915 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:44.732859    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc" podStartSLOduration=1.698307596 podStartE2EDuration="2.732844178s" totalImagesPullingTime="1.034536582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:10:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:10:44.732316948 +0000 UTC m=+607.528324282" watchObservedRunningTime="2026-07-20 19:10:44.732844178 +0000 UTC m=+607.528851511"
Jul 20 19:10:49.714582 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:49.714544    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:10:53.228141 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:53.228091    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:53.228518 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:53.228164    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:53.240349 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:53.240327    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:10:53.764150 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:10:53.764104    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ltxjc"
Jul 20 19:11:02.319240 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:11:02.319148    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:11:13.819199 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:11:13.819162    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:12:30.712352 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:12:30.712268    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:12:40.504665 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:12:40.504628    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:12:50.718322 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:12:50.718287    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:14:36.308642 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:14:36.308604    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:14:45.015451 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:14:45.015419    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:14:57.323985 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:14:57.323949    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:15:15.513610 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:15:15.513572    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:15:24.214301 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:15:24.214263    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:15:32.724649 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:15:32.724561    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:15:37.701824 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:15:37.701796    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:15:37.704130 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:15:37.704104    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:15:37.705347 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:15:37.705325    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:15:37.707554 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:15:37.707537    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:15:41.506416 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:15:41.506385    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:15:52.712278 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:15:52.712243    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:16:02.229425 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:16:02.229392    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:16:13.436959 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:16:13.436906    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:16:21.206282 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:16:21.206247    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:16:28.510758 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:16:28.510720    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:16:37.106649 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:16:37.106617    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:16:49.003306 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:16:49.003271    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:16:58.910880 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:16:58.910845    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:17:22.611891 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:17:22.611813    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:17:32.909771 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:17:32.909719    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:17:48.407515 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:17:48.407465    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:17:59.905585 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:17:59.905553    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:18:08.916050 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:18:08.916016    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:18:18.003061 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:18:18.003023    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:18:26.513919 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:18:26.513880    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:20:16.405522 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:20:16.405487    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:20:28.309456 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:20:28.309407    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:20:36.321453 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:20:36.321415    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:20:37.738579 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:20:37.738546    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:20:37.741972 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:20:37.741952    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:20:37.742605 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:20:37.742589    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:20:37.746107 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:20:37.746089    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:20:48.813423 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:20:48.813390    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:20:57.914594 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:20:57.914558    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:21:08.618278 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:21:08.618242    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:21:17.117548 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:21:17.117514    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:21:28.006349 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:21:28.006312    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:21:39.818815 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:21:39.818777    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:21:46.708087 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:21:46.708052    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:21:56.004063 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:21:56.004030    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:22:04.741050 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:04.741002    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:22:25.798299 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:25.798261    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:22:33.206454 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.206418    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:22:33.819983 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.819948    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"]
Jul 20 19:22:33.823382 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.823359    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:33.825669 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.825649    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-5db00266-kserve-self-signed-certs\""
Jul 20 19:22:33.844413 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.844386    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"]
Jul 20 19:22:33.891448 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.891428    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8007d7e-5a99-4ac2-801c-f2f675d2e536-tls-certs\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:33.891555 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.891458    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-tmp-dir\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:33.891555 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.891495    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trv5l\" (UniqueName: \"kubernetes.io/projected/b8007d7e-5a99-4ac2-801c-f2f675d2e536-kube-api-access-trv5l\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:33.891677 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.891592    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-model-cache\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:33.891677 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.891668    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-home\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:33.891779 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.891694    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-dshm\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:33.992873 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.992844    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-model-cache\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:33.992978 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.992908    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-home\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:33.992978 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.992935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-dshm\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:33.993098 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.992983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8007d7e-5a99-4ac2-801c-f2f675d2e536-tls-certs\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:33.993098 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.993009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-tmp-dir\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:33.993098 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.993063    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trv5l\" (UniqueName: \"kubernetes.io/projected/b8007d7e-5a99-4ac2-801c-f2f675d2e536-kube-api-access-trv5l\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:33.993338 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.993310    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-model-cache\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:33.993639 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.993613    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-home\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:33.993735 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.993701    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-tmp-dir\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:33.995612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.995593    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-dshm\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:33.995612 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:33.995604    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8007d7e-5a99-4ac2-801c-f2f675d2e536-tls-certs\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:34.000505 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:34.000488    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trv5l\" (UniqueName: \"kubernetes.io/projected/b8007d7e-5a99-4ac2-801c-f2f675d2e536-kube-api-access-trv5l\") pod \"e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") " pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:34.132553 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:34.132493    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:34.264273 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:34.264247    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"]
Jul 20 19:22:34.266349 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:22:34.266322    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8007d7e_5a99_4ac2_801c_f2f675d2e536.slice/crio-8787bf36964d971fe7c1466ede5c7ec85c934c16c1bde3ae2e95b845fd470437 WatchSource:0}: Error finding container 8787bf36964d971fe7c1466ede5c7ec85c934c16c1bde3ae2e95b845fd470437: Status 404 returned error can't find the container with id 8787bf36964d971fe7c1466ede5c7ec85c934c16c1bde3ae2e95b845fd470437
Jul 20 19:22:35.066587 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:35.066557    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j" event={"ID":"b8007d7e-5a99-4ac2-801c-f2f675d2e536","Type":"ContainerStarted","Data":"2a10fee21570fb6e575c2fb1de01b06c2049755036957a969bc6584ad62c1897"}
Jul 20 19:22:35.066806 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:35.066595    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j" event={"ID":"b8007d7e-5a99-4ac2-801c-f2f675d2e536","Type":"ContainerStarted","Data":"8787bf36964d971fe7c1466ede5c7ec85c934c16c1bde3ae2e95b845fd470437"}
Jul 20 19:22:35.085047 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:35.085005    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j" podStartSLOduration=2.084992258 podStartE2EDuration="2.084992258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:22:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:35.082699318 +0000 UTC m=+1317.878706651" watchObservedRunningTime="2026-07-20 19:22:35.084992258 +0000 UTC m=+1317.880999590"
Jul 20 19:22:44.132794 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:44.132714    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:44.132794 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:44.132759    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:44.145944 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:44.145918    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:45.121997 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:45.121969    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:22:45.598779 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:45.598745    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:22:53.699941 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.699909    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"]
Jul 20 19:22:53.703623 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.703603    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.705861 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.705845    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-5db00266-kserve-self-signed-certs\""
Jul 20 19:22:53.712111 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.712088    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"]
Jul 20 19:22:53.853879 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.853852    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-home\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.853996 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.853944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-tmp-dir\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.853996 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.853978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-model-cache\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.854088 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.854052    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-tls-certs\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.854153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.854104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-dshm\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.854153 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.854141    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5mpt\" (UniqueName: \"kubernetes.io/projected/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-kube-api-access-l5mpt\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.955001 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.954935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-home\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.955001 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.954998    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-tmp-dir\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.955188 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.955025    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-model-cache\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.955188 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.955080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-tls-certs\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.955188 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.955109    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-dshm\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.955188 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.955152    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5mpt\" (UniqueName: \"kubernetes.io/projected/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-kube-api-access-l5mpt\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.955422 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.955397    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-home\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.955466 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.955426    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-model-cache\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.955501 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.955481    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-tmp-dir\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.957420 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.957396    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-dshm\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.957628 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.957609    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-tls-certs\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:53.962391 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:53.962370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5mpt\" (UniqueName: \"kubernetes.io/projected/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-kube-api-access-l5mpt\") pod \"e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") " pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:54.013070 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:54.013047    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:22:54.142885 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:54.142860    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"]
Jul 20 19:22:54.145775 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:22:54.145748    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d33141f_7b0f_4aa2_bc78_1cd7623a2048.slice/crio-75d7beda4732e0afe08ae3aabc43aed8226b4540ec325c32c26cbfa4b6dc34a5 WatchSource:0}: Error finding container 75d7beda4732e0afe08ae3aabc43aed8226b4540ec325c32c26cbfa4b6dc34a5: Status 404 returned error can't find the container with id 75d7beda4732e0afe08ae3aabc43aed8226b4540ec325c32c26cbfa4b6dc34a5
Jul 20 19:22:54.153293 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:54.153263    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp" event={"ID":"4d33141f-7b0f-4aa2-bc78-1cd7623a2048","Type":"ContainerStarted","Data":"75d7beda4732e0afe08ae3aabc43aed8226b4540ec325c32c26cbfa4b6dc34a5"}
Jul 20 19:22:55.159530 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:55.159500    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp" event={"ID":"4d33141f-7b0f-4aa2-bc78-1cd7623a2048","Type":"ContainerStarted","Data":"5e2b32041b5636500e70abb9b4c74efae61122fcfd5adda183bc04826a4f9752"}
Jul 20 19:22:55.176706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:55.176662    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp" podStartSLOduration=2.176646327 podStartE2EDuration="2.176646327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:22:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:22:55.174518723 +0000 UTC m=+1337.970526061" watchObservedRunningTime="2026-07-20 19:22:55.176646327 +0000 UTC m=+1337.972653661"
Jul 20 19:22:57.807780 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:22:57.807745    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:23:04.013402 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:04.013323    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:23:04.013402 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:04.013369    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:23:04.025881 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:04.025862    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:23:04.212040 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:04.212014    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:23:24.242199 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:24.242167    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"]
Jul 20 19:23:24.892200 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:24.892169    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"]
Jul 20 19:23:27.906907 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:27.906866    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:23:39.262510 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.262443    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j" podUID="b8007d7e-5a99-4ac2-801c-f2f675d2e536" containerName="main" containerID="cri-o://2a10fee21570fb6e575c2fb1de01b06c2049755036957a969bc6584ad62c1897" gracePeriod=45
Jul 20 19:23:39.508095 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.508072    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:23:39.618829 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.618748    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-tmp-dir\") pod \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") "
Jul 20 19:23:39.618829 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.618787    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-home\") pod \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") "
Jul 20 19:23:39.618829 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.618809    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-dshm\") pod \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") "
Jul 20 19:23:39.619255 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.618867    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trv5l\" (UniqueName: \"kubernetes.io/projected/b8007d7e-5a99-4ac2-801c-f2f675d2e536-kube-api-access-trv5l\") pod \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") "
Jul 20 19:23:39.619255 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.618898    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-model-cache\") pod \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") "
Jul 20 19:23:39.619255 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.618993    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8007d7e-5a99-4ac2-801c-f2f675d2e536-tls-certs\") pod \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\" (UID: \"b8007d7e-5a99-4ac2-801c-f2f675d2e536\") "
Jul 20 19:23:39.619255 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.619027    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-home" (OuterVolumeSpecName: "home") pod "b8007d7e-5a99-4ac2-801c-f2f675d2e536" (UID: "b8007d7e-5a99-4ac2-801c-f2f675d2e536"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:23:39.619255 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.619040    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b8007d7e-5a99-4ac2-801c-f2f675d2e536" (UID: "b8007d7e-5a99-4ac2-801c-f2f675d2e536"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:23:39.619255 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.619191    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-model-cache" (OuterVolumeSpecName: "model-cache") pod "b8007d7e-5a99-4ac2-801c-f2f675d2e536" (UID: "b8007d7e-5a99-4ac2-801c-f2f675d2e536"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:23:39.619463 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.619290    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-tmp-dir\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:23:39.619463 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.619303    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-home\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:23:39.619463 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.619313    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-model-cache\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:23:39.621069 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.621048    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8007d7e-5a99-4ac2-801c-f2f675d2e536-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b8007d7e-5a99-4ac2-801c-f2f675d2e536" (UID: "b8007d7e-5a99-4ac2-801c-f2f675d2e536"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:23:39.621151 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.621085    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8007d7e-5a99-4ac2-801c-f2f675d2e536-kube-api-access-trv5l" (OuterVolumeSpecName: "kube-api-access-trv5l") pod "b8007d7e-5a99-4ac2-801c-f2f675d2e536" (UID: "b8007d7e-5a99-4ac2-801c-f2f675d2e536"). InnerVolumeSpecName "kube-api-access-trv5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:23:39.621198 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.621146    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-dshm" (OuterVolumeSpecName: "dshm") pod "b8007d7e-5a99-4ac2-801c-f2f675d2e536" (UID: "b8007d7e-5a99-4ac2-801c-f2f675d2e536"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:23:39.720413 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.720387    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8007d7e-5a99-4ac2-801c-f2f675d2e536-dshm\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:23:39.720413 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.720411    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trv5l\" (UniqueName: \"kubernetes.io/projected/b8007d7e-5a99-4ac2-801c-f2f675d2e536-kube-api-access-trv5l\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:23:39.720560 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.720420    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8007d7e-5a99-4ac2-801c-f2f675d2e536-tls-certs\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:23:39.912155 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:39.912067    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp" podUID="4d33141f-7b0f-4aa2-bc78-1cd7623a2048" containerName="main" containerID="cri-o://5e2b32041b5636500e70abb9b4c74efae61122fcfd5adda183bc04826a4f9752" gracePeriod=45
Jul 20 19:23:40.150103 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.150077    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:23:40.224570 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.224545    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-tmp-dir\") pod \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") "
Jul 20 19:23:40.224734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.224582    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-tls-certs\") pod \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") "
Jul 20 19:23:40.224734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.224631    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-model-cache\") pod \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") "
Jul 20 19:23:40.224734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.224660    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-dshm\") pod \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") "
Jul 20 19:23:40.224734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.224684    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5mpt\" (UniqueName: \"kubernetes.io/projected/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-kube-api-access-l5mpt\") pod \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") "
Jul 20 19:23:40.224734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.224710    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-home\") pod \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\" (UID: \"4d33141f-7b0f-4aa2-bc78-1cd7623a2048\") "
Jul 20 19:23:40.224980 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.224823    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4d33141f-7b0f-4aa2-bc78-1cd7623a2048" (UID: "4d33141f-7b0f-4aa2-bc78-1cd7623a2048"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:23:40.224980 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.224913    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-model-cache" (OuterVolumeSpecName: "model-cache") pod "4d33141f-7b0f-4aa2-bc78-1cd7623a2048" (UID: "4d33141f-7b0f-4aa2-bc78-1cd7623a2048"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:23:40.225083 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.225030    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-home" (OuterVolumeSpecName: "home") pod "4d33141f-7b0f-4aa2-bc78-1cd7623a2048" (UID: "4d33141f-7b0f-4aa2-bc78-1cd7623a2048"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:23:40.225167 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.225088    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-tmp-dir\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:23:40.225167 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.225101    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-model-cache\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:23:40.225167 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.225114    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-home\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:23:40.226734 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.226710    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-dshm" (OuterVolumeSpecName: "dshm") pod "4d33141f-7b0f-4aa2-bc78-1cd7623a2048" (UID: "4d33141f-7b0f-4aa2-bc78-1cd7623a2048"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:23:40.226829 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.226768    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4d33141f-7b0f-4aa2-bc78-1cd7623a2048" (UID: "4d33141f-7b0f-4aa2-bc78-1cd7623a2048"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:23:40.226829 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.226779    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-kube-api-access-l5mpt" (OuterVolumeSpecName: "kube-api-access-l5mpt") pod "4d33141f-7b0f-4aa2-bc78-1cd7623a2048" (UID: "4d33141f-7b0f-4aa2-bc78-1cd7623a2048"). InnerVolumeSpecName "kube-api-access-l5mpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:23:40.325504 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.325484    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-tls-certs\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:23:40.325504 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.325505    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-dshm\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:23:40.325823 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.325514    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5mpt\" (UniqueName: \"kubernetes.io/projected/4d33141f-7b0f-4aa2-bc78-1cd7623a2048-kube-api-access-l5mpt\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:23:40.378989 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.378960    2560 generic.go:356] "Generic (PLEG): container finished" podID="b8007d7e-5a99-4ac2-801c-f2f675d2e536" containerID="2a10fee21570fb6e575c2fb1de01b06c2049755036957a969bc6584ad62c1897" exitCode=0
Jul 20 19:23:40.379314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.379002    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"
Jul 20 19:23:40.379314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.379053    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j" event={"ID":"b8007d7e-5a99-4ac2-801c-f2f675d2e536","Type":"ContainerDied","Data":"2a10fee21570fb6e575c2fb1de01b06c2049755036957a969bc6584ad62c1897"}
Jul 20 19:23:40.379314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.379095    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j" event={"ID":"b8007d7e-5a99-4ac2-801c-f2f675d2e536","Type":"ContainerDied","Data":"8787bf36964d971fe7c1466ede5c7ec85c934c16c1bde3ae2e95b845fd470437"}
Jul 20 19:23:40.379314 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.379139    2560 scope.go:117] "RemoveContainer" containerID="2a10fee21570fb6e575c2fb1de01b06c2049755036957a969bc6584ad62c1897"
Jul 20 19:23:40.380460 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.380442    2560 generic.go:356] "Generic (PLEG): container finished" podID="4d33141f-7b0f-4aa2-bc78-1cd7623a2048" containerID="5e2b32041b5636500e70abb9b4c74efae61122fcfd5adda183bc04826a4f9752" exitCode=0
Jul 20 19:23:40.380548 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.380471    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp" event={"ID":"4d33141f-7b0f-4aa2-bc78-1cd7623a2048","Type":"ContainerDied","Data":"5e2b32041b5636500e70abb9b4c74efae61122fcfd5adda183bc04826a4f9752"}
Jul 20 19:23:40.380548 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.380481    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"
Jul 20 19:23:40.380548 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.380493    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp" event={"ID":"4d33141f-7b0f-4aa2-bc78-1cd7623a2048","Type":"ContainerDied","Data":"75d7beda4732e0afe08ae3aabc43aed8226b4540ec325c32c26cbfa4b6dc34a5"}
Jul 20 19:23:40.388592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.388571    2560 scope.go:117] "RemoveContainer" containerID="2a10fee21570fb6e575c2fb1de01b06c2049755036957a969bc6584ad62c1897"
Jul 20 19:23:40.388835 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:23:40.388817    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a10fee21570fb6e575c2fb1de01b06c2049755036957a969bc6584ad62c1897\": container with ID starting with 2a10fee21570fb6e575c2fb1de01b06c2049755036957a969bc6584ad62c1897 not found: ID does not exist" containerID="2a10fee21570fb6e575c2fb1de01b06c2049755036957a969bc6584ad62c1897"
Jul 20 19:23:40.388918 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.388847    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a10fee21570fb6e575c2fb1de01b06c2049755036957a969bc6584ad62c1897"} err="failed to get container status \"2a10fee21570fb6e575c2fb1de01b06c2049755036957a969bc6584ad62c1897\": rpc error: code = NotFound desc = could not find container \"2a10fee21570fb6e575c2fb1de01b06c2049755036957a969bc6584ad62c1897\": container with ID starting with 2a10fee21570fb6e575c2fb1de01b06c2049755036957a969bc6584ad62c1897 not found: ID does not exist"
Jul 20 19:23:40.388918 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.388878    2560 scope.go:117] "RemoveContainer" containerID="5e2b32041b5636500e70abb9b4c74efae61122fcfd5adda183bc04826a4f9752"
Jul 20 19:23:40.396683 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.396669    2560 scope.go:117] "RemoveContainer" containerID="5e2b32041b5636500e70abb9b4c74efae61122fcfd5adda183bc04826a4f9752"
Jul 20 19:23:40.396891 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:23:40.396866    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e2b32041b5636500e70abb9b4c74efae61122fcfd5adda183bc04826a4f9752\": container with ID starting with 5e2b32041b5636500e70abb9b4c74efae61122fcfd5adda183bc04826a4f9752 not found: ID does not exist" containerID="5e2b32041b5636500e70abb9b4c74efae61122fcfd5adda183bc04826a4f9752"
Jul 20 19:23:40.396935 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.396896    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e2b32041b5636500e70abb9b4c74efae61122fcfd5adda183bc04826a4f9752"} err="failed to get container status \"5e2b32041b5636500e70abb9b4c74efae61122fcfd5adda183bc04826a4f9752\": rpc error: code = NotFound desc = could not find container \"5e2b32041b5636500e70abb9b4c74efae61122fcfd5adda183bc04826a4f9752\": container with ID starting with 5e2b32041b5636500e70abb9b4c74efae61122fcfd5adda183bc04826a4f9752 not found: ID does not exist"
Jul 20 19:23:40.402933 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.402861    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"]
Jul 20 19:23:40.404580 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.404559    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-5db00266-kserve-f95566fdc-kjw8j"]
Jul 20 19:23:40.413946 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.413923    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"]
Jul 20 19:23:40.417693 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.417673    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-5db00266-kserve-85fc8585f9-sttvp"]
Jul 20 19:23:40.710205 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.710175    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:23:40.739741 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.739715    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d33141f-7b0f-4aa2-bc78-1cd7623a2048" path="/var/lib/kubelet/pods/4d33141f-7b0f-4aa2-bc78-1cd7623a2048/volumes"
Jul 20 19:23:40.740147 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:40.740111    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8007d7e-5a99-4ac2-801c-f2f675d2e536" path="/var/lib/kubelet/pods/b8007d7e-5a99-4ac2-801c-f2f675d2e536/volumes"
Jul 20 19:23:49.908289 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:23:49.908243    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:24:01.217475 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:24:01.217437    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:24:10.317766 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:24:10.317728    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:24:19.605602 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:24:19.605568    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:24:26.918688 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:24:26.918655    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:24:37.622356 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:24:37.622322    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:24:45.929405 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:24:45.929366    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:24:51.551259 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:24:51.551223    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:25:01.388156 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:25:01.388101    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:25:18.654415 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:25:18.654380    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:25:30.621486 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:25:30.621451    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:25:37.768940 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:25:37.768910    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:25:37.771992 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:25:37.771974    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:25:37.772797 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:25:37.772779    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:25:37.776179 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:25:37.776159    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:25:40.243746 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:25:40.243708    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:25:52.544013 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:25:52.543982    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:26:08.280234 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:26:08.280139    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:26:20.220295 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:26:20.220263    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:26:33.359334 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:26:33.359292    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:26:42.629656 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:26:42.629621    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:26:52.715039 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:26:52.715002    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:27:05.023736 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:05.023694    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:27:19.917169 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:19.917112    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:27:39.914912 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:39.914877    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8"]
Jul 20 19:27:39.915821 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:39.915793    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d33141f-7b0f-4aa2-bc78-1cd7623a2048" containerName="main"
Jul 20 19:27:39.915987 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:39.915961    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d33141f-7b0f-4aa2-bc78-1cd7623a2048" containerName="main"
Jul 20 19:27:39.916050 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:39.916037    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8007d7e-5a99-4ac2-801c-f2f675d2e536" containerName="main"
Jul 20 19:27:39.916050 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:39.916048    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8007d7e-5a99-4ac2-801c-f2f675d2e536" containerName="main"
Jul 20 19:27:39.916354 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:39.916339    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8007d7e-5a99-4ac2-801c-f2f675d2e536" containerName="main"
Jul 20 19:27:39.916436 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:39.916360    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d33141f-7b0f-4aa2-bc78-1cd7623a2048" containerName="main"
Jul 20 19:27:39.923034 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:39.923010    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8"
Jul 20 19:27:39.929114 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:39.929081    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jx7gs\""
Jul 20 19:27:39.929591 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:39.929562    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:27:39.931009 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:39.930714    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8"]
Jul 20 19:27:40.038413 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:40.038388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c9477ed-870e-4bda-a15b-e9e20c1245d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8\" (UID: \"3c9477ed-870e-4bda-a15b-e9e20c1245d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8"
Jul 20 19:27:40.139668 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:40.139640    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c9477ed-870e-4bda-a15b-e9e20c1245d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8\" (UID: \"3c9477ed-870e-4bda-a15b-e9e20c1245d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8"
Jul 20 19:27:40.140335 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:40.140316    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c9477ed-870e-4bda-a15b-e9e20c1245d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8\" (UID: \"3c9477ed-870e-4bda-a15b-e9e20c1245d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8"
Jul 20 19:27:40.235384 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:40.235367    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8"
Jul 20 19:27:40.370567 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:40.370417    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8"]
Jul 20 19:27:40.372760 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:27:40.372730    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9477ed_870e_4bda_a15b_e9e20c1245d4.slice/crio-68709115996f9143a252d5b7842e3c48b625b17d963b4effba654e2edc6380b0 WatchSource:0}: Error finding container 68709115996f9143a252d5b7842e3c48b625b17d963b4effba654e2edc6380b0: Status 404 returned error can't find the container with id 68709115996f9143a252d5b7842e3c48b625b17d963b4effba654e2edc6380b0
Jul 20 19:27:40.374537 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:40.374521    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:27:40.518419 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:40.518356    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8" event={"ID":"3c9477ed-870e-4bda-a15b-e9e20c1245d4","Type":"ContainerStarted","Data":"68709115996f9143a252d5b7842e3c48b625b17d963b4effba654e2edc6380b0"}
Jul 20 19:27:43.540318 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:43.540288    2560 generic.go:356] "Generic (PLEG): container finished" podID="3c9477ed-870e-4bda-a15b-e9e20c1245d4" containerID="13ef1c88be4926ada0ee36d8d76c2ac92de9dce719f43bf90a7f7503f043d4a0" exitCode=0
Jul 20 19:27:43.540667 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:43.540365    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8" event={"ID":"3c9477ed-870e-4bda-a15b-e9e20c1245d4","Type":"ContainerDied","Data":"13ef1c88be4926ada0ee36d8d76c2ac92de9dce719f43bf90a7f7503f043d4a0"}
Jul 20 19:27:44.675342 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:44.675318    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8"
Jul 20 19:27:44.779979 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:44.779955    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c9477ed-870e-4bda-a15b-e9e20c1245d4-maas-api-service-ca\") pod \"3c9477ed-870e-4bda-a15b-e9e20c1245d4\" (UID: \"3c9477ed-870e-4bda-a15b-e9e20c1245d4\") "
Jul 20 19:27:44.780294 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:44.780271    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c9477ed-870e-4bda-a15b-e9e20c1245d4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3c9477ed-870e-4bda-a15b-e9e20c1245d4" (UID: "3c9477ed-870e-4bda-a15b-e9e20c1245d4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:27:44.881038 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:44.880973    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c9477ed-870e-4bda-a15b-e9e20c1245d4-maas-api-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:27:45.551002 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:45.550974    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8"
Jul 20 19:27:45.551197 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:45.551016    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8" event={"ID":"3c9477ed-870e-4bda-a15b-e9e20c1245d4","Type":"ContainerDied","Data":"68709115996f9143a252d5b7842e3c48b625b17d963b4effba654e2edc6380b0"}
Jul 20 19:27:45.551197 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:45.551061    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68709115996f9143a252d5b7842e3c48b625b17d963b4effba654e2edc6380b0"
Jul 20 19:27:53.116792 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:53.116757    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:27:55.023405 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:55.023367    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8"]
Jul 20 19:27:55.026454 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:55.026430    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b1e95d9e-kktz8"]
Jul 20 19:27:56.739547 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:27:56.739518    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c9477ed-870e-4bda-a15b-e9e20c1245d4" path="/var/lib/kubelet/pods/3c9477ed-870e-4bda-a15b-e9e20c1245d4/volumes"
Jul 20 19:28:02.714981 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:02.714942    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:28:23.700859 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:23.700818    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx"]
Jul 20 19:28:23.701427 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:23.701384    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9477ed-870e-4bda-a15b-e9e20c1245d4" containerName="revoke-keys"
Jul 20 19:28:23.701427 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:23.701407    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9477ed-870e-4bda-a15b-e9e20c1245d4" containerName="revoke-keys"
Jul 20 19:28:23.701550 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:23.701532    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c9477ed-870e-4bda-a15b-e9e20c1245d4" containerName="revoke-keys"
Jul 20 19:28:23.705417 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:23.705395    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx"
Jul 20 19:28:23.707793 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:23.707770    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:28:23.707915 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:23.707808    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jx7gs\""
Jul 20 19:28:23.711950 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:23.711880    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx"]
Jul 20 19:28:23.775542 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:23.775512    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53638e82-b596-46e2-8a56-5fef15851dd4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx\" (UID: \"53638e82-b596-46e2-8a56-5fef15851dd4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx"
Jul 20 19:28:23.876451 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:23.876425    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53638e82-b596-46e2-8a56-5fef15851dd4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx\" (UID: \"53638e82-b596-46e2-8a56-5fef15851dd4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx"
Jul 20 19:28:23.877059 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:23.877039    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53638e82-b596-46e2-8a56-5fef15851dd4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx\" (UID: \"53638e82-b596-46e2-8a56-5fef15851dd4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx"
Jul 20 19:28:24.017212 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:24.017150    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx"
Jul 20 19:28:24.150843 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:24.150819    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx"]
Jul 20 19:28:24.153792 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:28:24.153761    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53638e82_b596_46e2_8a56_5fef15851dd4.slice/crio-e6f6a4a328326cafd00b2ab1eea63edbad1db8bcc1979f18386497b25e3a1241 WatchSource:0}: Error finding container e6f6a4a328326cafd00b2ab1eea63edbad1db8bcc1979f18386497b25e3a1241: Status 404 returned error can't find the container with id e6f6a4a328326cafd00b2ab1eea63edbad1db8bcc1979f18386497b25e3a1241
Jul 20 19:28:24.743900 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:24.743867    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx" event={"ID":"53638e82-b596-46e2-8a56-5fef15851dd4","Type":"ContainerStarted","Data":"b3ee2956f7b46b3976ee8d1d047b6af472d574c7bf2ccedc97622910a002937f"}
Jul 20 19:28:24.744269 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:24.743915    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx" event={"ID":"53638e82-b596-46e2-8a56-5fef15851dd4","Type":"ContainerStarted","Data":"e6f6a4a328326cafd00b2ab1eea63edbad1db8bcc1979f18386497b25e3a1241"}
Jul 20 19:28:24.760657 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:24.760613    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx" podStartSLOduration=1.760599585 podStartE2EDuration="1.760599585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:28:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:28:24.759094794 +0000 UTC m=+1667.555102127" watchObservedRunningTime="2026-07-20 19:28:24.760599585 +0000 UTC m=+1667.556606917"
Jul 20 19:28:25.749722 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:25.749688    2560 generic.go:356] "Generic (PLEG): container finished" podID="53638e82-b596-46e2-8a56-5fef15851dd4" containerID="b3ee2956f7b46b3976ee8d1d047b6af472d574c7bf2ccedc97622910a002937f" exitCode=0
Jul 20 19:28:25.750104 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:25.749782    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx" event={"ID":"53638e82-b596-46e2-8a56-5fef15851dd4","Type":"ContainerDied","Data":"b3ee2956f7b46b3976ee8d1d047b6af472d574c7bf2ccedc97622910a002937f"}
Jul 20 19:28:26.884597 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:26.884575    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx"
Jul 20 19:28:26.903194 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:26.903164    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53638e82-b596-46e2-8a56-5fef15851dd4-maas-api-service-ca\") pod \"53638e82-b596-46e2-8a56-5fef15851dd4\" (UID: \"53638e82-b596-46e2-8a56-5fef15851dd4\") "
Jul 20 19:28:26.903577 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:26.903553    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53638e82-b596-46e2-8a56-5fef15851dd4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "53638e82-b596-46e2-8a56-5fef15851dd4" (UID: "53638e82-b596-46e2-8a56-5fef15851dd4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:28:27.004465 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:27.004441    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/53638e82-b596-46e2-8a56-5fef15851dd4-maas-api-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:28:27.761038 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:27.761012    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx"
Jul 20 19:28:27.761299 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:27.761006    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx" event={"ID":"53638e82-b596-46e2-8a56-5fef15851dd4","Type":"ContainerDied","Data":"e6f6a4a328326cafd00b2ab1eea63edbad1db8bcc1979f18386497b25e3a1241"}
Jul 20 19:28:27.761299 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:27.761153    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6f6a4a328326cafd00b2ab1eea63edbad1db8bcc1979f18386497b25e3a1241"
Jul 20 19:28:37.315428 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:37.315392    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:28:38.846467 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:38.846434    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx"]
Jul 20 19:28:38.854028 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:38.854004    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c4bb01a-nhhzx"]
Jul 20 19:28:40.740098 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:40.740064    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53638e82-b596-46e2-8a56-5fef15851dd4" path="/var/lib/kubelet/pods/53638e82-b596-46e2-8a56-5fef15851dd4/volumes"
Jul 20 19:28:49.412808 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:28:49.412768    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:29:07.647961 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:07.647878    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8"]
Jul 20 19:29:07.648439 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:07.648321    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53638e82-b596-46e2-8a56-5fef15851dd4" containerName="revoke-keys"
Jul 20 19:29:07.648439 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:07.648335    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="53638e82-b596-46e2-8a56-5fef15851dd4" containerName="revoke-keys"
Jul 20 19:29:07.648439 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:07.648413    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="53638e82-b596-46e2-8a56-5fef15851dd4" containerName="revoke-keys"
Jul 20 19:29:07.651303 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:07.651286    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8"
Jul 20 19:29:07.653816 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:07.653800    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:29:07.653878 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:07.653832    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jx7gs\""
Jul 20 19:29:07.659549 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:07.659517    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8"]
Jul 20 19:29:07.727442 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:07.727414    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea4dfa5-7193-4d34-ae78-c007f680c2fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8\" (UID: \"bea4dfa5-7193-4d34-ae78-c007f680c2fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8"
Jul 20 19:29:07.828519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:07.828483    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea4dfa5-7193-4d34-ae78-c007f680c2fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8\" (UID: \"bea4dfa5-7193-4d34-ae78-c007f680c2fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8"
Jul 20 19:29:07.829064 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:07.829047    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea4dfa5-7193-4d34-ae78-c007f680c2fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8\" (UID: \"bea4dfa5-7193-4d34-ae78-c007f680c2fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8"
Jul 20 19:29:07.962632 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:07.962611    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8"
Jul 20 19:29:08.090722 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:08.090631    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8"]
Jul 20 19:29:08.093242 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:29:08.093219    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea4dfa5_7193_4d34_ae78_c007f680c2fa.slice/crio-8b1bca2fc20c67402b69001c04e1151b301087e96a8f2ba067430c48da08da5e WatchSource:0}: Error finding container 8b1bca2fc20c67402b69001c04e1151b301087e96a8f2ba067430c48da08da5e: Status 404 returned error can't find the container with id 8b1bca2fc20c67402b69001c04e1151b301087e96a8f2ba067430c48da08da5e
Jul 20 19:29:08.963547 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:08.963512    2560 generic.go:356] "Generic (PLEG): container finished" podID="bea4dfa5-7193-4d34-ae78-c007f680c2fa" containerID="04ed1fdbea312008af7c88074f7e444985f6689d9d0d082c9bd6669e17e5fc7b" exitCode=0
Jul 20 19:29:08.963879 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:08.963591    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8" event={"ID":"bea4dfa5-7193-4d34-ae78-c007f680c2fa","Type":"ContainerDied","Data":"04ed1fdbea312008af7c88074f7e444985f6689d9d0d082c9bd6669e17e5fc7b"}
Jul 20 19:29:08.963879 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:08.963659    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8" event={"ID":"bea4dfa5-7193-4d34-ae78-c007f680c2fa","Type":"ContainerStarted","Data":"8b1bca2fc20c67402b69001c04e1151b301087e96a8f2ba067430c48da08da5e"}
Jul 20 19:29:10.101359 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:10.101335    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8"
Jul 20 19:29:10.248477 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:10.248402    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea4dfa5-7193-4d34-ae78-c007f680c2fa-maas-api-service-ca\") pod \"bea4dfa5-7193-4d34-ae78-c007f680c2fa\" (UID: \"bea4dfa5-7193-4d34-ae78-c007f680c2fa\") "
Jul 20 19:29:10.248758 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:10.248738    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bea4dfa5-7193-4d34-ae78-c007f680c2fa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bea4dfa5-7193-4d34-ae78-c007f680c2fa" (UID: "bea4dfa5-7193-4d34-ae78-c007f680c2fa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:29:10.349726 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:10.349706    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bea4dfa5-7193-4d34-ae78-c007f680c2fa-maas-api-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:29:10.975267 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:10.975227    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8" event={"ID":"bea4dfa5-7193-4d34-ae78-c007f680c2fa","Type":"ContainerDied","Data":"8b1bca2fc20c67402b69001c04e1151b301087e96a8f2ba067430c48da08da5e"}
Jul 20 19:29:10.975420 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:10.975285    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8"
Jul 20 19:29:10.975420 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:10.975288    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b1bca2fc20c67402b69001c04e1151b301087e96a8f2ba067430c48da08da5e"
Jul 20 19:29:21.146717 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:21.146681    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:29:22.749629 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:22.749596    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8"]
Jul 20 19:29:22.753921 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:22.753890    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c0f5505a-rvcl8"]
Jul 20 19:29:24.739818 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:24.739789    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bea4dfa5-7193-4d34-ae78-c007f680c2fa" path="/var/lib/kubelet/pods/bea4dfa5-7193-4d34-ae78-c007f680c2fa/volumes"
Jul 20 19:29:33.642112 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:33.642073    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:29:51.999743 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:51.999704    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1e283793-gzfv2"]
Jul 20 19:29:52.000498 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:52.000480    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bea4dfa5-7193-4d34-ae78-c007f680c2fa" containerName="revoke-keys"
Jul 20 19:29:52.000549 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:52.000500    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bea4dfa5-7193-4d34-ae78-c007f680c2fa" containerName="revoke-keys"
Jul 20 19:29:52.000584 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:52.000562    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bea4dfa5-7193-4d34-ae78-c007f680c2fa" containerName="revoke-keys"
Jul 20 19:29:52.003784 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:52.003769    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1e283793-gzfv2"
Jul 20 19:29:52.006450 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:52.006431    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jx7gs\""
Jul 20 19:29:52.006533 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:52.006474    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:29:52.015976 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:52.015954    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1e283793-gzfv2"]
Jul 20 19:29:52.073963 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:52.073931    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/602fb9d2-d264-4399-82af-918f2fd1afe7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1e283793-gzfv2\" (UID: \"602fb9d2-d264-4399-82af-918f2fd1afe7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1e283793-gzfv2"
Jul 20 19:29:52.174645 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:52.174613    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/602fb9d2-d264-4399-82af-918f2fd1afe7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1e283793-gzfv2\" (UID: \"602fb9d2-d264-4399-82af-918f2fd1afe7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1e283793-gzfv2"
Jul 20 19:29:52.175404 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:52.175382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/602fb9d2-d264-4399-82af-918f2fd1afe7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1e283793-gzfv2\" (UID: \"602fb9d2-d264-4399-82af-918f2fd1afe7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1e283793-gzfv2"
Jul 20 19:29:52.313572 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:52.313497    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1e283793-gzfv2"
Jul 20 19:29:52.454326 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:52.454173    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1e283793-gzfv2"]
Jul 20 19:29:52.457094 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:29:52.457066    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod602fb9d2_d264_4399_82af_918f2fd1afe7.slice/crio-130a180bfa05277f7148c28e088ed1b54b1f0857ac0fc0616f96c64a08c54b7b WatchSource:0}: Error finding container 130a180bfa05277f7148c28e088ed1b54b1f0857ac0fc0616f96c64a08c54b7b: Status 404 returned error can't find the container with id 130a180bfa05277f7148c28e088ed1b54b1f0857ac0fc0616f96c64a08c54b7b
Jul 20 19:29:53.183645 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:53.183558    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1e283793-gzfv2" event={"ID":"602fb9d2-d264-4399-82af-918f2fd1afe7","Type":"ContainerStarted","Data":"42a7cb56bbee8313fa55d49d882c2369c905d77436dd7d068d7a2f19e96838ea"}
Jul 20 19:29:53.183989 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:53.183647    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1e283793-gzfv2" event={"ID":"602fb9d2-d264-4399-82af-918f2fd1afe7","Type":"ContainerStarted","Data":"130a180bfa05277f7148c28e088ed1b54b1f0857ac0fc0616f96c64a08c54b7b"}
Jul 20 19:29:53.218383 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:53.218341    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1e283793-gzfv2" podStartSLOduration=2.21832885 podStartE2EDuration="2.21832885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:29:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:29:53.218307041 +0000 UTC m=+1756.014314375" watchObservedRunningTime="2026-07-20 19:29:53.21832885 +0000 UTC m=+1756.014336182"
Jul 20 19:29:54.190837 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:54.190799    2560 generic.go:356] "Generic (PLEG): container finished" podID="602fb9d2-d264-4399-82af-918f2fd1afe7" containerID="42a7cb56bbee8313fa55d49d882c2369c905d77436dd7d068d7a2f19e96838ea" exitCode=0
Jul 20 19:29:54.191272 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:54.190892    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1e283793-gzfv2" event={"ID":"602fb9d2-d264-4399-82af-918f2fd1afe7","Type":"ContainerDied","Data":"42a7cb56bbee8313fa55d49d882c2369c905d77436dd7d068d7a2f19e96838ea"}
Jul 20 19:29:55.326761 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:55.326740    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1e283793-gzfv2"
Jul 20 19:29:55.401565 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:55.401537    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/602fb9d2-d264-4399-82af-918f2fd1afe7-maas-api-service-ca\") pod \"602fb9d2-d264-4399-82af-918f2fd1afe7\" (UID: \"602fb9d2-d264-4399-82af-918f2fd1afe7\") "
Jul 20 19:29:55.401836 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:55.401812    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/602fb9d2-d264-4399-82af-918f2fd1afe7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "602fb9d2-d264-4399-82af-918f2fd1afe7" (UID: "602fb9d2-d264-4399-82af-918f2fd1afe7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:29:55.502621 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:55.502563    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/602fb9d2-d264-4399-82af-918f2fd1afe7-maas-api-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:29:56.202688 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:56.202662    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1e283793-gzfv2"
Jul 20 19:29:56.202853 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:56.202706    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1e283793-gzfv2" event={"ID":"602fb9d2-d264-4399-82af-918f2fd1afe7","Type":"ContainerDied","Data":"130a180bfa05277f7148c28e088ed1b54b1f0857ac0fc0616f96c64a08c54b7b"}
Jul 20 19:29:56.202853 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:29:56.202754    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="130a180bfa05277f7148c28e088ed1b54b1f0857ac0fc0616f96c64a08c54b7b"
Jul 20 19:30:00.138500 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:00.138463    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742930-bbmmn"]
Jul 20 19:30:00.138947 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:00.138844    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="602fb9d2-d264-4399-82af-918f2fd1afe7" containerName="revoke-keys"
Jul 20 19:30:00.138947 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:00.138856    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="602fb9d2-d264-4399-82af-918f2fd1afe7" containerName="revoke-keys"
Jul 20 19:30:00.138947 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:00.138926    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="602fb9d2-d264-4399-82af-918f2fd1afe7" containerName="revoke-keys"
Jul 20 19:30:00.142159 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:00.142142    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-1e283793-29742930-hzlvj"]
Jul 20 19:30:00.142250 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:00.142231    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742930-bbmmn"
Jul 20 19:30:00.145629 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:00.145386    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jx7gs\""
Jul 20 19:30:00.149465 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:00.149439    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-1e283793-29742930-hzlvj"
Jul 20 19:30:00.155177 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:00.155149    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-1e283793-29742930-hzlvj"]
Jul 20 19:30:00.155672 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:00.155652    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742930-bbmmn"
Jul 20 19:30:00.157687 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:00.157664    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742930-bbmmn"]
Jul 20 19:30:00.166538 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:00.166520    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-1e283793-29742930-hzlvj"
Jul 20 19:30:00.303614 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:00.303397    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742930-bbmmn"]
Jul 20 19:30:00.305794 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:30:00.305767    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05fa1243_2a84_472a_afe9_8b1cba7446e5.slice/crio-3e302e4d312f4c7566003fb5fba44e313e0957ca730ce286cacd548aedd9ada8 WatchSource:0}: Error finding container 3e302e4d312f4c7566003fb5fba44e313e0957ca730ce286cacd548aedd9ada8: Status 404 returned error can't find the container with id 3e302e4d312f4c7566003fb5fba44e313e0957ca730ce286cacd548aedd9ada8
Jul 20 19:30:00.325252 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:00.325231    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-1e283793-29742930-hzlvj"]
Jul 20 19:30:00.328436 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:30:00.328409    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d4508a6_02d2_440f_87be_cabfc6ca81d4.slice/crio-be652e92e92c7aaf0e8627a495761168bfcc7a205ed2ff56480652dfb07c8706 WatchSource:0}: Error finding container be652e92e92c7aaf0e8627a495761168bfcc7a205ed2ff56480652dfb07c8706: Status 404 returned error can't find the container with id be652e92e92c7aaf0e8627a495761168bfcc7a205ed2ff56480652dfb07c8706
Jul 20 19:30:01.232953 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:01.232920    2560 generic.go:356] "Generic (PLEG): container finished" podID="05fa1243-2a84-472a-afe9-8b1cba7446e5" containerID="b2b37244e533d3e52cde3cbc79dec354528199b09402bf9d5bbae9d2fa8d2227" exitCode=0
Jul 20 19:30:01.233387 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:01.233008    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742930-bbmmn" event={"ID":"05fa1243-2a84-472a-afe9-8b1cba7446e5","Type":"ContainerDied","Data":"b2b37244e533d3e52cde3cbc79dec354528199b09402bf9d5bbae9d2fa8d2227"}
Jul 20 19:30:01.233387 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:01.233073    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742930-bbmmn" event={"ID":"05fa1243-2a84-472a-afe9-8b1cba7446e5","Type":"ContainerStarted","Data":"3e302e4d312f4c7566003fb5fba44e313e0957ca730ce286cacd548aedd9ada8"}
Jul 20 19:30:01.234451 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:01.234430    2560 generic.go:356] "Generic (PLEG): container finished" podID="1d4508a6-02d2-440f-87be-cabfc6ca81d4" containerID="49b5c197bc8550ca94655d1a8b13e39659ec742f8ab941f8178764b86e8bf9bb" exitCode=0
Jul 20 19:30:01.234560 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:01.234469    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-1e283793-29742930-hzlvj" event={"ID":"1d4508a6-02d2-440f-87be-cabfc6ca81d4","Type":"ContainerDied","Data":"49b5c197bc8550ca94655d1a8b13e39659ec742f8ab941f8178764b86e8bf9bb"}
Jul 20 19:30:01.234560 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:01.234511    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-1e283793-29742930-hzlvj" event={"ID":"1d4508a6-02d2-440f-87be-cabfc6ca81d4","Type":"ContainerStarted","Data":"be652e92e92c7aaf0e8627a495761168bfcc7a205ed2ff56480652dfb07c8706"}
Jul 20 19:30:02.383180 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:02.383158    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-1e283793-29742930-hzlvj"
Jul 20 19:30:02.409386 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:02.409362    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742930-bbmmn"
Jul 20 19:30:02.711009 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:02.710979    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-1e283793-29742930-hzlvj"]
Jul 20 19:30:02.729504 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:02.729472    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-1e283793-29742930-hzlvj"]
Jul 20 19:30:02.740087 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:02.740065    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d4508a6-02d2-440f-87be-cabfc6ca81d4" path="/var/lib/kubelet/pods/1d4508a6-02d2-440f-87be-cabfc6ca81d4/volumes"
Jul 20 19:30:03.245670 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:03.245648    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-1e283793-29742930-hzlvj"
Jul 20 19:30:03.245835 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:03.245703    2560 scope.go:117] "RemoveContainer" containerID="49b5c197bc8550ca94655d1a8b13e39659ec742f8ab941f8178764b86e8bf9bb"
Jul 20 19:30:03.247167 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:03.247026    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742930-bbmmn" event={"ID":"05fa1243-2a84-472a-afe9-8b1cba7446e5","Type":"ContainerDied","Data":"3e302e4d312f4c7566003fb5fba44e313e0957ca730ce286cacd548aedd9ada8"}
Jul 20 19:30:03.247167 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:03.247066    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e302e4d312f4c7566003fb5fba44e313e0957ca730ce286cacd548aedd9ada8"
Jul 20 19:30:03.247167 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:03.247071    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742930-bbmmn"
Jul 20 19:30:05.567956 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:05.567925    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:30:07.097960 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:07.097920    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1e283793-gzfv2"]
Jul 20 19:30:07.101714 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:07.101687    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1e283793-gzfv2"]
Jul 20 19:30:08.740513 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:08.740483    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="602fb9d2-d264-4399-82af-918f2fd1afe7" path="/var/lib/kubelet/pods/602fb9d2-d264-4399-82af-918f2fd1afe7/volumes"
Jul 20 19:30:37.800214 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:37.800185    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:30:37.803731 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:37.803705    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:30:37.804690 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:37.804665    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:30:37.808278 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:30:37.808257    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:31:35.424370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:31:35.424334    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:31:45.415046 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:31:45.415010    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:31:56.528146 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:31:56.528094    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:32:02.271869 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:02.271779    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-088e4681-c4z26"]
Jul 20 19:32:02.272287 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:02.272189    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d4508a6-02d2-440f-87be-cabfc6ca81d4" containerName="cleanup"
Jul 20 19:32:02.272287 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:02.272202    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d4508a6-02d2-440f-87be-cabfc6ca81d4" containerName="cleanup"
Jul 20 19:32:02.272287 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:02.272211    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05fa1243-2a84-472a-afe9-8b1cba7446e5" containerName="cleanup"
Jul 20 19:32:02.272287 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:02.272218    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="05fa1243-2a84-472a-afe9-8b1cba7446e5" containerName="cleanup"
Jul 20 19:32:02.272287 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:02.272280    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d4508a6-02d2-440f-87be-cabfc6ca81d4" containerName="cleanup"
Jul 20 19:32:02.272287 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:02.272290    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="05fa1243-2a84-472a-afe9-8b1cba7446e5" containerName="cleanup"
Jul 20 19:32:02.275592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:02.275574    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-088e4681-c4z26"
Jul 20 19:32:02.279509 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:02.279484    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:32:02.279509 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:02.279498    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jx7gs\""
Jul 20 19:32:02.287301 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:02.287267    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-088e4681-c4z26"]
Jul 20 19:32:02.288167 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:02.288146    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45c0166a-d2cb-405e-902a-99e9b499db18-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-088e4681-c4z26\" (UID: \"45c0166a-d2cb-405e-902a-99e9b499db18\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-088e4681-c4z26"
Jul 20 19:32:02.389275 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:02.389253    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45c0166a-d2cb-405e-902a-99e9b499db18-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-088e4681-c4z26\" (UID: \"45c0166a-d2cb-405e-902a-99e9b499db18\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-088e4681-c4z26"
Jul 20 19:32:02.389826 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:02.389809    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45c0166a-d2cb-405e-902a-99e9b499db18-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-088e4681-c4z26\" (UID: \"45c0166a-d2cb-405e-902a-99e9b499db18\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-088e4681-c4z26"
Jul 20 19:32:02.586599 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:02.586540    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-088e4681-c4z26"
Jul 20 19:32:02.717077 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:02.717052    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-088e4681-c4z26"]
Jul 20 19:32:02.719067 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:32:02.719040    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45c0166a_d2cb_405e_902a_99e9b499db18.slice/crio-090237d4c3a678c94537aa14b3eeec89599ff73dc8785c20f7db3c51f790d604 WatchSource:0}: Error finding container 090237d4c3a678c94537aa14b3eeec89599ff73dc8785c20f7db3c51f790d604: Status 404 returned error can't find the container with id 090237d4c3a678c94537aa14b3eeec89599ff73dc8785c20f7db3c51f790d604
Jul 20 19:32:02.833800 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:02.833772    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-088e4681-c4z26" event={"ID":"45c0166a-d2cb-405e-902a-99e9b499db18","Type":"ContainerStarted","Data":"090237d4c3a678c94537aa14b3eeec89599ff73dc8785c20f7db3c51f790d604"}
Jul 20 19:32:03.840477 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:03.840450    2560 generic.go:356] "Generic (PLEG): container finished" podID="45c0166a-d2cb-405e-902a-99e9b499db18" containerID="1cb61d41e38b4fc3d7b3624809fa58ba07a25464cbb5cb6b44f607c3a165d170" exitCode=0
Jul 20 19:32:03.840843 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:03.840498    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-088e4681-c4z26" event={"ID":"45c0166a-d2cb-405e-902a-99e9b499db18","Type":"ContainerDied","Data":"1cb61d41e38b4fc3d7b3624809fa58ba07a25464cbb5cb6b44f607c3a165d170"}
Jul 20 19:32:04.974946 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:04.974920    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-088e4681-c4z26"
Jul 20 19:32:05.008402 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:05.008377    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45c0166a-d2cb-405e-902a-99e9b499db18-maas-api-service-ca\") pod \"45c0166a-d2cb-405e-902a-99e9b499db18\" (UID: \"45c0166a-d2cb-405e-902a-99e9b499db18\") "
Jul 20 19:32:05.008684 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:05.008664    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45c0166a-d2cb-405e-902a-99e9b499db18-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "45c0166a-d2cb-405e-902a-99e9b499db18" (UID: "45c0166a-d2cb-405e-902a-99e9b499db18"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:32:05.110150 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:05.110072    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45c0166a-d2cb-405e-902a-99e9b499db18-maas-api-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:32:05.858313 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:05.858282    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-088e4681-c4z26"
Jul 20 19:32:05.858313 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:05.858296    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-088e4681-c4z26" event={"ID":"45c0166a-d2cb-405e-902a-99e9b499db18","Type":"ContainerDied","Data":"090237d4c3a678c94537aa14b3eeec89599ff73dc8785c20f7db3c51f790d604"}
Jul 20 19:32:05.858544 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:05.858369    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="090237d4c3a678c94537aa14b3eeec89599ff73dc8785c20f7db3c51f790d604"
Jul 20 19:32:15.513707 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:15.513672    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:32:17.440021 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:17.439987    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-088e4681-c4z26"]
Jul 20 19:32:17.442299 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:17.442276    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-088e4681-c4z26"]
Jul 20 19:32:18.739989 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:18.739957    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45c0166a-d2cb-405e-902a-99e9b499db18" path="/var/lib/kubelet/pods/45c0166a-d2cb-405e-902a-99e9b499db18/volumes"
Jul 20 19:32:51.319714 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:32:51.319672    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:33:02.125835 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:02.125795    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:33:11.751743 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:11.751708    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:33:19.714419 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:19.714383    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms"]
Jul 20 19:33:19.714826 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:19.714745    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45c0166a-d2cb-405e-902a-99e9b499db18" containerName="revoke-keys"
Jul 20 19:33:19.714826 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:19.714757    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="45c0166a-d2cb-405e-902a-99e9b499db18" containerName="revoke-keys"
Jul 20 19:33:19.714911 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:19.714838    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="45c0166a-d2cb-405e-902a-99e9b499db18" containerName="revoke-keys"
Jul 20 19:33:19.717941 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:19.717924    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms"
Jul 20 19:33:19.720300 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:19.720271    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:33:19.720424 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:19.720300    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jx7gs\""
Jul 20 19:33:19.725667 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:19.725253    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms"]
Jul 20 19:33:19.791112 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:19.791085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6b3e14-d53f-4b18-9adc-53dc413d7ded-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms\" (UID: \"ab6b3e14-d53f-4b18-9adc-53dc413d7ded\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms"
Jul 20 19:33:19.891869 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:19.891838    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6b3e14-d53f-4b18-9adc-53dc413d7ded-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms\" (UID: \"ab6b3e14-d53f-4b18-9adc-53dc413d7ded\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms"
Jul 20 19:33:19.892450 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:19.892432    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6b3e14-d53f-4b18-9adc-53dc413d7ded-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms\" (UID: \"ab6b3e14-d53f-4b18-9adc-53dc413d7ded\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms"
Jul 20 19:33:20.030045 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:20.029953    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms"
Jul 20 19:33:20.364889 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:20.364822    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms"]
Jul 20 19:33:20.368441 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:33:20.368407    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6b3e14_d53f_4b18_9adc_53dc413d7ded.slice/crio-b89cd3b559fe8bb2f880a86d3a228540fe5391fe519f5d8943b4ba439f33743f WatchSource:0}: Error finding container b89cd3b559fe8bb2f880a86d3a228540fe5391fe519f5d8943b4ba439f33743f: Status 404 returned error can't find the container with id b89cd3b559fe8bb2f880a86d3a228540fe5391fe519f5d8943b4ba439f33743f
Jul 20 19:33:21.240706 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:21.240670    2560 generic.go:356] "Generic (PLEG): container finished" podID="ab6b3e14-d53f-4b18-9adc-53dc413d7ded" containerID="e35acee7aa6c6131d372cfc700d77c9d952902ab924d8e97ee5dffb5592aa5b3" exitCode=0
Jul 20 19:33:21.241072 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:21.240725    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms" event={"ID":"ab6b3e14-d53f-4b18-9adc-53dc413d7ded","Type":"ContainerDied","Data":"e35acee7aa6c6131d372cfc700d77c9d952902ab924d8e97ee5dffb5592aa5b3"}
Jul 20 19:33:21.241072 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:21.240779    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms" event={"ID":"ab6b3e14-d53f-4b18-9adc-53dc413d7ded","Type":"ContainerStarted","Data":"b89cd3b559fe8bb2f880a86d3a228540fe5391fe519f5d8943b4ba439f33743f"}
Jul 20 19:33:22.388856 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:22.388832    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms"
Jul 20 19:33:22.511964 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:22.511900    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6b3e14-d53f-4b18-9adc-53dc413d7ded-maas-api-service-ca\") pod \"ab6b3e14-d53f-4b18-9adc-53dc413d7ded\" (UID: \"ab6b3e14-d53f-4b18-9adc-53dc413d7ded\") "
Jul 20 19:33:22.512273 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:22.512253    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab6b3e14-d53f-4b18-9adc-53dc413d7ded-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ab6b3e14-d53f-4b18-9adc-53dc413d7ded" (UID: "ab6b3e14-d53f-4b18-9adc-53dc413d7ded"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:33:22.612643 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:22.612617    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6b3e14-d53f-4b18-9adc-53dc413d7ded-maas-api-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:33:23.251106 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:23.251076    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms"
Jul 20 19:33:23.251285 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:23.251109    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms" event={"ID":"ab6b3e14-d53f-4b18-9adc-53dc413d7ded","Type":"ContainerDied","Data":"b89cd3b559fe8bb2f880a86d3a228540fe5391fe519f5d8943b4ba439f33743f"}
Jul 20 19:33:23.251285 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:23.251176    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b89cd3b559fe8bb2f880a86d3a228540fe5391fe519f5d8943b4ba439f33743f"
Jul 20 19:33:33.813834 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:33.813759    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:33:39.821378 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:39.821343    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms"]
Jul 20 19:33:39.824369 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:39.824345    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-18f84c7f-gp7ms"]
Jul 20 19:33:40.739966 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:40.739932    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab6b3e14-d53f-4b18-9adc-53dc413d7ded" path="/var/lib/kubelet/pods/ab6b3e14-d53f-4b18-9adc-53dc413d7ded/volumes"
Jul 20 19:33:44.232156 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:33:44.232101    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:34:37.872996 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:34:37.872963    2560 scope.go:117] "RemoveContainer" containerID="13ef1c88be4926ada0ee36d8d76c2ac92de9dce719f43bf90a7f7503f043d4a0"
Jul 20 19:34:37.881546 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:34:37.881526    2560 scope.go:117] "RemoveContainer" containerID="b3ee2956f7b46b3976ee8d1d047b6af472d574c7bf2ccedc97622910a002937f"
Jul 20 19:34:40.158038 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:34:40.158002    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:34:52.516342 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:34:52.516309    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:35:37.832220 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:37.832193    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:35:37.835997 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:37.835974    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:35:37.837280 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:37.837255    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:35:37.847390 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:37.847364    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:35:37.905529 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:37.905507    2560 scope.go:117] "RemoveContainer" containerID="04ed1fdbea312008af7c88074f7e444985f6689d9d0d082c9bd6669e17e5fc7b"
Jul 20 19:35:40.704922 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:40.704894    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:35:44.124054 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.124020    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"]
Jul 20 19:35:44.124641 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.124622    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6b3e14-d53f-4b18-9adc-53dc413d7ded" containerName="revoke-keys"
Jul 20 19:35:44.124641 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.124642    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6b3e14-d53f-4b18-9adc-53dc413d7ded" containerName="revoke-keys"
Jul 20 19:35:44.124826 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.124770    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab6b3e14-d53f-4b18-9adc-53dc413d7ded" containerName="revoke-keys"
Jul 20 19:35:44.128423 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.128404    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"
Jul 20 19:35:44.130664 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.130644    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 19:35:44.131333 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.131317    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-d43dd5-serving-cert\""
Jul 20 19:35:44.131430 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.131332    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:35:44.131430 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.131314    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9tjtc\""
Jul 20 19:35:44.144294 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.144272    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"]
Jul 20 19:35:44.247391 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.247368    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90935e40-7322-4ee2-87a8-5c85d56a67f6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz\" (UID: \"90935e40-7322-4ee2-87a8-5c85d56a67f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"
Jul 20 19:35:44.247506 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.247406    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90935e40-7322-4ee2-87a8-5c85d56a67f6-maas-api-tls\") pod \"maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz\" (UID: \"90935e40-7322-4ee2-87a8-5c85d56a67f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"
Jul 20 19:35:44.247506 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.247494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vxwc\" (UniqueName: \"kubernetes.io/projected/90935e40-7322-4ee2-87a8-5c85d56a67f6-kube-api-access-7vxwc\") pod \"maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz\" (UID: \"90935e40-7322-4ee2-87a8-5c85d56a67f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"
Jul 20 19:35:44.348695 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.348674    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vxwc\" (UniqueName: \"kubernetes.io/projected/90935e40-7322-4ee2-87a8-5c85d56a67f6-kube-api-access-7vxwc\") pod \"maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz\" (UID: \"90935e40-7322-4ee2-87a8-5c85d56a67f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"
Jul 20 19:35:44.348797 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.348719    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90935e40-7322-4ee2-87a8-5c85d56a67f6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz\" (UID: \"90935e40-7322-4ee2-87a8-5c85d56a67f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"
Jul 20 19:35:44.348797 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.348742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90935e40-7322-4ee2-87a8-5c85d56a67f6-maas-api-tls\") pod \"maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz\" (UID: \"90935e40-7322-4ee2-87a8-5c85d56a67f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"
Jul 20 19:35:44.348911 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:35:44.348823    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-serving-cert: secret "maas-api-e2e-inf-b-d43dd5-serving-cert" not found
Jul 20 19:35:44.348911 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:35:44.348873    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90935e40-7322-4ee2-87a8-5c85d56a67f6-maas-api-tls podName:90935e40-7322-4ee2-87a8-5c85d56a67f6 nodeName:}" failed. No retries permitted until 2026-07-20 19:35:44.84885672 +0000 UTC m=+2107.644864031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/90935e40-7322-4ee2-87a8-5c85d56a67f6-maas-api-tls") pod "maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz" (UID: "90935e40-7322-4ee2-87a8-5c85d56a67f6") : secret "maas-api-e2e-inf-b-d43dd5-serving-cert" not found
Jul 20 19:35:44.349289 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.349271    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90935e40-7322-4ee2-87a8-5c85d56a67f6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz\" (UID: \"90935e40-7322-4ee2-87a8-5c85d56a67f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"
Jul 20 19:35:44.358298 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.358278    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vxwc\" (UniqueName: \"kubernetes.io/projected/90935e40-7322-4ee2-87a8-5c85d56a67f6-kube-api-access-7vxwc\") pod \"maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz\" (UID: \"90935e40-7322-4ee2-87a8-5c85d56a67f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"
Jul 20 19:35:44.853357 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.853328    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90935e40-7322-4ee2-87a8-5c85d56a67f6-maas-api-tls\") pod \"maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz\" (UID: \"90935e40-7322-4ee2-87a8-5c85d56a67f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"
Jul 20 19:35:44.855655 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:44.855632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90935e40-7322-4ee2-87a8-5c85d56a67f6-maas-api-tls\") pod \"maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz\" (UID: \"90935e40-7322-4ee2-87a8-5c85d56a67f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"
Jul 20 19:35:45.047226 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:45.047198    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"
Jul 20 19:35:45.177737 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:45.177713    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"]
Jul 20 19:35:45.179203 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:35:45.179176    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90935e40_7322_4ee2_87a8_5c85d56a67f6.slice/crio-c6ab6cf668da30bfc1ce398585127dd9d4118cdb06cf08fcb1a6030f6129d25b WatchSource:0}: Error finding container c6ab6cf668da30bfc1ce398585127dd9d4118cdb06cf08fcb1a6030f6129d25b: Status 404 returned error can't find the container with id c6ab6cf668da30bfc1ce398585127dd9d4118cdb06cf08fcb1a6030f6129d25b
Jul 20 19:35:45.180451 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:45.180430    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:35:45.980875 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:45.980817    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz" event={"ID":"90935e40-7322-4ee2-87a8-5c85d56a67f6","Type":"ContainerStarted","Data":"c6ab6cf668da30bfc1ce398585127dd9d4118cdb06cf08fcb1a6030f6129d25b"}
Jul 20 19:35:47.992992 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:47.992948    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz" event={"ID":"90935e40-7322-4ee2-87a8-5c85d56a67f6","Type":"ContainerStarted","Data":"51ebddd440f7c6c56d60c11fb298511c47c086183f594b3048b6156db19324a6"}
Jul 20 19:35:47.993431 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:47.993023    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"
Jul 20 19:35:54.003237 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:54.003209    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"
Jul 20 19:35:54.026794 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:54.026749    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz" podStartSLOduration=7.737623786 podStartE2EDuration="10.02673525s" totalImagesPullingTime="2.289111464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:35:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:35:48.00942053 +0000 UTC m=+2110.805427867" watchObservedRunningTime="2026-07-20 19:35:54.02673525 +0000 UTC m=+2116.822742582"
Jul 20 19:35:56.828142 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:35:56.828092    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:36:09.509680 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:36:09.509645    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:36:37.924698 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:36:37.924660    2560 scope.go:117] "RemoveContainer" containerID="42a7cb56bbee8313fa55d49d882c2369c905d77436dd7d068d7a2f19e96838ea"
Jul 20 19:36:41.313684 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:36:41.313647    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:37:20.233673 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:20.233640    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v"]
Jul 20 19:37:20.237146 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:20.237111    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v"
Jul 20 19:37:20.239096 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:20.239078    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jx7gs\""
Jul 20 19:37:20.243750 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:20.243723    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v"]
Jul 20 19:37:20.298042 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:20.298016    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6857a2-099c-4fd3-ab26-16209de8227c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v\" (UID: \"da6857a2-099c-4fd3-ab26-16209de8227c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v"
Jul 20 19:37:20.399222 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:20.399196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6857a2-099c-4fd3-ab26-16209de8227c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v\" (UID: \"da6857a2-099c-4fd3-ab26-16209de8227c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v"
Jul 20 19:37:20.399843 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:20.399823    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6857a2-099c-4fd3-ab26-16209de8227c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v\" (UID: \"da6857a2-099c-4fd3-ab26-16209de8227c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v"
Jul 20 19:37:20.548702 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:20.548641    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v"
Jul 20 19:37:20.682809 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:20.682783    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v"]
Jul 20 19:37:20.685110 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:37:20.685078    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6857a2_099c_4fd3_ab26_16209de8227c.slice/crio-11241568e2321dbb8d7dc095b114be0119eaed670539acbec8825d761e0cc1a4 WatchSource:0}: Error finding container 11241568e2321dbb8d7dc095b114be0119eaed670539acbec8825d761e0cc1a4: Status 404 returned error can't find the container with id 11241568e2321dbb8d7dc095b114be0119eaed670539acbec8825d761e0cc1a4
Jul 20 19:37:21.453581 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:21.453555    2560 generic.go:356] "Generic (PLEG): container finished" podID="da6857a2-099c-4fd3-ab26-16209de8227c" containerID="57a614bdd0d8958fd4c7963cc29b3829fdce68ba58a92da559e833938c9630f8" exitCode=0
Jul 20 19:37:21.453877 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:21.453613    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v" event={"ID":"da6857a2-099c-4fd3-ab26-16209de8227c","Type":"ContainerDied","Data":"57a614bdd0d8958fd4c7963cc29b3829fdce68ba58a92da559e833938c9630f8"}
Jul 20 19:37:21.453877 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:21.453668    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v" event={"ID":"da6857a2-099c-4fd3-ab26-16209de8227c","Type":"ContainerStarted","Data":"11241568e2321dbb8d7dc095b114be0119eaed670539acbec8825d761e0cc1a4"}
Jul 20 19:37:22.589737 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:22.589711    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v"
Jul 20 19:37:22.615834 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:22.615812    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6857a2-099c-4fd3-ab26-16209de8227c-maas-api-service-ca\") pod \"da6857a2-099c-4fd3-ab26-16209de8227c\" (UID: \"da6857a2-099c-4fd3-ab26-16209de8227c\") "
Jul 20 19:37:22.616233 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:22.616209    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da6857a2-099c-4fd3-ab26-16209de8227c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "da6857a2-099c-4fd3-ab26-16209de8227c" (UID: "da6857a2-099c-4fd3-ab26-16209de8227c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:37:22.716724 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:22.716669    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6857a2-099c-4fd3-ab26-16209de8227c-maas-api-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:37:23.464363 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:23.464331    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v" event={"ID":"da6857a2-099c-4fd3-ab26-16209de8227c","Type":"ContainerDied","Data":"11241568e2321dbb8d7dc095b114be0119eaed670539acbec8825d761e0cc1a4"}
Jul 20 19:37:23.464363 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:23.464352    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v"
Jul 20 19:37:23.464568 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:23.464378    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11241568e2321dbb8d7dc095b114be0119eaed670539acbec8825d761e0cc1a4"
Jul 20 19:37:26.207543 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:26.207508    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:37:35.322270 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:35.322238    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v"]
Jul 20 19:37:35.324540 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:35.324515    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bd0ca5-8qt9v"]
Jul 20 19:37:35.504486 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:35.504458    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:37:36.740593 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:36.740554    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da6857a2-099c-4fd3-ab26-16209de8227c" path="/var/lib/kubelet/pods/da6857a2-099c-4fd3-ab26-16209de8227c/volumes"
Jul 20 19:37:52.498199 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:52.498160    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"]
Jul 20 19:37:52.498801 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:52.498410    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz" podUID="90935e40-7322-4ee2-87a8-5c85d56a67f6" containerName="maas-api" containerID="cri-o://51ebddd440f7c6c56d60c11fb298511c47c086183f594b3048b6156db19324a6" gracePeriod=30
Jul 20 19:37:52.938939 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:52.938918    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"
Jul 20 19:37:53.061847 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.061769    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90935e40-7322-4ee2-87a8-5c85d56a67f6-maas-api-tls\") pod \"90935e40-7322-4ee2-87a8-5c85d56a67f6\" (UID: \"90935e40-7322-4ee2-87a8-5c85d56a67f6\") "
Jul 20 19:37:53.061847 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.061826    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vxwc\" (UniqueName: \"kubernetes.io/projected/90935e40-7322-4ee2-87a8-5c85d56a67f6-kube-api-access-7vxwc\") pod \"90935e40-7322-4ee2-87a8-5c85d56a67f6\" (UID: \"90935e40-7322-4ee2-87a8-5c85d56a67f6\") "
Jul 20 19:37:53.062056 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.061854    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90935e40-7322-4ee2-87a8-5c85d56a67f6-openshift-service-ca\") pod \"90935e40-7322-4ee2-87a8-5c85d56a67f6\" (UID: \"90935e40-7322-4ee2-87a8-5c85d56a67f6\") "
Jul 20 19:37:53.062305 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.062281    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90935e40-7322-4ee2-87a8-5c85d56a67f6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "90935e40-7322-4ee2-87a8-5c85d56a67f6" (UID: "90935e40-7322-4ee2-87a8-5c85d56a67f6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:37:53.063928 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.063898    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90935e40-7322-4ee2-87a8-5c85d56a67f6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "90935e40-7322-4ee2-87a8-5c85d56a67f6" (UID: "90935e40-7322-4ee2-87a8-5c85d56a67f6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:37:53.064033 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.063952    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90935e40-7322-4ee2-87a8-5c85d56a67f6-kube-api-access-7vxwc" (OuterVolumeSpecName: "kube-api-access-7vxwc") pod "90935e40-7322-4ee2-87a8-5c85d56a67f6" (UID: "90935e40-7322-4ee2-87a8-5c85d56a67f6"). InnerVolumeSpecName "kube-api-access-7vxwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:37:53.163039 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.163014    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vxwc\" (UniqueName: \"kubernetes.io/projected/90935e40-7322-4ee2-87a8-5c85d56a67f6-kube-api-access-7vxwc\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:37:53.163039 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.163037    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90935e40-7322-4ee2-87a8-5c85d56a67f6-openshift-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:37:53.163213 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.163046    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90935e40-7322-4ee2-87a8-5c85d56a67f6-maas-api-tls\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:37:53.618915 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.618883    2560 generic.go:356] "Generic (PLEG): container finished" podID="90935e40-7322-4ee2-87a8-5c85d56a67f6" containerID="51ebddd440f7c6c56d60c11fb298511c47c086183f594b3048b6156db19324a6" exitCode=0
Jul 20 19:37:53.619315 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.618928    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"
Jul 20 19:37:53.619315 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.618953    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz" event={"ID":"90935e40-7322-4ee2-87a8-5c85d56a67f6","Type":"ContainerDied","Data":"51ebddd440f7c6c56d60c11fb298511c47c086183f594b3048b6156db19324a6"}
Jul 20 19:37:53.619315 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.618994    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz" event={"ID":"90935e40-7322-4ee2-87a8-5c85d56a67f6","Type":"ContainerDied","Data":"c6ab6cf668da30bfc1ce398585127dd9d4118cdb06cf08fcb1a6030f6129d25b"}
Jul 20 19:37:53.619315 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.619017    2560 scope.go:117] "RemoveContainer" containerID="51ebddd440f7c6c56d60c11fb298511c47c086183f594b3048b6156db19324a6"
Jul 20 19:37:53.628993 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.628977    2560 scope.go:117] "RemoveContainer" containerID="51ebddd440f7c6c56d60c11fb298511c47c086183f594b3048b6156db19324a6"
Jul 20 19:37:53.629295 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:37:53.629276    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51ebddd440f7c6c56d60c11fb298511c47c086183f594b3048b6156db19324a6\": container with ID starting with 51ebddd440f7c6c56d60c11fb298511c47c086183f594b3048b6156db19324a6 not found: ID does not exist" containerID="51ebddd440f7c6c56d60c11fb298511c47c086183f594b3048b6156db19324a6"
Jul 20 19:37:53.629378 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.629307    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51ebddd440f7c6c56d60c11fb298511c47c086183f594b3048b6156db19324a6"} err="failed to get container status \"51ebddd440f7c6c56d60c11fb298511c47c086183f594b3048b6156db19324a6\": rpc error: code = NotFound desc = could not find container \"51ebddd440f7c6c56d60c11fb298511c47c086183f594b3048b6156db19324a6\": container with ID starting with 51ebddd440f7c6c56d60c11fb298511c47c086183f594b3048b6156db19324a6 not found: ID does not exist"
Jul 20 19:37:53.640639 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.640619    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"]
Jul 20 19:37:53.644039 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:53.644019    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d43dd5-55bbccc957-fc8kz"]
Jul 20 19:37:54.738954 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:54.738923    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90935e40-7322-4ee2-87a8-5c85d56a67f6" path="/var/lib/kubelet/pods/90935e40-7322-4ee2-87a8-5c85d56a67f6/volumes"
Jul 20 19:37:55.216034 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:37:55.216005    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:38:07.760694 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.760603    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"]
Jul 20 19:38:07.761169 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.761105    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90935e40-7322-4ee2-87a8-5c85d56a67f6" containerName="maas-api"
Jul 20 19:38:07.761169 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.761135    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="90935e40-7322-4ee2-87a8-5c85d56a67f6" containerName="maas-api"
Jul 20 19:38:07.761169 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.761156    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da6857a2-099c-4fd3-ab26-16209de8227c" containerName="revoke-keys"
Jul 20 19:38:07.761169 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.761161    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="da6857a2-099c-4fd3-ab26-16209de8227c" containerName="revoke-keys"
Jul 20 19:38:07.761410 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.761225    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="da6857a2-099c-4fd3-ab26-16209de8227c" containerName="revoke-keys"
Jul 20 19:38:07.761410 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.761239    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="90935e40-7322-4ee2-87a8-5c85d56a67f6" containerName="maas-api"
Jul 20 19:38:07.765474 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.765452    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"
Jul 20 19:38:07.768276 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.768258    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 19:38:07.768518 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.768503    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:38:07.768518 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.768512    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-3e0d8c-serving-cert\""
Jul 20 19:38:07.769081 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.769068    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9tjtc\""
Jul 20 19:38:07.774573 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.774554    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"]
Jul 20 19:38:07.882395 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.882365    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9760311-358f-4296-923c-d51d1671cfa2-openshift-service-ca\") pod \"maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn\" (UID: \"e9760311-358f-4296-923c-d51d1671cfa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"
Jul 20 19:38:07.882527 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.882401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwjt8\" (UniqueName: \"kubernetes.io/projected/e9760311-358f-4296-923c-d51d1671cfa2-kube-api-access-qwjt8\") pod \"maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn\" (UID: \"e9760311-358f-4296-923c-d51d1671cfa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"
Jul 20 19:38:07.882527 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.882438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9760311-358f-4296-923c-d51d1671cfa2-maas-api-tls\") pod \"maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn\" (UID: \"e9760311-358f-4296-923c-d51d1671cfa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"
Jul 20 19:38:07.983678 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.983652    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9760311-358f-4296-923c-d51d1671cfa2-openshift-service-ca\") pod \"maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn\" (UID: \"e9760311-358f-4296-923c-d51d1671cfa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"
Jul 20 19:38:07.983810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.983687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwjt8\" (UniqueName: \"kubernetes.io/projected/e9760311-358f-4296-923c-d51d1671cfa2-kube-api-access-qwjt8\") pod \"maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn\" (UID: \"e9760311-358f-4296-923c-d51d1671cfa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"
Jul 20 19:38:07.983810 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.983720    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9760311-358f-4296-923c-d51d1671cfa2-maas-api-tls\") pod \"maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn\" (UID: \"e9760311-358f-4296-923c-d51d1671cfa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"
Jul 20 19:38:07.983892 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:38:07.983825    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-serving-cert: secret "maas-api-e2e-api-a-3e0d8c-serving-cert" not found
Jul 20 19:38:07.983892 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:38:07.983882    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9760311-358f-4296-923c-d51d1671cfa2-maas-api-tls podName:e9760311-358f-4296-923c-d51d1671cfa2 nodeName:}" failed. No retries permitted until 2026-07-20 19:38:08.483866943 +0000 UTC m=+2251.279874255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e9760311-358f-4296-923c-d51d1671cfa2-maas-api-tls") pod "maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn" (UID: "e9760311-358f-4296-923c-d51d1671cfa2") : secret "maas-api-e2e-api-a-3e0d8c-serving-cert" not found
Jul 20 19:38:07.984251 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.984232    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9760311-358f-4296-923c-d51d1671cfa2-openshift-service-ca\") pod \"maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn\" (UID: \"e9760311-358f-4296-923c-d51d1671cfa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"
Jul 20 19:38:07.992620 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:07.992592    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwjt8\" (UniqueName: \"kubernetes.io/projected/e9760311-358f-4296-923c-d51d1671cfa2-kube-api-access-qwjt8\") pod \"maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn\" (UID: \"e9760311-358f-4296-923c-d51d1671cfa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"
Jul 20 19:38:08.487547 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:08.487518    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9760311-358f-4296-923c-d51d1671cfa2-maas-api-tls\") pod \"maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn\" (UID: \"e9760311-358f-4296-923c-d51d1671cfa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"
Jul 20 19:38:08.489837 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:08.489817    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9760311-358f-4296-923c-d51d1671cfa2-maas-api-tls\") pod \"maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn\" (UID: \"e9760311-358f-4296-923c-d51d1671cfa2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"
Jul 20 19:38:08.676500 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:08.676472    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"
Jul 20 19:38:08.810680 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:08.810571    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"]
Jul 20 19:38:08.813338 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:38:08.813311    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9760311_358f_4296_923c_d51d1671cfa2.slice/crio-1c7250a04740f4da4b49cdfdfbdd26c47ad1514df969d8d494b5c43f37f26657 WatchSource:0}: Error finding container 1c7250a04740f4da4b49cdfdfbdd26c47ad1514df969d8d494b5c43f37f26657: Status 404 returned error can't find the container with id 1c7250a04740f4da4b49cdfdfbdd26c47ad1514df969d8d494b5c43f37f26657
Jul 20 19:38:09.703989 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:09.703947    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn" event={"ID":"e9760311-358f-4296-923c-d51d1671cfa2","Type":"ContainerStarted","Data":"f7541b7c07da05f8f3b8a0488b79b3262f2d1ae36db5edb7982184deac7822f8"}
Jul 20 19:38:09.704178 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:09.704006    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn" event={"ID":"e9760311-358f-4296-923c-d51d1671cfa2","Type":"ContainerStarted","Data":"1c7250a04740f4da4b49cdfdfbdd26c47ad1514df969d8d494b5c43f37f26657"}
Jul 20 19:38:09.704178 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:09.704047    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"
Jul 20 19:38:09.723597 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:09.723550    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn" podStartSLOduration=2.247909878 podStartE2EDuration="2.723534589s" totalImagesPullingTime="475.624711ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:38:09.722233543 +0000 UTC m=+2252.518240905" watchObservedRunningTime="2026-07-20 19:38:09.723534589 +0000 UTC m=+2252.519541921"
Jul 20 19:38:15.714334 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:15.714308    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"
Jul 20 19:38:15.910329 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:15.910298    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:38:15.921395 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:15.921368    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"]
Jul 20 19:38:15.924833 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:15.924815    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"
Jul 20 19:38:15.927056 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:15.927037    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-4cceca-serving-cert\""
Jul 20 19:38:15.934442 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:15.934412    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"]
Jul 20 19:38:16.048040 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:16.047968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8c569e0-95ce-41b3-9050-efcfffa53034-openshift-service-ca\") pod \"maas-api-e2e-api-b-4cceca-7f659954d5-fq26f\" (UID: \"b8c569e0-95ce-41b3-9050-efcfffa53034\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"
Jul 20 19:38:16.048040 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:16.047998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhp6q\" (UniqueName: \"kubernetes.io/projected/b8c569e0-95ce-41b3-9050-efcfffa53034-kube-api-access-xhp6q\") pod \"maas-api-e2e-api-b-4cceca-7f659954d5-fq26f\" (UID: \"b8c569e0-95ce-41b3-9050-efcfffa53034\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"
Jul 20 19:38:16.048040 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:16.048019    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8c569e0-95ce-41b3-9050-efcfffa53034-maas-api-tls\") pod \"maas-api-e2e-api-b-4cceca-7f659954d5-fq26f\" (UID: \"b8c569e0-95ce-41b3-9050-efcfffa53034\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"
Jul 20 19:38:16.149445 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:16.149414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8c569e0-95ce-41b3-9050-efcfffa53034-openshift-service-ca\") pod \"maas-api-e2e-api-b-4cceca-7f659954d5-fq26f\" (UID: \"b8c569e0-95ce-41b3-9050-efcfffa53034\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"
Jul 20 19:38:16.149584 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:16.149447    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhp6q\" (UniqueName: \"kubernetes.io/projected/b8c569e0-95ce-41b3-9050-efcfffa53034-kube-api-access-xhp6q\") pod \"maas-api-e2e-api-b-4cceca-7f659954d5-fq26f\" (UID: \"b8c569e0-95ce-41b3-9050-efcfffa53034\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"
Jul 20 19:38:16.149584 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:16.149475    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8c569e0-95ce-41b3-9050-efcfffa53034-maas-api-tls\") pod \"maas-api-e2e-api-b-4cceca-7f659954d5-fq26f\" (UID: \"b8c569e0-95ce-41b3-9050-efcfffa53034\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"
Jul 20 19:38:16.150029 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:16.150005    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8c569e0-95ce-41b3-9050-efcfffa53034-openshift-service-ca\") pod \"maas-api-e2e-api-b-4cceca-7f659954d5-fq26f\" (UID: \"b8c569e0-95ce-41b3-9050-efcfffa53034\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"
Jul 20 19:38:16.151783 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:16.151762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8c569e0-95ce-41b3-9050-efcfffa53034-maas-api-tls\") pod \"maas-api-e2e-api-b-4cceca-7f659954d5-fq26f\" (UID: \"b8c569e0-95ce-41b3-9050-efcfffa53034\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"
Jul 20 19:38:16.160084 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:16.160063    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhp6q\" (UniqueName: \"kubernetes.io/projected/b8c569e0-95ce-41b3-9050-efcfffa53034-kube-api-access-xhp6q\") pod \"maas-api-e2e-api-b-4cceca-7f659954d5-fq26f\" (UID: \"b8c569e0-95ce-41b3-9050-efcfffa53034\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"
Jul 20 19:38:16.235957 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:16.235932    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"
Jul 20 19:38:16.367031 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:16.367003    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"]
Jul 20 19:38:16.369775 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:38:16.369745    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c569e0_95ce_41b3_9050_efcfffa53034.slice/crio-0c12f0c8ce0dca3875525cb34f4a7f2e29e44d1a8ab8772ff0e4ea6c3788d0e3 WatchSource:0}: Error finding container 0c12f0c8ce0dca3875525cb34f4a7f2e29e44d1a8ab8772ff0e4ea6c3788d0e3: Status 404 returned error can't find the container with id 0c12f0c8ce0dca3875525cb34f4a7f2e29e44d1a8ab8772ff0e4ea6c3788d0e3
Jul 20 19:38:16.740420 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:16.740388    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f" event={"ID":"b8c569e0-95ce-41b3-9050-efcfffa53034","Type":"ContainerStarted","Data":"0c12f0c8ce0dca3875525cb34f4a7f2e29e44d1a8ab8772ff0e4ea6c3788d0e3"}
Jul 20 19:38:17.746603 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:17.746565    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f" event={"ID":"b8c569e0-95ce-41b3-9050-efcfffa53034","Type":"ContainerStarted","Data":"c9c42b51e1455d0b58aba330001811d512b39727f3cf90deb38072158fb1bdad"}
Jul 20 19:38:17.747024 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:17.746684    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"
Jul 20 19:38:17.762461 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:17.762415    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f" podStartSLOduration=2.316657013 podStartE2EDuration="2.762401828s" totalImagesPullingTime="445.744815ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:38:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:38:17.761501766 +0000 UTC m=+2260.557509100" watchObservedRunningTime="2026-07-20 19:38:17.762401828 +0000 UTC m=+2260.558409161"
Jul 20 19:38:23.756536 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:23.756507    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"
Jul 20 19:38:29.427208 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:29.427174    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h"]
Jul 20 19:38:29.430799 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:29.430782    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h"
Jul 20 19:38:29.432762 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:29.432745    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jx7gs\""
Jul 20 19:38:29.436714 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:29.436690    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h"]
Jul 20 19:38:29.454639 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:29.454617    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aff8ee4-f32a-43a8-97c7-d0d7f18b2966-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h\" (UID: \"6aff8ee4-f32a-43a8-97c7-d0d7f18b2966\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h"
Jul 20 19:38:29.556002 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:29.555974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aff8ee4-f32a-43a8-97c7-d0d7f18b2966-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h\" (UID: \"6aff8ee4-f32a-43a8-97c7-d0d7f18b2966\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h"
Jul 20 19:38:29.556589 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:29.556570    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aff8ee4-f32a-43a8-97c7-d0d7f18b2966-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h\" (UID: \"6aff8ee4-f32a-43a8-97c7-d0d7f18b2966\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h"
Jul 20 19:38:29.743421 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:29.743396    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h"
Jul 20 19:38:29.872045 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:29.872014    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h"]
Jul 20 19:38:29.874347 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:38:29.874311    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aff8ee4_f32a_43a8_97c7_d0d7f18b2966.slice/crio-fccce130b06cd2a8159eb6dadfe1b70dbb88838c051fae99d2bed6b68d3b173e WatchSource:0}: Error finding container fccce130b06cd2a8159eb6dadfe1b70dbb88838c051fae99d2bed6b68d3b173e: Status 404 returned error can't find the container with id fccce130b06cd2a8159eb6dadfe1b70dbb88838c051fae99d2bed6b68d3b173e
Jul 20 19:38:30.813302 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:30.813265    2560 generic.go:356] "Generic (PLEG): container finished" podID="6aff8ee4-f32a-43a8-97c7-d0d7f18b2966" containerID="46f46e37a2ea727de2d3f17e076d82222255a36b6745bafb38ca2191442345c6" exitCode=0
Jul 20 19:38:30.813650 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:30.813340    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h" event={"ID":"6aff8ee4-f32a-43a8-97c7-d0d7f18b2966","Type":"ContainerDied","Data":"46f46e37a2ea727de2d3f17e076d82222255a36b6745bafb38ca2191442345c6"}
Jul 20 19:38:30.813650 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:30.813390    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h" event={"ID":"6aff8ee4-f32a-43a8-97c7-d0d7f18b2966","Type":"ContainerStarted","Data":"fccce130b06cd2a8159eb6dadfe1b70dbb88838c051fae99d2bed6b68d3b173e"}
Jul 20 19:38:31.919951 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:31.919918    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:38:31.951531 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:31.951508    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h"
Jul 20 19:38:31.978689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:31.978667    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aff8ee4-f32a-43a8-97c7-d0d7f18b2966-maas-api-service-ca\") pod \"6aff8ee4-f32a-43a8-97c7-d0d7f18b2966\" (UID: \"6aff8ee4-f32a-43a8-97c7-d0d7f18b2966\") "
Jul 20 19:38:31.978986 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:31.978959    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6aff8ee4-f32a-43a8-97c7-d0d7f18b2966-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6aff8ee4-f32a-43a8-97c7-d0d7f18b2966" (UID: "6aff8ee4-f32a-43a8-97c7-d0d7f18b2966"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:38:32.079969 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:32.079915    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aff8ee4-f32a-43a8-97c7-d0d7f18b2966-maas-api-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:38:32.824322 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:32.824295    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h"
Jul 20 19:38:32.824451 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:32.824338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h" event={"ID":"6aff8ee4-f32a-43a8-97c7-d0d7f18b2966","Type":"ContainerDied","Data":"fccce130b06cd2a8159eb6dadfe1b70dbb88838c051fae99d2bed6b68d3b173e"}
Jul 20 19:38:32.824451 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:32.824385    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fccce130b06cd2a8159eb6dadfe1b70dbb88838c051fae99d2bed6b68d3b173e"
Jul 20 19:38:37.952847 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:37.952812    2560 scope.go:117] "RemoveContainer" containerID="1cb61d41e38b4fc3d7b3624809fa58ba07a25464cbb5cb6b44f607c3a165d170"
Jul 20 19:38:45.251707 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.251674    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"]
Jul 20 19:38:45.252181 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.251883    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn" podUID="e9760311-358f-4296-923c-d51d1671cfa2" containerName="maas-api" containerID="cri-o://f7541b7c07da05f8f3b8a0488b79b3262f2d1ae36db5edb7982184deac7822f8" gracePeriod=30
Jul 20 19:38:45.501840 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.501780    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"
Jul 20 19:38:45.583197 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.583167    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9760311-358f-4296-923c-d51d1671cfa2-maas-api-tls\") pod \"e9760311-358f-4296-923c-d51d1671cfa2\" (UID: \"e9760311-358f-4296-923c-d51d1671cfa2\") "
Jul 20 19:38:45.583337 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.583276    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9760311-358f-4296-923c-d51d1671cfa2-openshift-service-ca\") pod \"e9760311-358f-4296-923c-d51d1671cfa2\" (UID: \"e9760311-358f-4296-923c-d51d1671cfa2\") "
Jul 20 19:38:45.583379 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.583352    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwjt8\" (UniqueName: \"kubernetes.io/projected/e9760311-358f-4296-923c-d51d1671cfa2-kube-api-access-qwjt8\") pod \"e9760311-358f-4296-923c-d51d1671cfa2\" (UID: \"e9760311-358f-4296-923c-d51d1671cfa2\") "
Jul 20 19:38:45.583614 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.583587    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9760311-358f-4296-923c-d51d1671cfa2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e9760311-358f-4296-923c-d51d1671cfa2" (UID: "e9760311-358f-4296-923c-d51d1671cfa2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:38:45.585351 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.585329    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9760311-358f-4296-923c-d51d1671cfa2-kube-api-access-qwjt8" (OuterVolumeSpecName: "kube-api-access-qwjt8") pod "e9760311-358f-4296-923c-d51d1671cfa2" (UID: "e9760311-358f-4296-923c-d51d1671cfa2"). InnerVolumeSpecName "kube-api-access-qwjt8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:38:45.585460 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.585356    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9760311-358f-4296-923c-d51d1671cfa2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e9760311-358f-4296-923c-d51d1671cfa2" (UID: "e9760311-358f-4296-923c-d51d1671cfa2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:38:45.684488 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.684463    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9760311-358f-4296-923c-d51d1671cfa2-openshift-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:38:45.684488 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.684488    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwjt8\" (UniqueName: \"kubernetes.io/projected/e9760311-358f-4296-923c-d51d1671cfa2-kube-api-access-qwjt8\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:38:45.684615 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.684497    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9760311-358f-4296-923c-d51d1671cfa2-maas-api-tls\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:38:45.891406 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.891336    2560 generic.go:356] "Generic (PLEG): container finished" podID="e9760311-358f-4296-923c-d51d1671cfa2" containerID="f7541b7c07da05f8f3b8a0488b79b3262f2d1ae36db5edb7982184deac7822f8" exitCode=0
Jul 20 19:38:45.891406 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.891390    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"
Jul 20 19:38:45.891534 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.891426    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn" event={"ID":"e9760311-358f-4296-923c-d51d1671cfa2","Type":"ContainerDied","Data":"f7541b7c07da05f8f3b8a0488b79b3262f2d1ae36db5edb7982184deac7822f8"}
Jul 20 19:38:45.891534 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.891486    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn" event={"ID":"e9760311-358f-4296-923c-d51d1671cfa2","Type":"ContainerDied","Data":"1c7250a04740f4da4b49cdfdfbdd26c47ad1514df969d8d494b5c43f37f26657"}
Jul 20 19:38:45.891534 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.891511    2560 scope.go:117] "RemoveContainer" containerID="f7541b7c07da05f8f3b8a0488b79b3262f2d1ae36db5edb7982184deac7822f8"
Jul 20 19:38:45.901115 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.901097    2560 scope.go:117] "RemoveContainer" containerID="f7541b7c07da05f8f3b8a0488b79b3262f2d1ae36db5edb7982184deac7822f8"
Jul 20 19:38:45.901463 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:38:45.901441    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7541b7c07da05f8f3b8a0488b79b3262f2d1ae36db5edb7982184deac7822f8\": container with ID starting with f7541b7c07da05f8f3b8a0488b79b3262f2d1ae36db5edb7982184deac7822f8 not found: ID does not exist" containerID="f7541b7c07da05f8f3b8a0488b79b3262f2d1ae36db5edb7982184deac7822f8"
Jul 20 19:38:45.901551 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.901470    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7541b7c07da05f8f3b8a0488b79b3262f2d1ae36db5edb7982184deac7822f8"} err="failed to get container status \"f7541b7c07da05f8f3b8a0488b79b3262f2d1ae36db5edb7982184deac7822f8\": rpc error: code = NotFound desc = could not find container \"f7541b7c07da05f8f3b8a0488b79b3262f2d1ae36db5edb7982184deac7822f8\": container with ID starting with f7541b7c07da05f8f3b8a0488b79b3262f2d1ae36db5edb7982184deac7822f8 not found: ID does not exist"
Jul 20 19:38:45.913778 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.913753    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"]
Jul 20 19:38:45.917316 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:45.917295    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3e0d8c-858fb4c8b-ffzzn"]
Jul 20 19:38:46.740077 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:46.740038    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9760311-358f-4296-923c-d51d1671cfa2" path="/var/lib/kubelet/pods/e9760311-358f-4296-923c-d51d1671cfa2/volumes"
Jul 20 19:38:49.526500 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:49.526463    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h"]
Jul 20 19:38:49.528186 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:49.528165    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3e0d8c-xtw6h"]
Jul 20 19:38:49.913029 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:49.912932    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:38:50.740292 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:50.740260    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6aff8ee4-f32a-43a8-97c7-d0d7f18b2966" path="/var/lib/kubelet/pods/6aff8ee4-f32a-43a8-97c7-d0d7f18b2966/volumes"
Jul 20 19:38:56.298269 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:56.298237    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz"]
Jul 20 19:38:56.298729 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:56.298622    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9760311-358f-4296-923c-d51d1671cfa2" containerName="maas-api"
Jul 20 19:38:56.298729 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:56.298634    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9760311-358f-4296-923c-d51d1671cfa2" containerName="maas-api"
Jul 20 19:38:56.298729 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:56.298657    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aff8ee4-f32a-43a8-97c7-d0d7f18b2966" containerName="revoke-keys"
Jul 20 19:38:56.298729 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:56.298667    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aff8ee4-f32a-43a8-97c7-d0d7f18b2966" containerName="revoke-keys"
Jul 20 19:38:56.298729 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:56.298729    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9760311-358f-4296-923c-d51d1671cfa2" containerName="maas-api"
Jul 20 19:38:56.298889 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:56.298749    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aff8ee4-f32a-43a8-97c7-d0d7f18b2966" containerName="revoke-keys"
Jul 20 19:38:56.303470 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:56.303453    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz"
Jul 20 19:38:56.307334 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:56.307310    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jx7gs\""
Jul 20 19:38:56.317781 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:56.317750    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz"]
Jul 20 19:38:56.371351 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:56.371321    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/674c8224-f16e-4959-9aa2-20e63c5dda6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz\" (UID: \"674c8224-f16e-4959-9aa2-20e63c5dda6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz"
Jul 20 19:38:56.471907 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:56.471880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/674c8224-f16e-4959-9aa2-20e63c5dda6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz\" (UID: \"674c8224-f16e-4959-9aa2-20e63c5dda6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz"
Jul 20 19:38:56.472538 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:56.472514    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/674c8224-f16e-4959-9aa2-20e63c5dda6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz\" (UID: \"674c8224-f16e-4959-9aa2-20e63c5dda6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz"
Jul 20 19:38:56.622598 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:56.622532    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz"
Jul 20 19:38:56.750911 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:56.750887    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz"]
Jul 20 19:38:56.754279 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:38:56.754253    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674c8224_f16e_4959_9aa2_20e63c5dda6b.slice/crio-b68fb4f565aa14afbdd57241e6dbe7d31646c6c915629e1708d45256156bf1c9 WatchSource:0}: Error finding container b68fb4f565aa14afbdd57241e6dbe7d31646c6c915629e1708d45256156bf1c9: Status 404 returned error can't find the container with id b68fb4f565aa14afbdd57241e6dbe7d31646c6c915629e1708d45256156bf1c9
Jul 20 19:38:56.952023 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:56.951993    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz" event={"ID":"674c8224-f16e-4959-9aa2-20e63c5dda6b","Type":"ContainerStarted","Data":"b68fb4f565aa14afbdd57241e6dbe7d31646c6c915629e1708d45256156bf1c9"}
Jul 20 19:38:57.958563 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:57.958529    2560 generic.go:356] "Generic (PLEG): container finished" podID="674c8224-f16e-4959-9aa2-20e63c5dda6b" containerID="9b084ef82efb5619d58fd768d886fe5278a09815ddf606519f3fa9abbd067971" exitCode=0
Jul 20 19:38:57.958931 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:57.958611    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz" event={"ID":"674c8224-f16e-4959-9aa2-20e63c5dda6b","Type":"ContainerDied","Data":"9b084ef82efb5619d58fd768d886fe5278a09815ddf606519f3fa9abbd067971"}
Jul 20 19:38:59.092400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:59.092376    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz"
Jul 20 19:38:59.196577 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:59.196549    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/674c8224-f16e-4959-9aa2-20e63c5dda6b-maas-api-service-ca\") pod \"674c8224-f16e-4959-9aa2-20e63c5dda6b\" (UID: \"674c8224-f16e-4959-9aa2-20e63c5dda6b\") "
Jul 20 19:38:59.196876 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:59.196854    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/674c8224-f16e-4959-9aa2-20e63c5dda6b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "674c8224-f16e-4959-9aa2-20e63c5dda6b" (UID: "674c8224-f16e-4959-9aa2-20e63c5dda6b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:38:59.298047 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:59.297984    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/674c8224-f16e-4959-9aa2-20e63c5dda6b-maas-api-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:38:59.968879 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:59.968848    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz" event={"ID":"674c8224-f16e-4959-9aa2-20e63c5dda6b","Type":"ContainerDied","Data":"b68fb4f565aa14afbdd57241e6dbe7d31646c6c915629e1708d45256156bf1c9"}
Jul 20 19:38:59.968879 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:59.968873    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz"
Jul 20 19:38:59.969090 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:38:59.968891    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b68fb4f565aa14afbdd57241e6dbe7d31646c6c915629e1708d45256156bf1c9"
Jul 20 19:39:11.794628 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:11.794593    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"]
Jul 20 19:39:11.795107 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:11.794843    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f" podUID="b8c569e0-95ce-41b3-9050-efcfffa53034" containerName="maas-api" containerID="cri-o://c9c42b51e1455d0b58aba330001811d512b39727f3cf90deb38072158fb1bdad" gracePeriod=30
Jul 20 19:39:12.032361 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:12.032332    2560 generic.go:356] "Generic (PLEG): container finished" podID="b8c569e0-95ce-41b3-9050-efcfffa53034" containerID="c9c42b51e1455d0b58aba330001811d512b39727f3cf90deb38072158fb1bdad" exitCode=0
Jul 20 19:39:12.032511 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:12.032406    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f" event={"ID":"b8c569e0-95ce-41b3-9050-efcfffa53034","Type":"ContainerDied","Data":"c9c42b51e1455d0b58aba330001811d512b39727f3cf90deb38072158fb1bdad"}
Jul 20 19:39:12.061154 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:12.061103    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"
Jul 20 19:39:12.208942 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:12.208917    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8c569e0-95ce-41b3-9050-efcfffa53034-maas-api-tls\") pod \"b8c569e0-95ce-41b3-9050-efcfffa53034\" (UID: \"b8c569e0-95ce-41b3-9050-efcfffa53034\") "
Jul 20 19:39:12.209100 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:12.209010    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8c569e0-95ce-41b3-9050-efcfffa53034-openshift-service-ca\") pod \"b8c569e0-95ce-41b3-9050-efcfffa53034\" (UID: \"b8c569e0-95ce-41b3-9050-efcfffa53034\") "
Jul 20 19:39:12.209100 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:12.209045    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhp6q\" (UniqueName: \"kubernetes.io/projected/b8c569e0-95ce-41b3-9050-efcfffa53034-kube-api-access-xhp6q\") pod \"b8c569e0-95ce-41b3-9050-efcfffa53034\" (UID: \"b8c569e0-95ce-41b3-9050-efcfffa53034\") "
Jul 20 19:39:12.209429 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:12.209403    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8c569e0-95ce-41b3-9050-efcfffa53034-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b8c569e0-95ce-41b3-9050-efcfffa53034" (UID: "b8c569e0-95ce-41b3-9050-efcfffa53034"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:39:12.211045 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:12.211007    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8c569e0-95ce-41b3-9050-efcfffa53034-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b8c569e0-95ce-41b3-9050-efcfffa53034" (UID: "b8c569e0-95ce-41b3-9050-efcfffa53034"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:39:12.211045 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:12.211035    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8c569e0-95ce-41b3-9050-efcfffa53034-kube-api-access-xhp6q" (OuterVolumeSpecName: "kube-api-access-xhp6q") pod "b8c569e0-95ce-41b3-9050-efcfffa53034" (UID: "b8c569e0-95ce-41b3-9050-efcfffa53034"). InnerVolumeSpecName "kube-api-access-xhp6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:39:12.310112 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:12.310056    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8c569e0-95ce-41b3-9050-efcfffa53034-openshift-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:39:12.310112 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:12.310078    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhp6q\" (UniqueName: \"kubernetes.io/projected/b8c569e0-95ce-41b3-9050-efcfffa53034-kube-api-access-xhp6q\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:39:12.310112 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:12.310088    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8c569e0-95ce-41b3-9050-efcfffa53034-maas-api-tls\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:39:13.039057 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:13.038983    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"
Jul 20 19:39:13.039057 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:13.039008    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f" event={"ID":"b8c569e0-95ce-41b3-9050-efcfffa53034","Type":"ContainerDied","Data":"0c12f0c8ce0dca3875525cb34f4a7f2e29e44d1a8ab8772ff0e4ea6c3788d0e3"}
Jul 20 19:39:13.039572 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:13.039080    2560 scope.go:117] "RemoveContainer" containerID="c9c42b51e1455d0b58aba330001811d512b39727f3cf90deb38072158fb1bdad"
Jul 20 19:39:13.058491 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:13.058467    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"]
Jul 20 19:39:13.063987 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:13.063965    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4cceca-7f659954d5-fq26f"]
Jul 20 19:39:14.739333 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:14.739305    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8c569e0-95ce-41b3-9050-efcfffa53034" path="/var/lib/kubelet/pods/b8c569e0-95ce-41b3-9050-efcfffa53034/volumes"
Jul 20 19:39:16.399657 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:16.399627    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz"]
Jul 20 19:39:16.403164 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:16.403139    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4cceca-cx4dz"]
Jul 20 19:39:16.408772 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:16.408752    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:39:16.739730 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:16.739702    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="674c8224-f16e-4959-9aa2-20e63c5dda6b" path="/var/lib/kubelet/pods/674c8224-f16e-4959-9aa2-20e63c5dda6b/volumes"
Jul 20 19:39:27.315963 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.315923    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"]
Jul 20 19:39:27.316505 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.316489    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8c569e0-95ce-41b3-9050-efcfffa53034" containerName="maas-api"
Jul 20 19:39:27.316550 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.316508    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8c569e0-95ce-41b3-9050-efcfffa53034" containerName="maas-api"
Jul 20 19:39:27.316550 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.316524    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="674c8224-f16e-4959-9aa2-20e63c5dda6b" containerName="revoke-keys"
Jul 20 19:39:27.316550 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.316533    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="674c8224-f16e-4959-9aa2-20e63c5dda6b" containerName="revoke-keys"
Jul 20 19:39:27.316645 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.316638    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="674c8224-f16e-4959-9aa2-20e63c5dda6b" containerName="revoke-keys"
Jul 20 19:39:27.316682 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.316651    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8c569e0-95ce-41b3-9050-efcfffa53034" containerName="maas-api"
Jul 20 19:39:27.321179 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.321159    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"
Jul 20 19:39:27.323418 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.323396    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9tjtc\""
Jul 20 19:39:27.323518 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.323396    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 19:39:27.323518 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.323394    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-037874-serving-cert\""
Jul 20 19:39:27.324093 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.324071    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 19:39:27.327848 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.327824    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"]
Jul 20 19:39:27.336029 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.336005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fde06ee-3b73-4d03-a33a-59bbef57ce54-maas-api-tls\") pod \"maas-api-e2e-shared-a-037874-687d9ffd49-59nv2\" (UID: \"3fde06ee-3b73-4d03-a33a-59bbef57ce54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"
Jul 20 19:39:27.336174 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.336041    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fde06ee-3b73-4d03-a33a-59bbef57ce54-openshift-service-ca\") pod \"maas-api-e2e-shared-a-037874-687d9ffd49-59nv2\" (UID: \"3fde06ee-3b73-4d03-a33a-59bbef57ce54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"
Jul 20 19:39:27.336174 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.336079    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zwmz\" (UniqueName: \"kubernetes.io/projected/3fde06ee-3b73-4d03-a33a-59bbef57ce54-kube-api-access-9zwmz\") pod \"maas-api-e2e-shared-a-037874-687d9ffd49-59nv2\" (UID: \"3fde06ee-3b73-4d03-a33a-59bbef57ce54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"
Jul 20 19:39:27.437400 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.437370    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fde06ee-3b73-4d03-a33a-59bbef57ce54-maas-api-tls\") pod \"maas-api-e2e-shared-a-037874-687d9ffd49-59nv2\" (UID: \"3fde06ee-3b73-4d03-a33a-59bbef57ce54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"
Jul 20 19:39:27.437548 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.437424    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fde06ee-3b73-4d03-a33a-59bbef57ce54-openshift-service-ca\") pod \"maas-api-e2e-shared-a-037874-687d9ffd49-59nv2\" (UID: \"3fde06ee-3b73-4d03-a33a-59bbef57ce54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"
Jul 20 19:39:27.437548 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.437467    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zwmz\" (UniqueName: \"kubernetes.io/projected/3fde06ee-3b73-4d03-a33a-59bbef57ce54-kube-api-access-9zwmz\") pod \"maas-api-e2e-shared-a-037874-687d9ffd49-59nv2\" (UID: \"3fde06ee-3b73-4d03-a33a-59bbef57ce54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"
Jul 20 19:39:27.437548 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:39:27.437512    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-serving-cert: secret "maas-api-e2e-shared-a-037874-serving-cert" not found
Jul 20 19:39:27.437715 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:39:27.437586    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fde06ee-3b73-4d03-a33a-59bbef57ce54-maas-api-tls podName:3fde06ee-3b73-4d03-a33a-59bbef57ce54 nodeName:}" failed. No retries permitted until 2026-07-20 19:39:27.937564397 +0000 UTC m=+2330.733571708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3fde06ee-3b73-4d03-a33a-59bbef57ce54-maas-api-tls") pod "maas-api-e2e-shared-a-037874-687d9ffd49-59nv2" (UID: "3fde06ee-3b73-4d03-a33a-59bbef57ce54") : secret "maas-api-e2e-shared-a-037874-serving-cert" not found
Jul 20 19:39:27.438172 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.438154    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fde06ee-3b73-4d03-a33a-59bbef57ce54-openshift-service-ca\") pod \"maas-api-e2e-shared-a-037874-687d9ffd49-59nv2\" (UID: \"3fde06ee-3b73-4d03-a33a-59bbef57ce54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"
Jul 20 19:39:27.448101 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.448081    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zwmz\" (UniqueName: \"kubernetes.io/projected/3fde06ee-3b73-4d03-a33a-59bbef57ce54-kube-api-access-9zwmz\") pod \"maas-api-e2e-shared-a-037874-687d9ffd49-59nv2\" (UID: \"3fde06ee-3b73-4d03-a33a-59bbef57ce54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"
Jul 20 19:39:27.942349 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.942312    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fde06ee-3b73-4d03-a33a-59bbef57ce54-maas-api-tls\") pod \"maas-api-e2e-shared-a-037874-687d9ffd49-59nv2\" (UID: \"3fde06ee-3b73-4d03-a33a-59bbef57ce54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"
Jul 20 19:39:27.944644 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:27.944614    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fde06ee-3b73-4d03-a33a-59bbef57ce54-maas-api-tls\") pod \"maas-api-e2e-shared-a-037874-687d9ffd49-59nv2\" (UID: \"3fde06ee-3b73-4d03-a33a-59bbef57ce54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"
Jul 20 19:39:28.233061 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:28.232974    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"
Jul 20 19:39:28.361938 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:28.361910    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"]
Jul 20 19:39:28.363108 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:39:28.363079    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fde06ee_3b73_4d03_a33a_59bbef57ce54.slice/crio-afac7e431b56128df32e7224b882ae70e01a5eda2144508fbc8238ece4b6603f WatchSource:0}: Error finding container afac7e431b56128df32e7224b882ae70e01a5eda2144508fbc8238ece4b6603f: Status 404 returned error can't find the container with id afac7e431b56128df32e7224b882ae70e01a5eda2144508fbc8238ece4b6603f
Jul 20 19:39:29.121442 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:29.121348    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2" event={"ID":"3fde06ee-3b73-4d03-a33a-59bbef57ce54","Type":"ContainerStarted","Data":"c90ca5ed8fe04224ede85ee6fef582276645f8d93633ecfa36d4807181867b7d"}
Jul 20 19:39:29.121442 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:29.121409    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2" event={"ID":"3fde06ee-3b73-4d03-a33a-59bbef57ce54","Type":"ContainerStarted","Data":"afac7e431b56128df32e7224b882ae70e01a5eda2144508fbc8238ece4b6603f"}
Jul 20 19:39:29.121679 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:29.121489    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"
Jul 20 19:39:29.138844 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:29.138792    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2" podStartSLOduration=1.705944887 podStartE2EDuration="2.138777196s" totalImagesPullingTime="432.832309ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:39:29.136913626 +0000 UTC m=+2331.932920973" watchObservedRunningTime="2026-07-20 19:39:29.138777196 +0000 UTC m=+2331.934784529"
Jul 20 19:39:35.004381 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:35.004346    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:39:35.130936 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:35.130910    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"
Jul 20 19:39:35.328926 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:35.328831    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"]
Jul 20 19:39:35.332940 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:35.332920    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"
Jul 20 19:39:35.335530 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:35.335508    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-e35917-serving-cert\""
Jul 20 19:39:35.345113 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:35.345090    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"]
Jul 20 19:39:35.408540 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:35.408518    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e35917-b856bc66f-5vq22\" (UID: \"58b538bf-b2d5-4a08-acbe-7a10e1328d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"
Jul 20 19:39:35.408636 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:35.408558    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-maas-api-tls\") pod \"maas-api-e2e-shared-b-e35917-b856bc66f-5vq22\" (UID: \"58b538bf-b2d5-4a08-acbe-7a10e1328d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"
Jul 20 19:39:35.408636 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:35.408625    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg2k5\" (UniqueName: \"kubernetes.io/projected/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-kube-api-access-kg2k5\") pod \"maas-api-e2e-shared-b-e35917-b856bc66f-5vq22\" (UID: \"58b538bf-b2d5-4a08-acbe-7a10e1328d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"
Jul 20 19:39:35.509696 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:35.509671    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg2k5\" (UniqueName: \"kubernetes.io/projected/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-kube-api-access-kg2k5\") pod \"maas-api-e2e-shared-b-e35917-b856bc66f-5vq22\" (UID: \"58b538bf-b2d5-4a08-acbe-7a10e1328d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"
Jul 20 19:39:35.509788 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:35.509721    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e35917-b856bc66f-5vq22\" (UID: \"58b538bf-b2d5-4a08-acbe-7a10e1328d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"
Jul 20 19:39:35.509788 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:35.509749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-maas-api-tls\") pod \"maas-api-e2e-shared-b-e35917-b856bc66f-5vq22\" (UID: \"58b538bf-b2d5-4a08-acbe-7a10e1328d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"
Jul 20 19:39:35.510374 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:35.510349    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e35917-b856bc66f-5vq22\" (UID: \"58b538bf-b2d5-4a08-acbe-7a10e1328d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"
Jul 20 19:39:35.512239 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:35.512217    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-maas-api-tls\") pod \"maas-api-e2e-shared-b-e35917-b856bc66f-5vq22\" (UID: \"58b538bf-b2d5-4a08-acbe-7a10e1328d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"
Jul 20 19:39:35.519712 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:35.519692    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg2k5\" (UniqueName: \"kubernetes.io/projected/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-kube-api-access-kg2k5\") pod \"maas-api-e2e-shared-b-e35917-b856bc66f-5vq22\" (UID: \"58b538bf-b2d5-4a08-acbe-7a10e1328d3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"
Jul 20 19:39:35.643803 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:35.643735    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"
Jul 20 19:39:35.774772 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:35.774748    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"]
Jul 20 19:39:35.776679 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:39:35.776647    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b538bf_b2d5_4a08_acbe_7a10e1328d3e.slice/crio-66aec8c1aba20c1ee1b7b5c60ea9f67fe8e8293b31f87e7c97c4a164b3b1530f WatchSource:0}: Error finding container 66aec8c1aba20c1ee1b7b5c60ea9f67fe8e8293b31f87e7c97c4a164b3b1530f: Status 404 returned error can't find the container with id 66aec8c1aba20c1ee1b7b5c60ea9f67fe8e8293b31f87e7c97c4a164b3b1530f
Jul 20 19:39:36.157038 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:36.157012    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22" event={"ID":"58b538bf-b2d5-4a08-acbe-7a10e1328d3e","Type":"ContainerStarted","Data":"72ef61f102183b4e78372428ffc3044eb56752f9fdb1fd7f9fbc7fd5e7a9ef8f"}
Jul 20 19:39:36.157429 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:36.157060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22" event={"ID":"58b538bf-b2d5-4a08-acbe-7a10e1328d3e","Type":"ContainerStarted","Data":"66aec8c1aba20c1ee1b7b5c60ea9f67fe8e8293b31f87e7c97c4a164b3b1530f"}
Jul 20 19:39:36.157429 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:36.157088    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"
Jul 20 19:39:36.182087 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:36.182037    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22" podStartSLOduration=0.869481074 podStartE2EDuration="1.182019861s" totalImagesPullingTime="312.538787ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:39:36.181137107 +0000 UTC m=+2338.977144433" watchObservedRunningTime="2026-07-20 19:39:36.182019861 +0000 UTC m=+2338.978027194"
Jul 20 19:39:37.979873 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:37.979841    2560 scope.go:117] "RemoveContainer" containerID="e35acee7aa6c6131d372cfc700d77c9d952902ab924d8e97ee5dffb5592aa5b3"
Jul 20 19:39:42.168211 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:42.168184    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"
Jul 20 19:39:49.233980 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:39:49.233944    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:40:04.335960 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:04.335922    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:40:37.870777 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:37.870745    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:40:37.874235 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:37.874209    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:40:37.877219 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:37.877194    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:40:37.880470 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:37.880452    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:40:46.058436 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.058404    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"]
Jul 20 19:40:46.062017 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.061991    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.084893 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.084870    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e35917\"/\"auth-test-model-e35917-kserve-self-signed-certs\""
Jul 20 19:40:46.084989 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.084870    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e35917\"/\"default-dockercfg-ntdg8\""
Jul 20 19:40:46.086668 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.086651    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e35917\"/\"kube-root-ca.crt\""
Jul 20 19:40:46.087467 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.087450    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e35917\"/\"openshift-service-ca.crt\""
Jul 20 19:40:46.104994 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.104973    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"]
Jul 20 19:40:46.183097 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.183072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85e23712-d0fe-4b05-9441-8ec03e0b65b8-tls-certs\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.183218 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.183138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlh68\" (UniqueName: \"kubernetes.io/projected/85e23712-d0fe-4b05-9441-8ec03e0b65b8-kube-api-access-rlh68\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.183218 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.183194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-dshm\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.183218 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.183210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-model-cache\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.183321 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.183264    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-tmp-dir\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.183360 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.183330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-home\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.283753 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.283726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-tmp-dir\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.283870 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.283793    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-home\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.283870 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.283822    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85e23712-d0fe-4b05-9441-8ec03e0b65b8-tls-certs\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.283990 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.283875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlh68\" (UniqueName: \"kubernetes.io/projected/85e23712-d0fe-4b05-9441-8ec03e0b65b8-kube-api-access-rlh68\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.283990 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.283934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-dshm\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.283990 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.283963    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-model-cache\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.284207 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.284183    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-tmp-dir\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.284278 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.284227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-home\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.284392 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.284375    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-model-cache\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.286203 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.286183    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-dshm\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.286487 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.286471    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85e23712-d0fe-4b05-9441-8ec03e0b65b8-tls-certs\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.296406 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.296386    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlh68\" (UniqueName: \"kubernetes.io/projected/85e23712-d0fe-4b05-9441-8ec03e0b65b8-kube-api-access-rlh68\") pod \"auth-test-model-e35917-kserve-cf5d6f95f-95hzl\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") " pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.372358 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.372301    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:46.505393 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:46.505371    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"]
Jul 20 19:40:46.508147 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:40:46.508104    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85e23712_d0fe_4b05_9441_8ec03e0b65b8.slice/crio-dea4e6abed8cc37a3401823dfb2c6b2b2dbd50cf3ecc473c88ed172490ff8ce1 WatchSource:0}: Error finding container dea4e6abed8cc37a3401823dfb2c6b2b2dbd50cf3ecc473c88ed172490ff8ce1: Status 404 returned error can't find the container with id dea4e6abed8cc37a3401823dfb2c6b2b2dbd50cf3ecc473c88ed172490ff8ce1
Jul 20 19:40:47.519901 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:47.519864    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl" event={"ID":"85e23712-d0fe-4b05-9441-8ec03e0b65b8","Type":"ContainerStarted","Data":"54ed5597833c7b23a5ce98342daf20ced2fd50c8f2b1bb1729b98971d8036e60"}
Jul 20 19:40:47.520277 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:47.519914    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl" event={"ID":"85e23712-d0fe-4b05-9441-8ec03e0b65b8","Type":"ContainerStarted","Data":"dea4e6abed8cc37a3401823dfb2c6b2b2dbd50cf3ecc473c88ed172490ff8ce1"}
Jul 20 19:40:47.559503 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:47.559451    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl" podStartSLOduration=1.55943798 podStartE2EDuration="1.55943798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:40:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:40:47.55660695 +0000 UTC m=+2410.352614283" watchObservedRunningTime="2026-07-20 19:40:47.55943798 +0000 UTC m=+2410.355445313"
Jul 20 19:40:49.860756 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:49.860721    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:40:56.372530 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:56.372493    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:56.373021 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:56.372548    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:56.384965 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:56.384941    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:40:56.575088 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:40:56.575063    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:41:03.857407 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:41:03.857326    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:41:21.255637 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:41:21.255591    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:41:38.516602 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:41:38.516570    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:41:56.113780 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:41:56.113748    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:42:14.216531 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:14.216497    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:42:31.412411 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:31.412338    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:42:43.608378 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:43.608344    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"]
Jul 20 19:42:47.411092 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:47.410958    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:42:58.634596 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:58.634561    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl" podUID="85e23712-d0fe-4b05-9441-8ec03e0b65b8" containerName="main" containerID="cri-o://54ed5597833c7b23a5ce98342daf20ced2fd50c8f2b1bb1729b98971d8036e60" gracePeriod=45
Jul 20 19:42:58.890074 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:58.890017    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:42:59.075084 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.075056    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85e23712-d0fe-4b05-9441-8ec03e0b65b8-tls-certs\") pod \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") "
Jul 20 19:42:59.075289 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.075103    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-model-cache\") pod \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") "
Jul 20 19:42:59.075289 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.075169    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-tmp-dir\") pod \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") "
Jul 20 19:42:59.075289 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.075219    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlh68\" (UniqueName: \"kubernetes.io/projected/85e23712-d0fe-4b05-9441-8ec03e0b65b8-kube-api-access-rlh68\") pod \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") "
Jul 20 19:42:59.075289 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.075239    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-home\") pod \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") "
Jul 20 19:42:59.075289 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.075258    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-dshm\") pod \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\" (UID: \"85e23712-d0fe-4b05-9441-8ec03e0b65b8\") "
Jul 20 19:42:59.075551 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.075436    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-model-cache" (OuterVolumeSpecName: "model-cache") pod "85e23712-d0fe-4b05-9441-8ec03e0b65b8" (UID: "85e23712-d0fe-4b05-9441-8ec03e0b65b8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:42:59.075551 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.075517    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "85e23712-d0fe-4b05-9441-8ec03e0b65b8" (UID: "85e23712-d0fe-4b05-9441-8ec03e0b65b8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:42:59.075551 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.075528    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-home" (OuterVolumeSpecName: "home") pod "85e23712-d0fe-4b05-9441-8ec03e0b65b8" (UID: "85e23712-d0fe-4b05-9441-8ec03e0b65b8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:42:59.075673 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.075590    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-model-cache\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:42:59.077417 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.077393    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-dshm" (OuterVolumeSpecName: "dshm") pod "85e23712-d0fe-4b05-9441-8ec03e0b65b8" (UID: "85e23712-d0fe-4b05-9441-8ec03e0b65b8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:42:59.077513 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.077412    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85e23712-d0fe-4b05-9441-8ec03e0b65b8-kube-api-access-rlh68" (OuterVolumeSpecName: "kube-api-access-rlh68") pod "85e23712-d0fe-4b05-9441-8ec03e0b65b8" (UID: "85e23712-d0fe-4b05-9441-8ec03e0b65b8"). InnerVolumeSpecName "kube-api-access-rlh68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:42:59.077513 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.077433    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85e23712-d0fe-4b05-9441-8ec03e0b65b8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "85e23712-d0fe-4b05-9441-8ec03e0b65b8" (UID: "85e23712-d0fe-4b05-9441-8ec03e0b65b8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:42:59.176886 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.176816    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-home\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:42:59.176886 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.176838    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-dshm\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:42:59.176886 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.176847    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85e23712-d0fe-4b05-9441-8ec03e0b65b8-tls-certs\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:42:59.176886 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.176860    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85e23712-d0fe-4b05-9441-8ec03e0b65b8-tmp-dir\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:42:59.176886 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.176872    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlh68\" (UniqueName: \"kubernetes.io/projected/85e23712-d0fe-4b05-9441-8ec03e0b65b8-kube-api-access-rlh68\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:42:59.177840 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.177813    2560 generic.go:356] "Generic (PLEG): container finished" podID="85e23712-d0fe-4b05-9441-8ec03e0b65b8" containerID="54ed5597833c7b23a5ce98342daf20ced2fd50c8f2b1bb1729b98971d8036e60" exitCode=0
Jul 20 19:42:59.177910 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.177859    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"
Jul 20 19:42:59.177910 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.177895    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl" event={"ID":"85e23712-d0fe-4b05-9441-8ec03e0b65b8","Type":"ContainerDied","Data":"54ed5597833c7b23a5ce98342daf20ced2fd50c8f2b1bb1729b98971d8036e60"}
Jul 20 19:42:59.177978 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.177936    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl" event={"ID":"85e23712-d0fe-4b05-9441-8ec03e0b65b8","Type":"ContainerDied","Data":"dea4e6abed8cc37a3401823dfb2c6b2b2dbd50cf3ecc473c88ed172490ff8ce1"}
Jul 20 19:42:59.177978 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.177957    2560 scope.go:117] "RemoveContainer" containerID="54ed5597833c7b23a5ce98342daf20ced2fd50c8f2b1bb1729b98971d8036e60"
Jul 20 19:42:59.187490 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.187475    2560 scope.go:117] "RemoveContainer" containerID="54ed5597833c7b23a5ce98342daf20ced2fd50c8f2b1bb1729b98971d8036e60"
Jul 20 19:42:59.187723 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:42:59.187705    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54ed5597833c7b23a5ce98342daf20ced2fd50c8f2b1bb1729b98971d8036e60\": container with ID starting with 54ed5597833c7b23a5ce98342daf20ced2fd50c8f2b1bb1729b98971d8036e60 not found: ID does not exist" containerID="54ed5597833c7b23a5ce98342daf20ced2fd50c8f2b1bb1729b98971d8036e60"
Jul 20 19:42:59.187763 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.187732    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54ed5597833c7b23a5ce98342daf20ced2fd50c8f2b1bb1729b98971d8036e60"} err="failed to get container status \"54ed5597833c7b23a5ce98342daf20ced2fd50c8f2b1bb1729b98971d8036e60\": rpc error: code = NotFound desc = could not find container \"54ed5597833c7b23a5ce98342daf20ced2fd50c8f2b1bb1729b98971d8036e60\": container with ID starting with 54ed5597833c7b23a5ce98342daf20ced2fd50c8f2b1bb1729b98971d8036e60 not found: ID does not exist"
Jul 20 19:42:59.201240 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.201219    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"]
Jul 20 19:42:59.205293 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:42:59.205272    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e35917/auth-test-model-e35917-kserve-cf5d6f95f-95hzl"]
Jul 20 19:43:00.741063 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:00.741018    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85e23712-d0fe-4b05-9441-8ec03e0b65b8" path="/var/lib/kubelet/pods/85e23712-d0fe-4b05-9441-8ec03e0b65b8/volumes"
Jul 20 19:43:01.212686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:01.212654    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:43:12.416616 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.416581    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"]
Jul 20 19:43:12.417103 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.416969    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85e23712-d0fe-4b05-9441-8ec03e0b65b8" containerName="main"
Jul 20 19:43:12.417103 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.416981    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="85e23712-d0fe-4b05-9441-8ec03e0b65b8" containerName="main"
Jul 20 19:43:12.417103 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.417077    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="85e23712-d0fe-4b05-9441-8ec03e0b65b8" containerName="main"
Jul 20 19:43:12.421412 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.421391    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.423773 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.423750    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e35917\"/\"kube-root-ca.crt\""
Jul 20 19:43:12.423880 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.423833    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e35917\"/\"openshift-service-ca.crt\""
Jul 20 19:43:12.423880 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.423842    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e35917\"/\"default-dockercfg-ntdg8\""
Jul 20 19:43:12.424130 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.424104    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e35917\"/\"sub-test-model-e35917-kserve-self-signed-certs\""
Jul 20 19:43:12.433053 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.433030    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"]
Jul 20 19:43:12.483473 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.483454    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-dshm\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.483575 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.483482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-model-cache\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.483575 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.483526    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-home\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.483575 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.483550    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntkcs\" (UniqueName: \"kubernetes.io/projected/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-kube-api-access-ntkcs\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.483575 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.483574    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-tmp-dir\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.483727 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.483664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-tls-certs\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.585049 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.585018    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-dshm\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.585160 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.585056    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-model-cache\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.585210 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.585179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-home\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.585252 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.585211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntkcs\" (UniqueName: \"kubernetes.io/projected/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-kube-api-access-ntkcs\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.585305 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.585250    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-tmp-dir\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.585357 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.585329    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-tls-certs\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.585459 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.585428    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-model-cache\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.585623 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.585511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-home\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.585623 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.585602    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-tmp-dir\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.587270 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.587248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-dshm\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.587643 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.587627    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-tls-certs\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.593182 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.593163    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntkcs\" (UniqueName: \"kubernetes.io/projected/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-kube-api-access-ntkcs\") pod \"sub-test-model-e35917-kserve-776b4dfc87-md2v5\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") " pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.730842 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.730820    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:12.861932 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:12.861906    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"]
Jul 20 19:43:12.863927 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:43:12.863897    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d02ab93_5b90_4bc4_b7b9_96a7e956e9a7.slice/crio-c417375beba2625a9c08ce32065a451251020601f9ea3aeec8552512c20c1dcc WatchSource:0}: Error finding container c417375beba2625a9c08ce32065a451251020601f9ea3aeec8552512c20c1dcc: Status 404 returned error can't find the container with id c417375beba2625a9c08ce32065a451251020601f9ea3aeec8552512c20c1dcc
Jul 20 19:43:13.249654 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:13.249614    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5" event={"ID":"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7","Type":"ContainerStarted","Data":"e64f4df302795ad882403003471e2551efc430639f246dac9b1637947363924d"}
Jul 20 19:43:13.249814 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:13.249659    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5" event={"ID":"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7","Type":"ContainerStarted","Data":"c417375beba2625a9c08ce32065a451251020601f9ea3aeec8552512c20c1dcc"}
Jul 20 19:43:13.268907 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:13.268860    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5" podStartSLOduration=1.268846447 podStartE2EDuration="1.268846447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:43:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:43:13.26708747 +0000 UTC m=+2556.063094806" watchObservedRunningTime="2026-07-20 19:43:13.268846447 +0000 UTC m=+2556.064853780"
Jul 20 19:43:16.501881 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:16.501847    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:43:22.731542 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:22.731508    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:22.732004 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:22.731555    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:22.745670 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:22.745647    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:23.310539 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:23.310506    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:43:30.512755 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:30.512721    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:43:38.030801 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:38.030767    2560 scope.go:117] "RemoveContainer" containerID="57a614bdd0d8958fd4c7963cc29b3829fdce68ba58a92da559e833938c9630f8"
Jul 20 19:43:48.798554 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:48.798512    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"]
Jul 20 19:43:53.010293 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:43:53.010253    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:44:03.820171 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:03.820062    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5" podUID="7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7" containerName="main" containerID="cri-o://e64f4df302795ad882403003471e2551efc430639f246dac9b1637947363924d" gracePeriod=45
Jul 20 19:44:04.068517 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.068495    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:44:04.204816 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.204789    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-tls-certs\") pod \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") "
Jul 20 19:44:04.204986 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.204822    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-tmp-dir\") pod \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") "
Jul 20 19:44:04.204986 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.204843    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntkcs\" (UniqueName: \"kubernetes.io/projected/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-kube-api-access-ntkcs\") pod \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") "
Jul 20 19:44:04.204986 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.204870    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-dshm\") pod \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") "
Jul 20 19:44:04.205210 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.204986    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-model-cache\") pod \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") "
Jul 20 19:44:04.205210 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.205058    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7" (UID: "7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:44:04.205210 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.205063    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-home\") pod \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\" (UID: \"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7\") "
Jul 20 19:44:04.205378 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.205262    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-model-cache" (OuterVolumeSpecName: "model-cache") pod "7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7" (UID: "7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:44:04.205378 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.205276    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-home" (OuterVolumeSpecName: "home") pod "7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7" (UID: "7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:44:04.205451 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.205411    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-model-cache\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:44:04.205451 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.205424    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-home\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:44:04.205451 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.205433    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-tmp-dir\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:44:04.206967 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.206940    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7" (UID: "7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:44:04.207393 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.207377    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-dshm" (OuterVolumeSpecName: "dshm") pod "7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7" (UID: "7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 19:44:04.207458 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.207395    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-kube-api-access-ntkcs" (OuterVolumeSpecName: "kube-api-access-ntkcs") pod "7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7" (UID: "7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7"). InnerVolumeSpecName "kube-api-access-ntkcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:44:04.306164 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.306140    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-tls-certs\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:44:04.306164 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.306159    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntkcs\" (UniqueName: \"kubernetes.io/projected/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-kube-api-access-ntkcs\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:44:04.306164 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.306168    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7-dshm\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:44:04.508931 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.508857    2560 generic.go:356] "Generic (PLEG): container finished" podID="7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7" containerID="e64f4df302795ad882403003471e2551efc430639f246dac9b1637947363924d" exitCode=0
Jul 20 19:44:04.508931 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.508908    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"
Jul 20 19:44:04.508931 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.508924    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5" event={"ID":"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7","Type":"ContainerDied","Data":"e64f4df302795ad882403003471e2551efc430639f246dac9b1637947363924d"}
Jul 20 19:44:04.509191 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.508963    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5" event={"ID":"7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7","Type":"ContainerDied","Data":"c417375beba2625a9c08ce32065a451251020601f9ea3aeec8552512c20c1dcc"}
Jul 20 19:44:04.509191 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.508985    2560 scope.go:117] "RemoveContainer" containerID="e64f4df302795ad882403003471e2551efc430639f246dac9b1637947363924d"
Jul 20 19:44:04.518239 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.518224    2560 scope.go:117] "RemoveContainer" containerID="e64f4df302795ad882403003471e2551efc430639f246dac9b1637947363924d"
Jul 20 19:44:04.518468 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:44:04.518450    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e64f4df302795ad882403003471e2551efc430639f246dac9b1637947363924d\": container with ID starting with e64f4df302795ad882403003471e2551efc430639f246dac9b1637947363924d not found: ID does not exist" containerID="e64f4df302795ad882403003471e2551efc430639f246dac9b1637947363924d"
Jul 20 19:44:04.518528 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.518475    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e64f4df302795ad882403003471e2551efc430639f246dac9b1637947363924d"} err="failed to get container status \"e64f4df302795ad882403003471e2551efc430639f246dac9b1637947363924d\": rpc error: code = NotFound desc = could not find container \"e64f4df302795ad882403003471e2551efc430639f246dac9b1637947363924d\": container with ID starting with e64f4df302795ad882403003471e2551efc430639f246dac9b1637947363924d not found: ID does not exist"
Jul 20 19:44:04.529929 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.529908    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"]
Jul 20 19:44:04.534193 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.534172    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e35917/sub-test-model-e35917-kserve-776b4dfc87-md2v5"]
Jul 20 19:44:04.739262 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:04.739240    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7" path="/var/lib/kubelet/pods/7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7/volumes"
Jul 20 19:44:07.705748 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:07.705716    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:44:21.610667 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:21.610633    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:44:38.056260 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:38.056226    2560 scope.go:117] "RemoveContainer" containerID="46f46e37a2ea727de2d3f17e076d82222255a36b6745bafb38ca2191442345c6"
Jul 20 19:44:43.713156 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:43.713113    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:44:58.606966 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:44:58.606934    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:45:00.128255 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.128220    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-037874-29742945-8ch2p"]
Jul 20 19:45:00.128615 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.128604    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7" containerName="main"
Jul 20 19:45:00.128615 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.128615    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7" containerName="main"
Jul 20 19:45:00.128698 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.128688    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d02ab93-5b90-4bc4-b7b9-96a7e956e9a7" containerName="main"
Jul 20 19:45:00.131833 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.131808    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-037874-29742945-8ch2p"
Jul 20 19:45:00.134079 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.134051    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e35917-29742945-f5fxq"]
Jul 20 19:45:00.134227 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.134209    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jx7gs\""
Jul 20 19:45:00.137450 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.137430    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742945-zfzrl"]
Jul 20 19:45:00.138290 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.137590    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e35917-29742945-f5fxq"
Jul 20 19:45:00.141096 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.141076    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-037874-29742945-8ch2p"]
Jul 20 19:45:00.141251 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.141168    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-zfzrl"
Jul 20 19:45:00.145652 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.145545    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-037874-29742945-8ch2p"
Jul 20 19:45:00.148637 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.148619    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742945-zfzrl"]
Jul 20 19:45:00.154784 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.154766    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e35917-29742945-f5fxq"]
Jul 20 19:45:00.157568 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.156724    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e35917-29742945-f5fxq"
Jul 20 19:45:00.185770 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.185735    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-zfzrl"
Jul 20 19:45:00.305315 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.305286    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-037874-29742945-8ch2p"]
Jul 20 19:45:00.308512 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:45:00.308486    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b961df_e82e_4d34_9013_13b187a9e228.slice/crio-56b9bd2e80e7aa54008e0bcd18568dc0e3490aa2494e6f246a9b0f06f3c5b442 WatchSource:0}: Error finding container 56b9bd2e80e7aa54008e0bcd18568dc0e3490aa2494e6f246a9b0f06f3c5b442: Status 404 returned error can't find the container with id 56b9bd2e80e7aa54008e0bcd18568dc0e3490aa2494e6f246a9b0f06f3c5b442
Jul 20 19:45:00.362165 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.362145    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742945-zfzrl"]
Jul 20 19:45:00.364593 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:45:00.364573    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc704d89a_336e_4064_9bb9_0c03b1111686.slice/crio-7bda6e0d1d9ec32c47e91c68acbeb9b45558d68aa50af7e69f0676de4075b4bf WatchSource:0}: Error finding container 7bda6e0d1d9ec32c47e91c68acbeb9b45558d68aa50af7e69f0676de4075b4bf: Status 404 returned error can't find the container with id 7bda6e0d1d9ec32c47e91c68acbeb9b45558d68aa50af7e69f0676de4075b4bf
Jul 20 19:45:00.538665 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.538641    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e35917-29742945-f5fxq"]
Jul 20 19:45:00.540626 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:45:00.540603    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33f478c0_814a_40f6_a317_dce5f6b89ba2.slice/crio-508ebbfb189742c29d7a4b279607867f6fd4539809e0dfbef6e0b00f49e97cfb WatchSource:0}: Error finding container 508ebbfb189742c29d7a4b279607867f6fd4539809e0dfbef6e0b00f49e97cfb: Status 404 returned error can't find the container with id 508ebbfb189742c29d7a4b279607867f6fd4539809e0dfbef6e0b00f49e97cfb
Jul 20 19:45:00.800648 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.800614    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e35917-29742945-f5fxq" event={"ID":"33f478c0-814a-40f6-a317-dce5f6b89ba2","Type":"ContainerStarted","Data":"508ebbfb189742c29d7a4b279607867f6fd4539809e0dfbef6e0b00f49e97cfb"}
Jul 20 19:45:00.802396 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.802371    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-037874-29742945-8ch2p" event={"ID":"48b961df-e82e-4d34-9013-13b187a9e228","Type":"ContainerStarted","Data":"0a64af0d741f9543256b020f721b82b2c8c2350f0e9ee8bb2fcde143811f3ab5"}
Jul 20 19:45:00.802512 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.802422    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-037874-29742945-8ch2p" event={"ID":"48b961df-e82e-4d34-9013-13b187a9e228","Type":"ContainerStarted","Data":"56b9bd2e80e7aa54008e0bcd18568dc0e3490aa2494e6f246a9b0f06f3c5b442"}
Jul 20 19:45:00.803912 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.803889    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-zfzrl" event={"ID":"c704d89a-336e-4064-9bb9-0c03b1111686","Type":"ContainerStarted","Data":"f368346452610da97a73a1c38f97bb0364a8750f398209edf057816ba781f046"}
Jul 20 19:45:00.804003 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.803937    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-zfzrl" event={"ID":"c704d89a-336e-4064-9bb9-0c03b1111686","Type":"ContainerStarted","Data":"7bda6e0d1d9ec32c47e91c68acbeb9b45558d68aa50af7e69f0676de4075b4bf"}
Jul 20 19:45:00.818519 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.818478    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-037874-29742945-8ch2p" podStartSLOduration=0.818463503 podStartE2EDuration="818.463503ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:45:00.816403198 +0000 UTC m=+2663.612410534" watchObservedRunningTime="2026-07-20 19:45:00.818463503 +0000 UTC m=+2663.614470835"
Jul 20 19:45:00.830703 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:00.830665    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-zfzrl" podStartSLOduration=0.830654373 podStartE2EDuration="830.654373ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:45:00.829857845 +0000 UTC m=+2663.625865180" watchObservedRunningTime="2026-07-20 19:45:00.830654373 +0000 UTC m=+2663.626661705"
Jul 20 19:45:01.809977 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:01.809941    2560 generic.go:356] "Generic (PLEG): container finished" podID="c704d89a-336e-4064-9bb9-0c03b1111686" containerID="f368346452610da97a73a1c38f97bb0364a8750f398209edf057816ba781f046" exitCode=0
Jul 20 19:45:01.810378 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:01.810021    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-zfzrl" event={"ID":"c704d89a-336e-4064-9bb9-0c03b1111686","Type":"ContainerDied","Data":"f368346452610da97a73a1c38f97bb0364a8750f398209edf057816ba781f046"}
Jul 20 19:45:01.811454 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:01.811432    2560 generic.go:356] "Generic (PLEG): container finished" podID="33f478c0-814a-40f6-a317-dce5f6b89ba2" containerID="bdb8c3e9117bbf33705f895fbc55748f1336c06e7ef70a83879a77a6f63e244c" exitCode=0
Jul 20 19:45:01.811518 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:01.811499    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e35917-29742945-f5fxq" event={"ID":"33f478c0-814a-40f6-a317-dce5f6b89ba2","Type":"ContainerDied","Data":"bdb8c3e9117bbf33705f895fbc55748f1336c06e7ef70a83879a77a6f63e244c"}
Jul 20 19:45:01.812710 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:01.812689    2560 generic.go:356] "Generic (PLEG): container finished" podID="48b961df-e82e-4d34-9013-13b187a9e228" containerID="0a64af0d741f9543256b020f721b82b2c8c2350f0e9ee8bb2fcde143811f3ab5" exitCode=0
Jul 20 19:45:01.812801 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:01.812713    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-037874-29742945-8ch2p" event={"ID":"48b961df-e82e-4d34-9013-13b187a9e228","Type":"ContainerDied","Data":"0a64af0d741f9543256b020f721b82b2c8c2350f0e9ee8bb2fcde143811f3ab5"}
Jul 20 19:45:02.958254 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:02.958108    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-zfzrl"
Jul 20 19:45:02.994721 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:02.994700    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-037874-29742945-8ch2p"
Jul 20 19:45:02.998916 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:02.998899    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e35917-29742945-f5fxq"
Jul 20 19:45:03.822665 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:03.822635    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-zfzrl"
Jul 20 19:45:03.822845 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:03.822667    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742945-zfzrl" event={"ID":"c704d89a-336e-4064-9bb9-0c03b1111686","Type":"ContainerDied","Data":"7bda6e0d1d9ec32c47e91c68acbeb9b45558d68aa50af7e69f0676de4075b4bf"}
Jul 20 19:45:03.822845 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:03.822718    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7bda6e0d1d9ec32c47e91c68acbeb9b45558d68aa50af7e69f0676de4075b4bf"
Jul 20 19:45:03.823927 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:03.823909    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e35917-29742945-f5fxq"
Jul 20 19:45:03.824053 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:03.823925    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e35917-29742945-f5fxq" event={"ID":"33f478c0-814a-40f6-a317-dce5f6b89ba2","Type":"ContainerDied","Data":"508ebbfb189742c29d7a4b279607867f6fd4539809e0dfbef6e0b00f49e97cfb"}
Jul 20 19:45:03.824053 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:03.823966    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="508ebbfb189742c29d7a4b279607867f6fd4539809e0dfbef6e0b00f49e97cfb"
Jul 20 19:45:03.825219 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:03.825196    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-037874-29742945-8ch2p" event={"ID":"48b961df-e82e-4d34-9013-13b187a9e228","Type":"ContainerDied","Data":"56b9bd2e80e7aa54008e0bcd18568dc0e3490aa2494e6f246a9b0f06f3c5b442"}
Jul 20 19:45:03.825318 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:03.825223    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-037874-29742945-8ch2p"
Jul 20 19:45:03.825318 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:03.825235    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56b9bd2e80e7aa54008e0bcd18568dc0e3490aa2494e6f246a9b0f06f3c5b442"
Jul 20 19:45:08.302250 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.302216    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7316-140203759713072"]
Jul 20 19:45:08.302602 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.302588    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c704d89a-336e-4064-9bb9-0c03b1111686" containerName="cleanup"
Jul 20 19:45:08.302602 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.302599    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c704d89a-336e-4064-9bb9-0c03b1111686" containerName="cleanup"
Jul 20 19:45:08.302686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.302611    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b961df-e82e-4d34-9013-13b187a9e228" containerName="cleanup"
Jul 20 19:45:08.302686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.302617    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b961df-e82e-4d34-9013-13b187a9e228" containerName="cleanup"
Jul 20 19:45:08.302686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.302629    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f478c0-814a-40f6-a317-dce5f6b89ba2" containerName="cleanup"
Jul 20 19:45:08.302686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.302635    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f478c0-814a-40f6-a317-dce5f6b89ba2" containerName="cleanup"
Jul 20 19:45:08.302807 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.302691    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c704d89a-336e-4064-9bb9-0c03b1111686" containerName="cleanup"
Jul 20 19:45:08.302807 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.302700    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="33f478c0-814a-40f6-a317-dce5f6b89ba2" containerName="cleanup"
Jul 20 19:45:08.302807 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.302706    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="48b961df-e82e-4d34-9013-13b187a9e228" containerName="cleanup"
Jul 20 19:45:08.305762 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.305746    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759713072"
Jul 20 19:45:08.307805 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.307784    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vhxv8\""
Jul 20 19:45:08.311715 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.311693    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7316-140203759713072"]
Jul 20 19:45:08.325401 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.325382    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvhfh\" (UniqueName: \"kubernetes.io/projected/59c58f2e-f2ce-4add-a568-591540eae378-kube-api-access-zvhfh\") pod \"test-curl-7316-140203759713072\" (UID: \"59c58f2e-f2ce-4add-a568-591540eae378\") " pod="opendatahub/test-curl-7316-140203759713072"
Jul 20 19:45:08.426281 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.426254    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvhfh\" (UniqueName: \"kubernetes.io/projected/59c58f2e-f2ce-4add-a568-591540eae378-kube-api-access-zvhfh\") pod \"test-curl-7316-140203759713072\" (UID: \"59c58f2e-f2ce-4add-a568-591540eae378\") " pod="opendatahub/test-curl-7316-140203759713072"
Jul 20 19:45:08.433942 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.433918    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvhfh\" (UniqueName: \"kubernetes.io/projected/59c58f2e-f2ce-4add-a568-591540eae378-kube-api-access-zvhfh\") pod \"test-curl-7316-140203759713072\" (UID: \"59c58f2e-f2ce-4add-a568-591540eae378\") " pod="opendatahub/test-curl-7316-140203759713072"
Jul 20 19:45:08.616190 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.616096    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759713072"
Jul 20 19:45:08.746168 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.746064    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7316-140203759713072"]
Jul 20 19:45:08.748603 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:45:08.748578    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59c58f2e_f2ce_4add_a568_591540eae378.slice/crio-d474ac6a1c2fc1107d20459c5d6abe9754d95976cf8aa6c5cc834079b1e94343 WatchSource:0}: Error finding container d474ac6a1c2fc1107d20459c5d6abe9754d95976cf8aa6c5cc834079b1e94343: Status 404 returned error can't find the container with id d474ac6a1c2fc1107d20459c5d6abe9754d95976cf8aa6c5cc834079b1e94343
Jul 20 19:45:08.750196 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.750178    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 19:45:08.851168 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:08.851141    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7316-140203759713072" event={"ID":"59c58f2e-f2ce-4add-a568-591540eae378","Type":"ContainerStarted","Data":"d474ac6a1c2fc1107d20459c5d6abe9754d95976cf8aa6c5cc834079b1e94343"}
Jul 20 19:45:09.857530 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:09.857500    2560 generic.go:356] "Generic (PLEG): container finished" podID="59c58f2e-f2ce-4add-a568-591540eae378" containerID="e80f7ba3a15584daf77e000d4e5ae05285522aa205a3da3b25fb0b735f24b602" exitCode=0
Jul 20 19:45:09.857983 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:09.857588    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7316-140203759713072" event={"ID":"59c58f2e-f2ce-4add-a568-591540eae378","Type":"ContainerDied","Data":"e80f7ba3a15584daf77e000d4e5ae05285522aa205a3da3b25fb0b735f24b602"}
Jul 20 19:45:11.003274 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.003251    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759713072"
Jul 20 19:45:11.046416 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.046390    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7316-140203759713072_59c58f2e-f2ce-4add-a568-591540eae378/test-curl-7316-140203759713072/0.log"
Jul 20 19:45:11.050567 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.050547    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvhfh\" (UniqueName: \"kubernetes.io/projected/59c58f2e-f2ce-4add-a568-591540eae378-kube-api-access-zvhfh\") pod \"59c58f2e-f2ce-4add-a568-591540eae378\" (UID: \"59c58f2e-f2ce-4add-a568-591540eae378\") "
Jul 20 19:45:11.052630 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.052605    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59c58f2e-f2ce-4add-a568-591540eae378-kube-api-access-zvhfh" (OuterVolumeSpecName: "kube-api-access-zvhfh") pod "59c58f2e-f2ce-4add-a568-591540eae378" (UID: "59c58f2e-f2ce-4add-a568-591540eae378"). InnerVolumeSpecName "kube-api-access-zvhfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:45:11.074024 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.073998    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7316-140203759713072"]
Jul 20 19:45:11.075958 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.075937    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7316-140203759713072"]
Jul 20 19:45:11.151406 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.151353    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvhfh\" (UniqueName: \"kubernetes.io/projected/59c58f2e-f2ce-4add-a568-591540eae378-kube-api-access-zvhfh\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:45:11.207426 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.207401    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7316-140203759713584"]
Jul 20 19:45:11.207833 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.207820    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59c58f2e-f2ce-4add-a568-591540eae378" containerName="test-curl-7316-140203759713072"
Jul 20 19:45:11.207881 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.207835    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="59c58f2e-f2ce-4add-a568-591540eae378" containerName="test-curl-7316-140203759713072"
Jul 20 19:45:11.207933 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.207922    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="59c58f2e-f2ce-4add-a568-591540eae378" containerName="test-curl-7316-140203759713072"
Jul 20 19:45:11.211105 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.211091    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759713584"
Jul 20 19:45:11.216579 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.216556    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7316-140203759713584"]
Jul 20 19:45:11.251987 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.251953    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n89w\" (UniqueName: \"kubernetes.io/projected/0c31d5b5-f975-4a09-99f8-d00a1978c11c-kube-api-access-9n89w\") pod \"test-curl-7316-140203759713584\" (UID: \"0c31d5b5-f975-4a09-99f8-d00a1978c11c\") " pod="opendatahub/test-curl-7316-140203759713584"
Jul 20 19:45:11.353269 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.353243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n89w\" (UniqueName: \"kubernetes.io/projected/0c31d5b5-f975-4a09-99f8-d00a1978c11c-kube-api-access-9n89w\") pod \"test-curl-7316-140203759713584\" (UID: \"0c31d5b5-f975-4a09-99f8-d00a1978c11c\") " pod="opendatahub/test-curl-7316-140203759713584"
Jul 20 19:45:11.361813 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.361787    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n89w\" (UniqueName: \"kubernetes.io/projected/0c31d5b5-f975-4a09-99f8-d00a1978c11c-kube-api-access-9n89w\") pod \"test-curl-7316-140203759713584\" (UID: \"0c31d5b5-f975-4a09-99f8-d00a1978c11c\") " pod="opendatahub/test-curl-7316-140203759713584"
Jul 20 19:45:11.521451 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.521412    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759713584"
Jul 20 19:45:11.647514 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.647487    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7316-140203759713584"]
Jul 20 19:45:11.649207 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:45:11.649184    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c31d5b5_f975_4a09_99f8_d00a1978c11c.slice/crio-9721bfd299339fd7bd53c9fd76f311aa0d8e71baa635b512cb35c09208f79fdc WatchSource:0}: Error finding container 9721bfd299339fd7bd53c9fd76f311aa0d8e71baa635b512cb35c09208f79fdc: Status 404 returned error can't find the container with id 9721bfd299339fd7bd53c9fd76f311aa0d8e71baa635b512cb35c09208f79fdc
Jul 20 19:45:11.868224 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.868161    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759713072"
Jul 20 19:45:11.868224 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.868182    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d474ac6a1c2fc1107d20459c5d6abe9754d95976cf8aa6c5cc834079b1e94343"
Jul 20 19:45:11.869453 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:11.869420    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7316-140203759713584" event={"ID":"0c31d5b5-f975-4a09-99f8-d00a1978c11c","Type":"ContainerStarted","Data":"9721bfd299339fd7bd53c9fd76f311aa0d8e71baa635b512cb35c09208f79fdc"}
Jul 20 19:45:11.878379 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:45:11.878356    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7316-140203759713072\" is forbidden: User \"system:node:ip-10-0-140-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-250.ec2.internal' and this object" podUID="59c58f2e-f2ce-4add-a568-591540eae378" pod="opendatahub/test-curl-7316-140203759713072"
Jul 20 19:45:12.739622 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:12.739593    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59c58f2e-f2ce-4add-a568-591540eae378" path="/var/lib/kubelet/pods/59c58f2e-f2ce-4add-a568-591540eae378/volumes"
Jul 20 19:45:12.875239 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:12.875213    2560 generic.go:356] "Generic (PLEG): container finished" podID="0c31d5b5-f975-4a09-99f8-d00a1978c11c" containerID="c05e9fd0e9d3e5ed6fdb3b20f0c2e6e05536712ce7878ec4026818a3bf0880bf" exitCode=0
Jul 20 19:45:12.875370 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:12.875306    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7316-140203759713584" event={"ID":"0c31d5b5-f975-4a09-99f8-d00a1978c11c","Type":"ContainerDied","Data":"c05e9fd0e9d3e5ed6fdb3b20f0c2e6e05536712ce7878ec4026818a3bf0880bf"}
Jul 20 19:45:14.017323 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:14.017302    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759713584"
Jul 20 19:45:14.038409 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:14.038388    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7316-140203759713584_0c31d5b5-f975-4a09-99f8-d00a1978c11c/test-curl-7316-140203759713584/0.log"
Jul 20 19:45:14.062712 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:14.062689    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7316-140203759713584"]
Jul 20 19:45:14.066654 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:14.066636    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7316-140203759713584"]
Jul 20 19:45:14.074875 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:14.074859    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9n89w\" (UniqueName: \"kubernetes.io/projected/0c31d5b5-f975-4a09-99f8-d00a1978c11c-kube-api-access-9n89w\") pod \"0c31d5b5-f975-4a09-99f8-d00a1978c11c\" (UID: \"0c31d5b5-f975-4a09-99f8-d00a1978c11c\") "
Jul 20 19:45:14.076838 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:14.076809    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c31d5b5-f975-4a09-99f8-d00a1978c11c-kube-api-access-9n89w" (OuterVolumeSpecName: "kube-api-access-9n89w") pod "0c31d5b5-f975-4a09-99f8-d00a1978c11c" (UID: "0c31d5b5-f975-4a09-99f8-d00a1978c11c"). InnerVolumeSpecName "kube-api-access-9n89w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:45:14.175939 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:14.175888    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n89w\" (UniqueName: \"kubernetes.io/projected/0c31d5b5-f975-4a09-99f8-d00a1978c11c-kube-api-access-9n89w\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:45:14.739427 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:14.739399    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c31d5b5-f975-4a09-99f8-d00a1978c11c" path="/var/lib/kubelet/pods/0c31d5b5-f975-4a09-99f8-d00a1978c11c/volumes"
Jul 20 19:45:14.886284 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:14.886251    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759713584"
Jul 20 19:45:14.886284 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:14.886263    2560 scope.go:117] "RemoveContainer" containerID="c05e9fd0e9d3e5ed6fdb3b20f0c2e6e05536712ce7878ec4026818a3bf0880bf"
Jul 20 19:45:17.573967 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:17.570956    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7316-140203759747120"]
Jul 20 19:45:17.573967 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:17.571873    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c31d5b5-f975-4a09-99f8-d00a1978c11c" containerName="test-curl-7316-140203759713584"
Jul 20 19:45:17.573967 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:17.571896    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c31d5b5-f975-4a09-99f8-d00a1978c11c" containerName="test-curl-7316-140203759713584"
Jul 20 19:45:17.573967 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:17.572143    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c31d5b5-f975-4a09-99f8-d00a1978c11c" containerName="test-curl-7316-140203759713584"
Jul 20 19:45:17.577705 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:17.577675    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759747120"
Jul 20 19:45:17.584166 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:17.584112    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vhxv8\""
Jul 20 19:45:17.596201 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:17.596179    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7316-140203759747120"]
Jul 20 19:45:17.599569 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:17.599549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b74ph\" (UniqueName: \"kubernetes.io/projected/d243f69f-e672-4457-8ed0-169f8439ca01-kube-api-access-b74ph\") pod \"test-curl-7316-140203759747120\" (UID: \"d243f69f-e672-4457-8ed0-169f8439ca01\") " pod="opendatahub/test-curl-7316-140203759747120"
Jul 20 19:45:17.700475 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:17.700450    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b74ph\" (UniqueName: \"kubernetes.io/projected/d243f69f-e672-4457-8ed0-169f8439ca01-kube-api-access-b74ph\") pod \"test-curl-7316-140203759747120\" (UID: \"d243f69f-e672-4457-8ed0-169f8439ca01\") " pod="opendatahub/test-curl-7316-140203759747120"
Jul 20 19:45:17.709776 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:17.709745    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b74ph\" (UniqueName: \"kubernetes.io/projected/d243f69f-e672-4457-8ed0-169f8439ca01-kube-api-access-b74ph\") pod \"test-curl-7316-140203759747120\" (UID: \"d243f69f-e672-4457-8ed0-169f8439ca01\") " pod="opendatahub/test-curl-7316-140203759747120"
Jul 20 19:45:17.886421 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:17.886348    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759747120"
Jul 20 19:45:18.014794 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:18.014771    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7316-140203759747120"]
Jul 20 19:45:18.016955 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:45:18.016931    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd243f69f_e672_4457_8ed0_169f8439ca01.slice/crio-49b09436837d865438acc0df54dbd1313d769ab0ad4ad017c716c17961f6665e WatchSource:0}: Error finding container 49b09436837d865438acc0df54dbd1313d769ab0ad4ad017c716c17961f6665e: Status 404 returned error can't find the container with id 49b09436837d865438acc0df54dbd1313d769ab0ad4ad017c716c17961f6665e
Jul 20 19:45:18.807253 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:18.807225    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:45:18.912041 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:18.912015    2560 generic.go:356] "Generic (PLEG): container finished" podID="d243f69f-e672-4457-8ed0-169f8439ca01" containerID="1f1e8578e1dac73efff221bd1557565c505fad34f207d4770312d225f70252b5" exitCode=0
Jul 20 19:45:18.912206 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:18.912096    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7316-140203759747120" event={"ID":"d243f69f-e672-4457-8ed0-169f8439ca01","Type":"ContainerDied","Data":"1f1e8578e1dac73efff221bd1557565c505fad34f207d4770312d225f70252b5"}
Jul 20 19:45:18.912206 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:18.912161    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7316-140203759747120" event={"ID":"d243f69f-e672-4457-8ed0-169f8439ca01","Type":"ContainerStarted","Data":"49b09436837d865438acc0df54dbd1313d769ab0ad4ad017c716c17961f6665e"}
Jul 20 19:45:20.062813 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:20.062793    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759747120"
Jul 20 19:45:20.084887 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:20.084856    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7316-140203759747120_d243f69f-e672-4457-8ed0-169f8439ca01/test-curl-7316-140203759747120/0.log"
Jul 20 19:45:20.111027 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:20.111000    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7316-140203759747120"]
Jul 20 19:45:20.114869 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:20.114842    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7316-140203759747120"]
Jul 20 19:45:20.118960 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:20.118940    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b74ph\" (UniqueName: \"kubernetes.io/projected/d243f69f-e672-4457-8ed0-169f8439ca01-kube-api-access-b74ph\") pod \"d243f69f-e672-4457-8ed0-169f8439ca01\" (UID: \"d243f69f-e672-4457-8ed0-169f8439ca01\") "
Jul 20 19:45:20.120905 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:20.120884    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d243f69f-e672-4457-8ed0-169f8439ca01-kube-api-access-b74ph" (OuterVolumeSpecName: "kube-api-access-b74ph") pod "d243f69f-e672-4457-8ed0-169f8439ca01" (UID: "d243f69f-e672-4457-8ed0-169f8439ca01"). InnerVolumeSpecName "kube-api-access-b74ph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:45:20.220248 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:20.220225    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b74ph\" (UniqueName: \"kubernetes.io/projected/d243f69f-e672-4457-8ed0-169f8439ca01-kube-api-access-b74ph\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:45:20.740595 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:20.740564    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d243f69f-e672-4457-8ed0-169f8439ca01" path="/var/lib/kubelet/pods/d243f69f-e672-4457-8ed0-169f8439ca01/volumes"
Jul 20 19:45:20.924975 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:20.924952    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759747120"
Jul 20 19:45:20.925148 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:20.924961    2560 scope.go:117] "RemoveContainer" containerID="1f1e8578e1dac73efff221bd1557565c505fad34f207d4770312d225f70252b5"
Jul 20 19:45:22.607986 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:22.607954    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7316-140203759666208"]
Jul 20 19:45:22.608390 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:22.608368    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d243f69f-e672-4457-8ed0-169f8439ca01" containerName="test-curl-7316-140203759747120"
Jul 20 19:45:22.608390 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:22.608381    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d243f69f-e672-4457-8ed0-169f8439ca01" containerName="test-curl-7316-140203759747120"
Jul 20 19:45:22.608483 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:22.608448    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d243f69f-e672-4457-8ed0-169f8439ca01" containerName="test-curl-7316-140203759747120"
Jul 20 19:45:22.612846 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:22.612831    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759666208"
Jul 20 19:45:22.615267 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:22.615244    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vhxv8\""
Jul 20 19:45:22.616324 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:22.616299    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7316-140203759666208"]
Jul 20 19:45:22.738178 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:22.738147    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvqdt\" (UniqueName: \"kubernetes.io/projected/b0172f1a-5773-4830-9232-91853c87b491-kube-api-access-wvqdt\") pod \"test-curl-7316-140203759666208\" (UID: \"b0172f1a-5773-4830-9232-91853c87b491\") " pod="opendatahub/test-curl-7316-140203759666208"
Jul 20 19:45:22.839152 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:22.839105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvqdt\" (UniqueName: \"kubernetes.io/projected/b0172f1a-5773-4830-9232-91853c87b491-kube-api-access-wvqdt\") pod \"test-curl-7316-140203759666208\" (UID: \"b0172f1a-5773-4830-9232-91853c87b491\") " pod="opendatahub/test-curl-7316-140203759666208"
Jul 20 19:45:22.848191 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:22.848168    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvqdt\" (UniqueName: \"kubernetes.io/projected/b0172f1a-5773-4830-9232-91853c87b491-kube-api-access-wvqdt\") pod \"test-curl-7316-140203759666208\" (UID: \"b0172f1a-5773-4830-9232-91853c87b491\") " pod="opendatahub/test-curl-7316-140203759666208"
Jul 20 19:45:22.923179 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:22.923112    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759666208"
Jul 20 19:45:23.049855 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:23.049833    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7316-140203759666208"]
Jul 20 19:45:23.051475 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:45:23.051444    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0172f1a_5773_4830_9232_91853c87b491.slice/crio-7ca874f55be7475ffe57d65819c676cd89cda070f72f78b9bb13b5082ae55fed WatchSource:0}: Error finding container 7ca874f55be7475ffe57d65819c676cd89cda070f72f78b9bb13b5082ae55fed: Status 404 returned error can't find the container with id 7ca874f55be7475ffe57d65819c676cd89cda070f72f78b9bb13b5082ae55fed
Jul 20 19:45:23.944377 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:23.944346    2560 generic.go:356] "Generic (PLEG): container finished" podID="b0172f1a-5773-4830-9232-91853c87b491" containerID="7914992ed475d905491f63e711e93d2af08919481d2c6e8f4003d49b5b2732c7" exitCode=0
Jul 20 19:45:23.944728 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:23.944431    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7316-140203759666208" event={"ID":"b0172f1a-5773-4830-9232-91853c87b491","Type":"ContainerDied","Data":"7914992ed475d905491f63e711e93d2af08919481d2c6e8f4003d49b5b2732c7"}
Jul 20 19:45:23.944728 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:23.944474    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7316-140203759666208" event={"ID":"b0172f1a-5773-4830-9232-91853c87b491","Type":"ContainerStarted","Data":"7ca874f55be7475ffe57d65819c676cd89cda070f72f78b9bb13b5082ae55fed"}
Jul 20 19:45:25.088640 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.088616    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759666208"
Jul 20 19:45:25.110699 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.110679    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7316-140203759666208_b0172f1a-5773-4830-9232-91853c87b491/test-curl-7316-140203759666208/0.log"
Jul 20 19:45:25.134608 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.134576    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7316-140203759666208"]
Jul 20 19:45:25.136596 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.136579    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7316-140203759666208"]
Jul 20 19:45:25.158158 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.158133    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvqdt\" (UniqueName: \"kubernetes.io/projected/b0172f1a-5773-4830-9232-91853c87b491-kube-api-access-wvqdt\") pod \"b0172f1a-5773-4830-9232-91853c87b491\" (UID: \"b0172f1a-5773-4830-9232-91853c87b491\") "
Jul 20 19:45:25.160158 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.160115    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0172f1a-5773-4830-9232-91853c87b491-kube-api-access-wvqdt" (OuterVolumeSpecName: "kube-api-access-wvqdt") pod "b0172f1a-5773-4830-9232-91853c87b491" (UID: "b0172f1a-5773-4830-9232-91853c87b491"). InnerVolumeSpecName "kube-api-access-wvqdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:45:25.259326 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.259256    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvqdt\" (UniqueName: \"kubernetes.io/projected/b0172f1a-5773-4830-9232-91853c87b491-kube-api-access-wvqdt\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:45:25.320732 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.320702    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-037874-v8kch"]
Jul 20 19:45:25.321152 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.321134    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0172f1a-5773-4830-9232-91853c87b491" containerName="test-curl-7316-140203759666208"
Jul 20 19:45:25.321231 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.321154    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0172f1a-5773-4830-9232-91853c87b491" containerName="test-curl-7316-140203759666208"
Jul 20 19:45:25.321298 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.321283    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0172f1a-5773-4830-9232-91853c87b491" containerName="test-curl-7316-140203759666208"
Jul 20 19:45:25.324273 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.324256    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-037874-v8kch"
Jul 20 19:45:25.326457 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.326440    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jx7gs\""
Jul 20 19:45:25.330714 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.330693    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-037874-v8kch"]
Jul 20 19:45:25.359789 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.359759    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0b378a4-de69-4539-89c4-185010d19c16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-037874-v8kch\" (UID: \"e0b378a4-de69-4539-89c4-185010d19c16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-037874-v8kch"
Jul 20 19:45:25.461066 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.461037    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0b378a4-de69-4539-89c4-185010d19c16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-037874-v8kch\" (UID: \"e0b378a4-de69-4539-89c4-185010d19c16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-037874-v8kch"
Jul 20 19:45:25.461628 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.461611    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0b378a4-de69-4539-89c4-185010d19c16-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-037874-v8kch\" (UID: \"e0b378a4-de69-4539-89c4-185010d19c16\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-037874-v8kch"
Jul 20 19:45:25.636450 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.636391    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-037874-v8kch"
Jul 20 19:45:25.772855 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.772822    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-037874-v8kch"]
Jul 20 19:45:25.774096 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:45:25.774071    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0b378a4_de69_4539_89c4_185010d19c16.slice/crio-627e0b7bb921f103cbcf632b5a6327395449061cbd593a5da0dfe2a23370bab6 WatchSource:0}: Error finding container 627e0b7bb921f103cbcf632b5a6327395449061cbd593a5da0dfe2a23370bab6: Status 404 returned error can't find the container with id 627e0b7bb921f103cbcf632b5a6327395449061cbd593a5da0dfe2a23370bab6
Jul 20 19:45:25.956211 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.956188    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ca874f55be7475ffe57d65819c676cd89cda070f72f78b9bb13b5082ae55fed"
Jul 20 19:45:25.956211 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.956190    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7316-140203759666208"
Jul 20 19:45:25.957346 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:25.957323    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-037874-v8kch" event={"ID":"e0b378a4-de69-4539-89c4-185010d19c16","Type":"ContainerStarted","Data":"627e0b7bb921f103cbcf632b5a6327395449061cbd593a5da0dfe2a23370bab6"}
Jul 20 19:45:25.966644 ip-10-0-140-250 kubenswrapper[2560]: E0720 19:45:25.966619    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7316-140203759666208\" is forbidden: User \"system:node:ip-10-0-140-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-250.ec2.internal' and this object" podUID="b0172f1a-5773-4830-9232-91853c87b491" pod="opendatahub/test-curl-7316-140203759666208"
Jul 20 19:45:26.739592 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:26.739564    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0172f1a-5773-4830-9232-91853c87b491" path="/var/lib/kubelet/pods/b0172f1a-5773-4830-9232-91853c87b491/volumes"
Jul 20 19:45:26.964745 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:26.964716    2560 generic.go:356] "Generic (PLEG): container finished" podID="e0b378a4-de69-4539-89c4-185010d19c16" containerID="e0ba5b483887446734d69d0b2089efc93f31f01318ee0bc166c3a48dd390df2d" exitCode=0
Jul 20 19:45:26.964890 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:26.964795    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-037874-v8kch" event={"ID":"e0b378a4-de69-4539-89c4-185010d19c16","Type":"ContainerDied","Data":"e0ba5b483887446734d69d0b2089efc93f31f01318ee0bc166c3a48dd390df2d"}
Jul 20 19:45:28.102485 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:28.102462    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-037874-v8kch"
Jul 20 19:45:28.180825 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:28.180798    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0b378a4-de69-4539-89c4-185010d19c16-maas-api-service-ca\") pod \"e0b378a4-de69-4539-89c4-185010d19c16\" (UID: \"e0b378a4-de69-4539-89c4-185010d19c16\") "
Jul 20 19:45:28.181115 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:28.181096    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0b378a4-de69-4539-89c4-185010d19c16-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e0b378a4-de69-4539-89c4-185010d19c16" (UID: "e0b378a4-de69-4539-89c4-185010d19c16"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:45:28.281403 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:28.281346    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0b378a4-de69-4539-89c4-185010d19c16-maas-api-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:45:28.976579 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:28.976550    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-037874-v8kch"
Jul 20 19:45:28.976720 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:28.976579    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-037874-v8kch" event={"ID":"e0b378a4-de69-4539-89c4-185010d19c16","Type":"ContainerDied","Data":"627e0b7bb921f103cbcf632b5a6327395449061cbd593a5da0dfe2a23370bab6"}
Jul 20 19:45:28.976720 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:28.976621    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="627e0b7bb921f103cbcf632b5a6327395449061cbd593a5da0dfe2a23370bab6"
Jul 20 19:45:35.864429 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:35.864355    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"]
Jul 20 19:45:35.864839 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:35.864562    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2" podUID="3fde06ee-3b73-4d03-a33a-59bbef57ce54" containerName="maas-api" containerID="cri-o://c90ca5ed8fe04224ede85ee6fef582276645f8d93633ecfa36d4807181867b7d" gracePeriod=30
Jul 20 19:45:35.898083 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:35.898053    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-037874-29742945-8ch2p"]
Jul 20 19:45:35.902904 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:35.902880    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-037874-29742945-8ch2p"]
Jul 20 19:45:36.740602 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:36.740567    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48b961df-e82e-4d34-9013-13b187a9e228" path="/var/lib/kubelet/pods/48b961df-e82e-4d34-9013-13b187a9e228/volumes"
Jul 20 19:45:37.020488 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:37.020414    2560 generic.go:356] "Generic (PLEG): container finished" podID="3fde06ee-3b73-4d03-a33a-59bbef57ce54" containerID="c90ca5ed8fe04224ede85ee6fef582276645f8d93633ecfa36d4807181867b7d" exitCode=0
Jul 20 19:45:37.020846 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:37.020496    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2" event={"ID":"3fde06ee-3b73-4d03-a33a-59bbef57ce54","Type":"ContainerDied","Data":"c90ca5ed8fe04224ede85ee6fef582276645f8d93633ecfa36d4807181867b7d"}
Jul 20 19:45:37.112436 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:37.112408    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"
Jul 20 19:45:37.257910 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:37.257884    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fde06ee-3b73-4d03-a33a-59bbef57ce54-maas-api-tls\") pod \"3fde06ee-3b73-4d03-a33a-59bbef57ce54\" (UID: \"3fde06ee-3b73-4d03-a33a-59bbef57ce54\") "
Jul 20 19:45:37.258063 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:37.257919    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zwmz\" (UniqueName: \"kubernetes.io/projected/3fde06ee-3b73-4d03-a33a-59bbef57ce54-kube-api-access-9zwmz\") pod \"3fde06ee-3b73-4d03-a33a-59bbef57ce54\" (UID: \"3fde06ee-3b73-4d03-a33a-59bbef57ce54\") "
Jul 20 19:45:37.258063 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:37.257988    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fde06ee-3b73-4d03-a33a-59bbef57ce54-openshift-service-ca\") pod \"3fde06ee-3b73-4d03-a33a-59bbef57ce54\" (UID: \"3fde06ee-3b73-4d03-a33a-59bbef57ce54\") "
Jul 20 19:45:37.258378 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:37.258356    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fde06ee-3b73-4d03-a33a-59bbef57ce54-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3fde06ee-3b73-4d03-a33a-59bbef57ce54" (UID: "3fde06ee-3b73-4d03-a33a-59bbef57ce54"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:45:37.260030 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:37.260004    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fde06ee-3b73-4d03-a33a-59bbef57ce54-kube-api-access-9zwmz" (OuterVolumeSpecName: "kube-api-access-9zwmz") pod "3fde06ee-3b73-4d03-a33a-59bbef57ce54" (UID: "3fde06ee-3b73-4d03-a33a-59bbef57ce54"). InnerVolumeSpecName "kube-api-access-9zwmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:45:37.260134 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:37.260031    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fde06ee-3b73-4d03-a33a-59bbef57ce54-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3fde06ee-3b73-4d03-a33a-59bbef57ce54" (UID: "3fde06ee-3b73-4d03-a33a-59bbef57ce54"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:45:37.358966 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:37.358910    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3fde06ee-3b73-4d03-a33a-59bbef57ce54-maas-api-tls\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:45:37.358966 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:37.358933    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zwmz\" (UniqueName: \"kubernetes.io/projected/3fde06ee-3b73-4d03-a33a-59bbef57ce54-kube-api-access-9zwmz\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:45:37.358966 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:37.358942    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fde06ee-3b73-4d03-a33a-59bbef57ce54-openshift-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:45:37.912977 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:37.912949    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:45:37.916783 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:37.916758    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:45:37.917924 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:37.917902    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:45:37.921306 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:37.921287    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:45:38.026559 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:38.026536    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"
Jul 20 19:45:38.026969 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:38.026530    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2" event={"ID":"3fde06ee-3b73-4d03-a33a-59bbef57ce54","Type":"ContainerDied","Data":"afac7e431b56128df32e7224b882ae70e01a5eda2144508fbc8238ece4b6603f"}
Jul 20 19:45:38.026969 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:38.026680    2560 scope.go:117] "RemoveContainer" containerID="c90ca5ed8fe04224ede85ee6fef582276645f8d93633ecfa36d4807181867b7d"
Jul 20 19:45:38.051171 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:38.051144    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"]
Jul 20 19:45:38.054996 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:38.054977    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-037874-687d9ffd49-59nv2"]
Jul 20 19:45:38.079641 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:38.079620    2560 scope.go:117] "RemoveContainer" containerID="9b084ef82efb5619d58fd768d886fe5278a09815ddf606519f3fa9abbd067971"
Jul 20 19:45:38.711580 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:38.711547    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:45:38.741300 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:38.741272    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fde06ee-3b73-4d03-a33a-59bbef57ce54" path="/var/lib/kubelet/pods/3fde06ee-3b73-4d03-a33a-59bbef57ce54/volumes"
Jul 20 19:45:40.445471 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:40.445441    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-037874-v8kch"]
Jul 20 19:45:40.450976 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:40.450953    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-037874-v8kch"]
Jul 20 19:45:40.739272 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:40.739196    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0b378a4-de69-4539-89c4-185010d19c16" path="/var/lib/kubelet/pods/e0b378a4-de69-4539-89c4-185010d19c16/volumes"
Jul 20 19:45:57.997881 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:57.997851    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"]
Jul 20 19:45:57.998316 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:57.998035    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22" podUID="58b538bf-b2d5-4a08-acbe-7a10e1328d3e" containerName="maas-api" containerID="cri-o://72ef61f102183b4e78372428ffc3044eb56752f9fdb1fd7f9fbc7fd5e7a9ef8f" gracePeriod=30
Jul 20 19:45:58.024259 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:58.024235    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e35917-29742945-f5fxq"]
Jul 20 19:45:58.026420 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:58.026401    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e35917-29742945-f5fxq"]
Jul 20 19:45:58.138925 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:58.138895    2560 generic.go:356] "Generic (PLEG): container finished" podID="58b538bf-b2d5-4a08-acbe-7a10e1328d3e" containerID="72ef61f102183b4e78372428ffc3044eb56752f9fdb1fd7f9fbc7fd5e7a9ef8f" exitCode=0
Jul 20 19:45:58.139100 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:58.138962    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22" event={"ID":"58b538bf-b2d5-4a08-acbe-7a10e1328d3e","Type":"ContainerDied","Data":"72ef61f102183b4e78372428ffc3044eb56752f9fdb1fd7f9fbc7fd5e7a9ef8f"}
Jul 20 19:45:58.249554 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:58.249499    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"
Jul 20 19:45:58.427651 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:58.427623    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg2k5\" (UniqueName: \"kubernetes.io/projected/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-kube-api-access-kg2k5\") pod \"58b538bf-b2d5-4a08-acbe-7a10e1328d3e\" (UID: \"58b538bf-b2d5-4a08-acbe-7a10e1328d3e\") "
Jul 20 19:45:58.427795 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:58.427658    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-openshift-service-ca\") pod \"58b538bf-b2d5-4a08-acbe-7a10e1328d3e\" (UID: \"58b538bf-b2d5-4a08-acbe-7a10e1328d3e\") "
Jul 20 19:45:58.427795 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:58.427736    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-maas-api-tls\") pod \"58b538bf-b2d5-4a08-acbe-7a10e1328d3e\" (UID: \"58b538bf-b2d5-4a08-acbe-7a10e1328d3e\") "
Jul 20 19:45:58.428052 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:58.428019    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "58b538bf-b2d5-4a08-acbe-7a10e1328d3e" (UID: "58b538bf-b2d5-4a08-acbe-7a10e1328d3e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 19:45:58.429772 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:58.429750    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-kube-api-access-kg2k5" (OuterVolumeSpecName: "kube-api-access-kg2k5") pod "58b538bf-b2d5-4a08-acbe-7a10e1328d3e" (UID: "58b538bf-b2d5-4a08-acbe-7a10e1328d3e"). InnerVolumeSpecName "kube-api-access-kg2k5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 19:45:58.429866 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:58.429753    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "58b538bf-b2d5-4a08-acbe-7a10e1328d3e" (UID: "58b538bf-b2d5-4a08-acbe-7a10e1328d3e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 19:45:58.529171 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:58.529084    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-maas-api-tls\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:45:58.529171 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:58.529134    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg2k5\" (UniqueName: \"kubernetes.io/projected/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-kube-api-access-kg2k5\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:45:58.529171 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:58.529145    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58b538bf-b2d5-4a08-acbe-7a10e1328d3e-openshift-service-ca\") on node \"ip-10-0-140-250.ec2.internal\" DevicePath \"\""
Jul 20 19:45:58.740861 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:58.740833    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33f478c0-814a-40f6-a317-dce5f6b89ba2" path="/var/lib/kubelet/pods/33f478c0-814a-40f6-a317-dce5f6b89ba2/volumes"
Jul 20 19:45:59.145035 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:59.144988    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22" event={"ID":"58b538bf-b2d5-4a08-acbe-7a10e1328d3e","Type":"ContainerDied","Data":"66aec8c1aba20c1ee1b7b5c60ea9f67fe8e8293b31f87e7c97c4a164b3b1530f"}
Jul 20 19:45:59.145035 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:59.145006    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"
Jul 20 19:45:59.145596 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:59.145056    2560 scope.go:117] "RemoveContainer" containerID="72ef61f102183b4e78372428ffc3044eb56752f9fdb1fd7f9fbc7fd5e7a9ef8f"
Jul 20 19:45:59.162749 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:59.162726    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"]
Jul 20 19:45:59.166594 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:45:59.166574    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e35917-b856bc66f-5vq22"]
Jul 20 19:46:00.739727 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:00.739692    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58b538bf-b2d5-4a08-acbe-7a10e1328d3e" path="/var/lib/kubelet/pods/58b538bf-b2d5-4a08-acbe-7a10e1328d3e/volumes"
Jul 20 19:46:00.904170 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:00.904135    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hqwmw"]
Jul 20 19:46:16.331061 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:16.331030    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc69fccc8-nsn6m_9693c682-68d1-49fe-9dc2-6c6775f2cbc1/manager/0.log"
Jul 20 19:46:16.339609 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:16.339585    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc69fccc8-nsn6m_9693c682-68d1-49fe-9dc2-6c6775f2cbc1/copy-manifests/0.log"
Jul 20 19:46:17.070840 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:17.070811    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742930-bbmmn_05fa1243-2a84-472a-afe9-8b1cba7446e5/cleanup/0.log"
Jul 20 19:46:17.211547 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:17.211517    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742945-zfzrl_c704d89a-336e-4064-9bb9-0c03b1111686/cleanup/0.log"
Jul 20 19:46:19.403386 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:19.403354    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hqwmw_d1441c0e-c7ec-4f9b-a5b4-47f4489efca2/limitador/0.log"
Jul 20 19:46:20.029836 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:20.029809    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-x7stb_8247b686-125a-4945-86fa-7ba56a3207ef/discovery/0.log"
Jul 20 19:46:20.772689 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:20.772661    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6985ddbc8-pvcb7_9a882a69-59de-4dd8-9411-5f53baf13da5/router/0.log"
Jul 20 19:46:21.407438 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:21.407412    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-ltxjc_d5499da4-600e-40bf-b3c3-5e6290fb78ee/main/0.log"
Jul 20 19:46:30.506063 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:30.506032    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gtmfg_bd4662d5-a409-4422-a2a5-47356519bf53/global-pull-secret-syncer/0.log"
Jul 20 19:46:30.653265 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:30.653234    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xrmsp_6cd4b6e1-8b4f-4960-b455-af290cb08b9b/konnectivity-agent/0.log"
Jul 20 19:46:30.720250 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:30.720226    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-250.ec2.internal_f25f41b37a59fc0cc578a7d81793a28f/haproxy/0.log"
Jul 20 19:46:35.559525 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:35.559494    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hqwmw_d1441c0e-c7ec-4f9b-a5b4-47f4489efca2/limitador/0.log"
Jul 20 19:46:37.138665 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:37.138634    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2967d194-9039-45be-8bcd-3b70c897015c/alertmanager/0.log"
Jul 20 19:46:37.162948 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:37.162920    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2967d194-9039-45be-8bcd-3b70c897015c/config-reloader/0.log"
Jul 20 19:46:37.189985 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:37.189960    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2967d194-9039-45be-8bcd-3b70c897015c/kube-rbac-proxy-web/0.log"
Jul 20 19:46:37.211629 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:37.211606    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2967d194-9039-45be-8bcd-3b70c897015c/kube-rbac-proxy/0.log"
Jul 20 19:46:37.233457 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:37.233432    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2967d194-9039-45be-8bcd-3b70c897015c/kube-rbac-proxy-metric/0.log"
Jul 20 19:46:37.255535 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:37.255517    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2967d194-9039-45be-8bcd-3b70c897015c/prom-label-proxy/0.log"
Jul 20 19:46:37.276993 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:37.276974    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2967d194-9039-45be-8bcd-3b70c897015c/init-config-reloader/0.log"
Jul 20 19:46:37.312146 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:37.312114    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-v966b_ea592eba-3f66-43c3-8235-7dee7375e218/cluster-monitoring-operator/0.log"
Jul 20 19:46:37.336849 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:37.336816    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-v2psj_3fed9cbe-8183-44ab-ac42-23baf9c13b4c/kube-state-metrics/0.log"
Jul 20 19:46:37.355953 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:37.355921    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-v2psj_3fed9cbe-8183-44ab-ac42-23baf9c13b4c/kube-rbac-proxy-main/0.log"
Jul 20 19:46:37.376989 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:37.376966    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-v2psj_3fed9cbe-8183-44ab-ac42-23baf9c13b4c/kube-rbac-proxy-self/0.log"
Jul 20 19:46:37.402474 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:37.402418    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-766d85bd97-b89tw_8c77cbf2-1a30-4069-8eee-e4c9b56787e7/metrics-server/0.log"
Jul 20 19:46:37.643808 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:37.643785    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qtzqr_180956ae-0304-43a1-a2f6-74302402e25b/node-exporter/0.log"
Jul 20 19:46:37.667425 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:37.667374    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qtzqr_180956ae-0304-43a1-a2f6-74302402e25b/kube-rbac-proxy/0.log"
Jul 20 19:46:37.695486 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:37.695470    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qtzqr_180956ae-0304-43a1-a2f6-74302402e25b/init-textfile/0.log"
Jul 20 19:46:38.079626 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:38.079596    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-7qcjv_012fde97-534a-4d50-9241-2ac475bd96a6/prometheus-operator-admission-webhook/0.log"
Jul 20 19:46:38.191878 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:38.191858    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f4df8445-xwwjm_cc707e43-07dd-4fa6-b6cc-341d6f443cd5/thanos-query/0.log"
Jul 20 19:46:38.216150 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:38.216111    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f4df8445-xwwjm_cc707e43-07dd-4fa6-b6cc-341d6f443cd5/kube-rbac-proxy-web/0.log"
Jul 20 19:46:38.236827 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:38.236811    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f4df8445-xwwjm_cc707e43-07dd-4fa6-b6cc-341d6f443cd5/kube-rbac-proxy/0.log"
Jul 20 19:46:38.259650 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:38.259634    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f4df8445-xwwjm_cc707e43-07dd-4fa6-b6cc-341d6f443cd5/prom-label-proxy/0.log"
Jul 20 19:46:38.282868 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:38.282849    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f4df8445-xwwjm_cc707e43-07dd-4fa6-b6cc-341d6f443cd5/kube-rbac-proxy-rules/0.log"
Jul 20 19:46:38.304561 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:38.304545    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78f4df8445-xwwjm_cc707e43-07dd-4fa6-b6cc-341d6f443cd5/kube-rbac-proxy-metrics/0.log"
Jul 20 19:46:39.682623 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:39.682593    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-t95nv_f9a45bf4-ad3e-4d9e-a588-aa6ef7c405cd/networking-console-plugin/0.log"
Jul 20 19:46:40.251694 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.251667    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/1.log"
Jul 20 19:46:40.255738 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.255709    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-5nbcw_9e6ad052-9fd5-4478-8002-f2546b4df236/console-operator/2.log"
Jul 20 19:46:40.622323 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.622246    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"]
Jul 20 19:46:40.622606 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.622593    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0b378a4-de69-4539-89c4-185010d19c16" containerName="revoke-keys"
Jul 20 19:46:40.622654 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.622607    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0b378a4-de69-4539-89c4-185010d19c16" containerName="revoke-keys"
Jul 20 19:46:40.622654 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.622624    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fde06ee-3b73-4d03-a33a-59bbef57ce54" containerName="maas-api"
Jul 20 19:46:40.622654 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.622631    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fde06ee-3b73-4d03-a33a-59bbef57ce54" containerName="maas-api"
Jul 20 19:46:40.622654 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.622650    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b538bf-b2d5-4a08-acbe-7a10e1328d3e" containerName="maas-api"
Jul 20 19:46:40.622776 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.622655    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b538bf-b2d5-4a08-acbe-7a10e1328d3e" containerName="maas-api"
Jul 20 19:46:40.622776 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.622712    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0b378a4-de69-4539-89c4-185010d19c16" containerName="revoke-keys"
Jul 20 19:46:40.622776 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.622723    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fde06ee-3b73-4d03-a33a-59bbef57ce54" containerName="maas-api"
Jul 20 19:46:40.622776 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.622729    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b538bf-b2d5-4a08-acbe-7a10e1328d3e" containerName="maas-api"
Jul 20 19:46:40.626166 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.626146    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:40.628509 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.628479    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxb5l\"/\"openshift-service-ca.crt\""
Jul 20 19:46:40.629309 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.629290    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wxb5l\"/\"default-dockercfg-5rgks\""
Jul 20 19:46:40.629406 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.629345    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wxb5l\"/\"kube-root-ca.crt\""
Jul 20 19:46:40.633834 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.633811    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"]
Jul 20 19:46:40.755838 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.755813    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdb3383d-2681-4e2e-af9f-5873b29af7f1-lib-modules\") pod \"perf-node-gather-daemonset-6lr7p\" (UID: \"bdb3383d-2681-4e2e-af9f-5873b29af7f1\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:40.756190 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.755856    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdb3383d-2681-4e2e-af9f-5873b29af7f1-podres\") pod \"perf-node-gather-daemonset-6lr7p\" (UID: \"bdb3383d-2681-4e2e-af9f-5873b29af7f1\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:40.756190 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.755886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdb3383d-2681-4e2e-af9f-5873b29af7f1-sys\") pod \"perf-node-gather-daemonset-6lr7p\" (UID: \"bdb3383d-2681-4e2e-af9f-5873b29af7f1\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:40.756190 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.755929    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdb3383d-2681-4e2e-af9f-5873b29af7f1-proc\") pod \"perf-node-gather-daemonset-6lr7p\" (UID: \"bdb3383d-2681-4e2e-af9f-5873b29af7f1\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:40.756190 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.755966    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dllh6\" (UniqueName: \"kubernetes.io/projected/bdb3383d-2681-4e2e-af9f-5873b29af7f1-kube-api-access-dllh6\") pod \"perf-node-gather-daemonset-6lr7p\" (UID: \"bdb3383d-2681-4e2e-af9f-5873b29af7f1\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:40.857175 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.857146    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dllh6\" (UniqueName: \"kubernetes.io/projected/bdb3383d-2681-4e2e-af9f-5873b29af7f1-kube-api-access-dllh6\") pod \"perf-node-gather-daemonset-6lr7p\" (UID: \"bdb3383d-2681-4e2e-af9f-5873b29af7f1\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:40.857303 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.857191    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdb3383d-2681-4e2e-af9f-5873b29af7f1-lib-modules\") pod \"perf-node-gather-daemonset-6lr7p\" (UID: \"bdb3383d-2681-4e2e-af9f-5873b29af7f1\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:40.857303 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.857232    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdb3383d-2681-4e2e-af9f-5873b29af7f1-podres\") pod \"perf-node-gather-daemonset-6lr7p\" (UID: \"bdb3383d-2681-4e2e-af9f-5873b29af7f1\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:40.857303 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.857257    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdb3383d-2681-4e2e-af9f-5873b29af7f1-sys\") pod \"perf-node-gather-daemonset-6lr7p\" (UID: \"bdb3383d-2681-4e2e-af9f-5873b29af7f1\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:40.857303 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.857296    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdb3383d-2681-4e2e-af9f-5873b29af7f1-proc\") pod \"perf-node-gather-daemonset-6lr7p\" (UID: \"bdb3383d-2681-4e2e-af9f-5873b29af7f1\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:40.857472 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.857335    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdb3383d-2681-4e2e-af9f-5873b29af7f1-lib-modules\") pod \"perf-node-gather-daemonset-6lr7p\" (UID: \"bdb3383d-2681-4e2e-af9f-5873b29af7f1\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:40.857472 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.857362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdb3383d-2681-4e2e-af9f-5873b29af7f1-sys\") pod \"perf-node-gather-daemonset-6lr7p\" (UID: \"bdb3383d-2681-4e2e-af9f-5873b29af7f1\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:40.857472 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.857375    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdb3383d-2681-4e2e-af9f-5873b29af7f1-podres\") pod \"perf-node-gather-daemonset-6lr7p\" (UID: \"bdb3383d-2681-4e2e-af9f-5873b29af7f1\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:40.857472 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.857369    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdb3383d-2681-4e2e-af9f-5873b29af7f1-proc\") pod \"perf-node-gather-daemonset-6lr7p\" (UID: \"bdb3383d-2681-4e2e-af9f-5873b29af7f1\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:40.864539 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.864514    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dllh6\" (UniqueName: \"kubernetes.io/projected/bdb3383d-2681-4e2e-af9f-5873b29af7f1-kube-api-access-dllh6\") pod \"perf-node-gather-daemonset-6lr7p\" (UID: \"bdb3383d-2681-4e2e-af9f-5873b29af7f1\") " pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:40.876757 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.876706    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-gxnnq_9fff8118-980d-4191-81b9-0b78ad1faa13/download-server/0.log"
Jul 20 19:46:40.937686 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:40.937671    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:41.085531 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:41.085509    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"]
Jul 20 19:46:41.087571 ip-10-0-140-250 kubenswrapper[2560]: W0720 19:46:41.087546    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbdb3383d_2681_4e2e_af9f_5873b29af7f1.slice/crio-70ea6dd9d0bad5b981de21d0b997a91f761eb2db5865cf86c688e9facefd154e WatchSource:0}: Error finding container 70ea6dd9d0bad5b981de21d0b997a91f761eb2db5865cf86c688e9facefd154e: Status 404 returned error can't find the container with id 70ea6dd9d0bad5b981de21d0b997a91f761eb2db5865cf86c688e9facefd154e
Jul 20 19:46:41.374296 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:41.374261    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p" event={"ID":"bdb3383d-2681-4e2e-af9f-5873b29af7f1","Type":"ContainerStarted","Data":"63fb0bb9f7c3145eda3d1024f70e478bb8aeec05a3be1d43b7312d0a0160d675"}
Jul 20 19:46:41.374460 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:41.374317    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p" event={"ID":"bdb3383d-2681-4e2e-af9f-5873b29af7f1","Type":"ContainerStarted","Data":"70ea6dd9d0bad5b981de21d0b997a91f761eb2db5865cf86c688e9facefd154e"}
Jul 20 19:46:41.374460 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:41.374379    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:41.390173 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:41.390114    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p" podStartSLOduration=1.390100028 podStartE2EDuration="1.390100028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 19:46:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 19:46:41.389506573 +0000 UTC m=+2764.185513905" watchObservedRunningTime="2026-07-20 19:46:41.390100028 +0000 UTC m=+2764.186107360"
Jul 20 19:46:41.542477 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:41.542405    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-6g49j_cc2e9a44-eb77-45b0-afe6-d3a8ea8d5ae0/volume-data-source-validator/0.log"
Jul 20 19:46:42.565962 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:42.565938    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5lswm_a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf/dns/0.log"
Jul 20 19:46:42.587726 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:42.587705    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5lswm_a5bd5c9d-7b47-4f04-adcf-b0a8a6b8aedf/kube-rbac-proxy/0.log"
Jul 20 19:46:42.785539 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:42.785509    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vt7z5_7a05c4ac-04f4-4ff5-adc2-411cffcb815c/dns-node-resolver/0.log"
Jul 20 19:46:43.394222 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:43.394193    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-87ghh_510bef60-8698-405f-a2bd-7200700ecb52/node-ca/0.log"
Jul 20 19:46:44.539340 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:44.539306    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-x7stb_8247b686-125a-4945-86fa-7ba56a3207ef/discovery/0.log"
Jul 20 19:46:44.747559 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:44.747531    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6985ddbc8-pvcb7_9a882a69-59de-4dd8-9411-5f53baf13da5/router/0.log"
Jul 20 19:46:45.484846 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:45.484814    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9cnwf_f188b329-3e3d-4340-8dcc-75ba3ba8d7c0/serve-healthcheck-canary/0.log"
Jul 20 19:46:45.989643 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:45.989618    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-hp5zw_b880cd4d-9983-4244-92e6-da9fcbc6539f/insights-operator/0.log"
Jul 20 19:46:45.990510 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:45.990494    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-hp5zw_b880cd4d-9983-4244-92e6-da9fcbc6539f/insights-operator/1.log"
Jul 20 19:46:46.012310 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:46.012289    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8n78l_b9dffe8c-6686-4451-a0d1-8fa4100c0b88/kube-rbac-proxy/0.log"
Jul 20 19:46:46.034105 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:46.034089    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8n78l_b9dffe8c-6686-4451-a0d1-8fa4100c0b88/exporter/0.log"
Jul 20 19:46:46.057501 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:46.057481    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8n78l_b9dffe8c-6686-4451-a0d1-8fa4100c0b88/extractor/0.log"
Jul 20 19:46:47.389265 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:47.389236    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wxb5l/perf-node-gather-daemonset-6lr7p"
Jul 20 19:46:49.019028 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:49.018998    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc69fccc8-nsn6m_9693c682-68d1-49fe-9dc2-6c6775f2cbc1/manager/0.log"
Jul 20 19:46:49.043137 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:49.043094    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc69fccc8-nsn6m_9693c682-68d1-49fe-9dc2-6c6775f2cbc1/copy-manifests/0.log"
Jul 20 19:46:50.271737 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:50.271705    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-569f4dcc7-lb95z_37f30b1a-bd1e-4cc5-aece-ca1401794f7b/manager/0.log"
Jul 20 19:46:50.522242 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:50.522171    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-x7stb_8247b686-125a-4945-86fa-7ba56a3207ef/discovery/0.log"
Jul 20 19:46:50.679918 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:50.679895    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6985ddbc8-pvcb7_9a882a69-59de-4dd8-9411-5f53baf13da5/router/0.log"
Jul 20 19:46:52.188293 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:52.188262    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-x7stb_8247b686-125a-4945-86fa-7ba56a3207ef/discovery/0.log"
Jul 20 19:46:52.345019 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:52.344982    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6985ddbc8-pvcb7_9a882a69-59de-4dd8-9411-5f53baf13da5/router/0.log"
Jul 20 19:46:55.809661 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:55.809636    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-f7fls_b1805f53-670a-44fc-89d6-adac1bf3cddf/kube-storage-version-migrator-operator/1.log"
Jul 20 19:46:55.810535 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:55.810514    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-f7fls_b1805f53-670a-44fc-89d6-adac1bf3cddf/kube-storage-version-migrator-operator/0.log"
Jul 20 19:46:56.813668 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:56.813641    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g85p9_e0848dc8-f613-4656-aa5e-c122e5b2650a/kube-multus-additional-cni-plugins/0.log"
Jul 20 19:46:56.837238 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:56.837218    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g85p9_e0848dc8-f613-4656-aa5e-c122e5b2650a/egress-router-binary-copy/0.log"
Jul 20 19:46:56.857477 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:56.857459    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g85p9_e0848dc8-f613-4656-aa5e-c122e5b2650a/cni-plugins/0.log"
Jul 20 19:46:56.877457 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:56.877439    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g85p9_e0848dc8-f613-4656-aa5e-c122e5b2650a/bond-cni-plugin/0.log"
Jul 20 19:46:56.899385 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:56.899368    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g85p9_e0848dc8-f613-4656-aa5e-c122e5b2650a/routeoverride-cni/0.log"
Jul 20 19:46:56.919453 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:56.919437    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g85p9_e0848dc8-f613-4656-aa5e-c122e5b2650a/whereabouts-cni-bincopy/0.log"
Jul 20 19:46:56.939602 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:56.939587    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g85p9_e0848dc8-f613-4656-aa5e-c122e5b2650a/whereabouts-cni/0.log"
Jul 20 19:46:57.318241 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:57.318216    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n47zz_b834d003-a3cf-401e-a040-3800e5a5a153/kube-multus/0.log"
Jul 20 19:46:57.415750 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:57.415724    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2rwr8_1a2c26c6-d757-4ddc-af69-e9fa0515a076/network-metrics-daemon/0.log"
Jul 20 19:46:57.434449 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:57.434420    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2rwr8_1a2c26c6-d757-4ddc-af69-e9fa0515a076/kube-rbac-proxy/0.log"
Jul 20 19:46:58.502952 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:58.502925    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-controller/0.log"
Jul 20 19:46:58.524448 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:58.524422    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/1.log"
Jul 20 19:46:58.524610 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:58.524550    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovn-acl-logging/0.log"
Jul 20 19:46:58.548625 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:58.548602    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/kube-rbac-proxy-node/0.log"
Jul 20 19:46:58.580589 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:58.580572    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/kube-rbac-proxy-ovn-metrics/0.log"
Jul 20 19:46:58.603921 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:58.603902    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/northd/0.log"
Jul 20 19:46:58.626621 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:58.626603    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/nbdb/0.log"
Jul 20 19:46:58.649393 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:58.649372    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/sbdb/0.log"
Jul 20 19:46:58.714750 ip-10-0-140-250 kubenswrapper[2560]: I0720 19:46:58.714728    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7jhvx_4a7f0781-9683-42bb-bdb2-f6bf03f313e3/ovnkube-controller/0.log"